Setup Elasticsearch Cluster + Kibana 8.x

This video shows how to set up an #elasticsearch cluster with 5 nodes with #kibana.

This video shows you how to create SSL with Let's Encrypt

Configuration files used can be found here:

NOTE 1: It would be a good idea to also do the following your in installation for production usage:
- use a firewall to protect unnecessary ports
- change default port numbers for elastic and kibana (explained in video)

Where the http.p12 is a copy of /etc/elasticsearch/certs/http.p12 from node 1

Table of Contents:
00:00 - Introduction
03:37 - Install Elasticsearch
07:15 - Configure and run node 1 (master node)
16:20 - Add node 2, 3, 4 and 5
29:55 - Publicly signed SSL for node 1
37:14 - Split-brain effect
42:55 - Install Kibana
54:45 - Summary

[evermightsystems]

UPDATES: since the release of this video, elasticsearch has released upgrades with some breaking changes. See the description of our video for any that we discover. And if you learn of anything, please share in the comments below to help everyone else out. Thank you in advance!

[shafiurrahman]

Appreciate your hard work. It was detailed on every step, which is rare to find. Thank you.

[mohammadmuzibulhaque]

This is really good stuff. I really liked the way you explained everything.

[anuragseven]

Thank you very much, your video help me add elastic node to an existing cluster (I am using ES 8..11.3 and it worked very well), thanks a ton, the ES people should really update their docs regarding using --enrollment-token instead of elasticsearch --enrollment-token <enrollment-token> .

[Aamenvi]

This is a blueprint of what a Tutorial should be.

[JawadHaiderSyed]

Exactly what I was looking for. Thank you :)

[Mrmidoo]

Thank you for this video, it is very useful.

[Privacy-LOST]

Hi John ! First off, thank you so much for this very precious and useful walkthrough. I have been carefully watching it every day for more than a week now, to reproduce every step and understand everything thoroughly. You give a lot of insight and that is so valuable. I do have my let's encrypt certs, but for the sake of completeness, I would like to use the self signed certificates to connect from Kibana to the cluster as well. I want to be able to do both dev and production setups. And honestly, I am drowning here, as there does not seem to be a unique way to tackle things.there are so many moving pieces. My cluster is working fine with default self signed certs, and I do not whish to disturb it, I just want to plug Kibana to it using self signed certs. I read many documenation pages but as I said, the all assume different cluster setups and mess around with what is already configured properly in your video. If you have any ressources on a step by step basis on how to achieve that, that would be great. Once again, thanks for posting this, it helps a lot !

[DOITWITHCODE]

Thanks for the tutorial. Would you mind creating another video using public certificates ( instead of self-signed )? Please feel free to point me to the documentation if there is one.

[rbjmnim]

Hello, I first formed one node, after a few days, I am trying to add more nodes into the existing cluster, but I am not able to do so, can i know the process how to do.

[eqbudvp]

Thank you for your tutorials, they are very good. Congratulations.
I would like a recommendation for a video or tutorial on monitoring postgres logs (.log or .csv) using elastic-agent and fleetserver (versions 12 to 15).
I tried to implement it, but it doesn't seem to work. I'm confused about whether I need to install and configure filebeat or just use integrations via elastic-agent.

[basdemiremrah]

thank you so much for valuable configurations, l have been asked to configure public signed cert. if you can make a video about that, it would be great!

[po.]

Thank you so much your video help me to know clearly how to setup Elastic cluster for production env, and next can you share another tutorial video How to connect Spirng-boot project with Elastic cluster that we already setup and Log spring-boot project on Kibana, Thank you

[Agnieszka-nxzpkvz]

Great video, detailed and helpful! I have one question. You've mentioned that joining additional node with enrollment-token won't be possible if the configuration of certificates is different than auto-generated. How can we add another node to the cluster with publicly signed certificates already set? Thank you in advance!

[dv]

Thanks you for this video, it is very useful. But I have a problem with cluster connection to kibana with self signed certs. Do you have more info about it?

[jokopurnomo]

Hi Jhon Thank you for your tutorials, very good and detail, can you make another tutorial for installing ELK like this using Docker Swarm Please 😇😇

[SunilKumar-jldl]

Great job!. This is a perfect tutorial. Split-brain problem is something that is missing in most of the other tutorials. Is it possible for a cassandra and redis tutorial in cluster mode?

[MrGreatScorpion]

Hi dear. Thank you for video. I have a question. I installed 2 nodes. and first of them the master. Then I stop the first node, the cluster also down, and not passed to second node as cluster. How can I solve this problem?

[jerryliu]

thanks for the sharing, 1 more question, please. I generated the elastic/kibana service account token but this token only worked on node where it been created, could you help share some idea, thanks in advance

[bunkjvy]

Hi John
Before say anything your video has been one of the best best elasticsearch cluster videos i have seen. so i am creating a gui interface for the implementation of elasticsearch cluster on single and multinode servers. for test purposes, how can i eliminate the whole ssl certificates, because it is just a project, and can i add the elasticsearch on my virtual machine to the cluster