You are currently viewing How To Create Elasticsearch Cluster In AWS

How To Create Elasticsearch Cluster In AWS

How To Create Elasticsearch Cluster In AWS

Hello Everyone

Welcome to CloudAffaire and this is Debjeet.

In this series, we will explore one of the most popular log management tools in DevOps better known as ELK (E=Elasticserach, L=Logstash, K=Kibana) stack.

What Is ELK stack in DevOps?

The ELK Stack is a collection of three open-source products — Elasticsearch, Logstash, and Kibana — all developed, managed and maintained by Elastic. Elasticsearch is an open-source, full-text search and analysis engine, based on the Apache Lucene search engine. Logstash is a log aggregator that collects data from various input sources, executes different transformations and enhancements and then ships the data to various supported output destinations. Kibana is a visualization layer that works on top of Elasticsearch, providing users with the ability to analyze and visualize the data. Together, these different components are most commonly used for monitoring, troubleshooting and securing IT environments, business intelligence, and web analytics.

How ELK stack fits in AWS?

In AWS there are two ways you can deploy an ELK stack, using fully managed services (E=Elasticsearch, L=Lambda, K=Kibana) or customer-managed (Install and configure ELK in EC2). In this blog post, we will create the Elasticsearch cluster using AWS Elasticsearch service (Kibana in included in AWS Elasticsearch service) and then we will insert some data to our Elasticsearch cluster and finally view the data in Kibana dashboard.

How To Create Elasticsearch Cluster In AWS:

Step 1: Create an access policy for your Elasticsearch cluster.

Step 2: Create your Elasticsearch Cluster.

Step 3: Get details of your Elasticsearch cluster.

Step 4: Insert some data in your Elasticsearch cluster.

Step 5: Configure your Elasticsearch Kibana dashboard.

How To Create Elasticsearch Cluster In AWS

How To Create Elasticsearch Cluster In AWS

Step 5: Cleanup.

To get more details on ELK, please refer below documentation.

https://www.elastic.co/guide/index.html