Swiftorial Logo
Home
Swift Lessons
Matchups
CodeSnaps
Tutorials
Career
Resources

Nodes and Clusters in Elasticsearch

Introduction to Elasticsearch

Elasticsearch is a distributed, RESTful search and analytics engine capable of solving a growing number of use cases. It allows you to store, search, and analyze big volumes of data quickly and in near real-time.

What is a Node?

A node in Elasticsearch is a single instance of Elasticsearch. It is a running instance of the Elasticsearch software which stores data and participates in the cluster’s indexing and search capabilities.

Example:

If you start Elasticsearch on your laptop and your server, you will have two separate nodes.

Types of Nodes

There are several types of nodes in Elasticsearch, each serving a different purpose:

  • Master Node: Responsible for cluster-wide settings and cluster health.
  • Data Node: Stores data and performs data-related operations such as CRUD, search, and aggregations.
  • Client Node: Acts as a load balancer, routing requests to the appropriate node.
  • Ingest Node: Preprocesses documents before the actual indexing.

What is a Cluster?

A cluster in Elasticsearch is a collection of one or more nodes (servers) that together holds your entire data and provides federated indexing and search capabilities across all nodes. A cluster is identified by a unique name which defaults to "elasticsearch".

Example:

If you have three nodes (Node A, Node B, Node C) configured to be part of the same cluster, they will work together to distribute data and load.

Setting Up a Node

To set up a node, you need to install Elasticsearch on your machine. Below are the steps to start a node:

  1. Download and install Elasticsearch from the official website.
  2. Open the elasticsearch.yml configuration file and set the node.name and cluster.name.
  3. Start the Elasticsearch service using the command:
    ./bin/elasticsearch

Once started, the node will automatically join the cluster specified in the configuration file.

Cluster Health

Monitoring cluster health is crucial. Elasticsearch provides an API to check the health status of your cluster:

GET /_cluster/health

The response will provide information about the cluster’s status, number of nodes, and more. The status can be:

  • Green: All primary and replica shards are active.
  • Yellow: All primary shards are active but some replicas are not.
  • Red: Some primary shards are not active.
{ "cluster_name": "elasticsearch", "status": "green", "number_of_nodes": 3, "number_of_data_nodes": 2, "active_primary_shards": 10, "active_shards": 20, "relocating_shards": 0, "initializing_shards": 0, "unassigned_shards": 0 }

Conclusion

Understanding nodes and clusters is fundamental to effectively managing and scaling Elasticsearch. Nodes are individual instances that store data and perform operations, while clusters are collections of nodes that provide distributed indexing and search capabilities. By setting up and monitoring nodes and clusters, you can ensure efficient data management and search performance.