Elasticsearch Cluster Layout - Deepstash

Keep reading for FREE

Terminology

Terminology

  • Node = An Elasticsearch process. It's recommended to run each node on a separate server.
  • Cluster = Set of one or more nodes.
  • Shard = Part of an index, used for distributing data across the cluster.

5

99 reads

Shards

Elasticsearch divides each index into shards, which are standalone Lucene indices. These can be either primary shards or replicas. 

The number of shards and replicas per shard is set when a new index is created. After that, Elasticsearch takes care of evenly distributing the shards across the cluster. For maximum availability and performance, it ensures that replica shards are not on the same node as their correspondent primary shard.

4

20 reads

Distributed indexing

Distributed indexing

Indexing process

  1. When you index a document, the node that receives your HTTP request determines which shard should contain your document, based on a hash of the document’s ID.
  2. Then, it forwards the document to the node holding that primary shard.
  3. Once the shard is updated, the document is sent to be indexed in all replicas of that shard.
  4. Finally, the indexing command returns after all replicas are updated.

This process keeps replicas in sync and allows them to serve searches and to be promoted to primary shards in case the original primary is unavailable.

4

13 reads

Distributed search

Distributed search

Searching an index requires Elasticsearch to query a set of shards that contain all your data. Since shards are distributed across multiple nodes, this query will be forwarded to multiple nodes.

Search process

  1. When you make a search request, the node that receives it forwards it to a set of shards that contain all your data. These can be either primary shards or replicas, and are chosen in a round-robin fashion.
  2. Then, the coordinator node gathers the results from those shards, aggregates and sorts them, and sends the results back to the client.

4

15 reads

CURATED BY

ocpodariu

Alt account of @ocp. I use it to stash ideas about software engineering

CURATOR'S NOTE

📖 Elasticsearch in Action

stash-superman-illustration

Explore the World’s

Best Ideas

200,000+ ideas on pretty much any topic. Created by the smartest people around & well-organized so you can explore at will.

An Idea for Everything

Explore the biggest library of insights. And we've infused it with powerful filtering tools so you can easily find what you need.

Knowledge Library

Powerful Saving & Organizational Tools

Save ideas for later reading, for personalized stashes, or for remembering it later.

# Personal Growth

Take Your Ideas

Anywhere

Organize your ideas & listen on the go. And with Pro, there are no limits.

Listen on the go

Just press play and we take care of the words.

Never worry about spotty connections

No Internet access? No problem. Within the mobile app, all your ideas are available, even when offline.

Get Organized with Stashes

Ideas for your next work project? Quotes that inspire you? Put them in the right place so you never lose them.

Join

2 Million Stashers

4.8

5,740 Reviews

App Store

4.7

72,690 Reviews

Google Play

Shankul Varada

Best app ever! You heard it right. This app has helped me get back on my quest to get things done while equipping myself with knowledge everyday.

samz905

Don’t look further if you love learning new things. A refreshing concept that provides quick ideas for busy thought leaders.

Ashley Anthony

This app is LOADED with RELEVANT, HELPFUL, AND EDUCATIONAL material. It is creatively intellectual, yet minimal enough to not overstimulate and create a learning block. I am exceptionally impressed with this app!

Sean Green

Great interesting short snippets of informative articles. Highly recommended to anyone who loves information and lacks patience.

Ghazala Begum

Even five minutes a day will improve your thinking. I've come across new ideas and learnt to improve existing ways to become more motivated, confident and happier.

Giovanna Scalzone

Brilliant. It feels fresh and encouraging. So many interesting pieces of information that are just enough to absorb and apply. So happy I found this.

Laetitia Berton

I have only been using it for a few days now, but I have found answers to questions I had never consciously formulated, or to problems I face everyday at work or at home. I wish I had found this earlier, highly recommended!

Jamyson Haug

Great for quick bits of information and interesting ideas around whatever topics you are interested in. Visually, it looks great as well.

Read & Learn

20x Faster

without
deepstash

with
deepstash

with

deepstash

Access to 200,000+ ideas

Access to the mobile app

Unlimited idea saving & library

Unlimited history

Unlimited listening to ideas

Downloading & offline access

Personalized recommendations

Supercharge your mind with one idea per day

Enter your email and spend 1 minute every day to learn something new.

Email

I agree to receive email updates