Distributed search - Deepstash

Explore the World's Best Ideas

Join today and uncover 100+ curated journeys from 50+ topics. Unlock access to our mobile app with extensive features.

Distributed search

Distributed search

Searching an index requires Elasticsearch to query a set of shards that contain all your data. Since shards are distributed across multiple nodes, this query will be forwarded to multiple nodes.

Search process

  1. When you make a search request, the node that receives it forwards it to a set of shards that contain all your data. These can be either primary shards or replicas, and are chosen in a round-robin fashion.
  2. Then, the coordinator node gathers the results from those shards, aggregates and sorts them, and sends the results back to the client.

4

15 reads

MORE IDEAS ON THIS

Shards

Elasticsearch divides each index into shards, which are standalone Lucene indices. These can be either primary shards or replicas.Β 

The number of shards and replicas per shard is set when a new index is created. After that, Elasticsearch takes care of evenly distrib...

4

20 reads

Distributed indexing

Distributed indexing

Indexing process

  1. When you index a document, the node that receives your HTTP request determines which shard should contain your document, based on a hash of the document’s ID.
  2. Then, it forwards the document to the node holding that prim...

4

13 reads

Terminology

Terminology

  • Node = An Elasticsearch process. It's recommended to run each node on a separate server.
  • Cluster = Set of one or more nodes.
  • Shard = Part of an index, used for distributing data across the cluster.

5

99 reads

CURATED FROM

IDEAS CURATED BY

ocpodariu

Alt account of @ocp. I use it to stash ideas about software engineering

πŸ“– Elasticsearch in Action

β€œ

Read & Learn

20x Faster

without
deepstash

with
deepstash

with

deepstash

Personalized microlearning

β€”

100+ Learning Journeys

β€”

Access to 200,000+ ideas

β€”

Access to the mobile app

β€”

Unlimited idea saving

β€”

β€”

Unlimited history

β€”

β€”

Unlimited listening to ideas

β€”

β€”

Downloading & offline access

β€”

β€”

Supercharge your mind with one idea per day

Enter your email and spend 1 minute every day to learn something new.

Email

I agree to receive email updates