Explore the World's Best Ideas
Join today and uncover 100+ curated journeys from 50+ topics. Unlock access to our mobile app with extensive features.
Scaling
Systems can be scaled:
- Vertically - by increasing the resources of a specific node (more CPU, memory, disk etc.). This is easier to do, but it's limited. You can only add so many CPU cores and memory.
- Horizontally - by adding more nodes of the same kind. This usually requires adding a load balancer in front of your nodes to distribute the load evenly.
12
125 reads
MORE IDEAS ON THIS
Networking metrics
- Bandwidth - Maximum amount of data that can be transferred in a unit of time. Usually expressed in bits per second.
- Throughput - Amount of data that is actually transferred in a unit of time.
- Latency - How long it takes data ...
13
81 reads
Caching
Caching systems are usually in-memory key-value databases that provide very fast access to data. They sit between your application and the database.
Depending on your use case, you can either cache only the results of the database queries, or cache the entire response objec...
12
63 reads
Database sharding
Sharding means splitting your data across multiple nodes. This can be done in different ways:
1. Vertical sharding
- Store tables on different nodes.
- Drawback: If one of these tables gets very large, then you need to re-shard that datab...
12
65 reads
Database denormalization
Joins in relational databases get very slow as the system grows bigger. You should denormalize your data to avoid joins and speed up your queries.
Normalized databases are designed to minimize redundancy, while denormalized databases are designed to optimize read ti...
13
83 reads
Asynchronous processing
Slow operations should be done asynchronously to avoid making users wait for long periods of time until their requests are processed.
Sometimes this can be done in advance, by pre-processing data that you know users will need. For example, a forum might per...
12
63 reads
CURATED FROM
CURATED BY
Alt account of @ocp. I use it to stash ideas about software engineering
📖 Cracking the Coding Interview
“
More like this
Big data Hadoop
- Ability to store and process huge amounts of any kind of data, quickly. With data volumes and varieties constantly increasing, especially from social media and the Internet of Things (IoT) , th...
Read & Learn
20x Faster
without
deepstash
with
deepstash
with
deepstash
Access to 200,000+ ideas
—
Access to the mobile app
—
Unlimited idea saving & library
—
—
Unlimited history
—
—
Unlimited listening to ideas
—
—
Downloading & offline access
—
—
Personalized recommendations
—
—
Supercharge your mind with one idea per day
Enter your email and spend 1 minute every day to learn something new.
I agree to receive email updates