The system design library
Search and filter every curated system design video, article, repository and paper in one place.
51 resources
Ashish Pratap Singh
System design concepts, low-level design and interview problems explained from first principles.
YouTubeBeginnerBy Ashish Pratap Singh
ByteMonk
Short animated explainers of system design concepts, distributed systems and how large platforms are built.
YouTubeBeginnerBy ByteMonk
Scalable Web Architecture and Distributed Systems
A full chapter on the building blocks of large websites: availability, performance, reliability, scalability, caches, proxies, indexes, load balancers and queues. Free to read here under CC BY 3.0.
BlogsBeginner40 minRead hereFree from the authorBy Kate Matsudaira · The Architecture of Open Source Applications
Backend Developer Roadmap
A visual guide to the skills a backend engineer builds, from databases to caching and APIs.
CoursesBeginnerBy roadmap.sh community · roadmap.sh
ByteByteGo Newsletter
A weekly illustrated newsletter on system design topics and how well-known systems work.
Podcasts & NewslettersBeginnerBy Alex Xu and Sahn Lam · ByteByteGo
CDN Services at Spotify
Spotify built its business on flawless content delivery. Our streaming platform serves up more than 50 million tracks (plus an array of images and other assets) to more than 230 million monthly active users around the world — making us o…
Case StudiesIntermediateRead hereBy Spotify engineers · Spotify
Consistent Hashing and Random Trees (paper)
The original consistent-hashing paper, written for distributing web caches.
PapersAdvancedRead hereBy Karger et al. · MIT
Cross-Region Caching Library at Wix
At the Wix server infrastructure group we work daily on a set of tools that help make the lives of our backend developers easier, while also helping them deliver their code to production faster and safer. Wix handles huge traffic with mo…
Case StudiesIntermediateRead hereBy Wix engineers · Wix
Distributed Cache at Zalando
Using Akka cluster-sharding and Akka HTTP on Kubernetes
Case StudiesIntermediateRead hereBy Zalando engineers · Zalando
Distributed Cache for S3 at ClickHouse
ClickHouse Cloud now has a distributed cache for object storage: shared, low-latency, and built for speed. This post dives into the architecture, why it matters, and how it performs.
Case StudiesIntermediateRead hereBy ClickHouse engineers · ClickHouse
Distributed Caching
This blog post is part 2 in the “Scaling Wix to over 100M Users” series. Read part 1 here. When Wix started, we used the Tomcat, Hibernate, and Ehcache stack with a MySQL database and Flash front end. Why did we choose that stack? Simply…
Case StudiesIntermediateRead hereBy Wix engineers · Wix
Estimating the Cache Efficiency using Big Data at Allegro
Caching is a good and well-known technique used to increase application performance and decrease overall system load. Usually small or medium data sets, which are often read and rarely changed, are considered as a good candidate for cach…
Case StudiesIntermediateRead hereBy Allegro engineers · Allegro
Flannel: An Application-Level Edge Cache to Make Slack Scale
Why Slack put a cache close to users to avoid loading all workspace data at startup, and how it keeps it fresh.
Case StudiesAdvancedRead hereBy Slack Engineering · Slack
MDN: HTTP caching
Cache-Control, validation and shared versus private caches.
DocumentationIntermediateBy MDN contributors · Mozilla
Memory Optimization in Redis at Wattpad
A real-world engineering write-up from Wattpad on distributed Caching.
Case StudiesIntermediateBy Wattpad engineers · Wattpad
Memsniff: Robust Memcache Traffic Analyzer at Box
“Box is the leader in Intelligent Content Management. Its platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform business workflows with enterprise AI.”
Case StudiesIntermediateRead hereBy Box engineers · Box
Moving persistent data out of Redis at Github
Historically, we have used Redis in two ways at GitHub: We used it as an LRU cache to conveniently store the results of expensive computations over data originally persisted in…
Case StudiesIntermediateRead hereBy Github engineers · Github
Optimizing Redis Storage at Deliveroo
Counting unique users, checking if a credit card has already been used, or checking if this is a mobile user’s first visit ever — all of these require maintaining a large set of fingerprints (unique visitor ID, card fingerprint, IDFVs de…
Case StudiesIntermediateRead hereBy Deliveroo engineers · Deliveroo
Prefetch Caching of Items at eBay
With 1.4 billion listings on eBay, improving the speed to render these listings at scale and accuracy is a huge engineering challenge. We have taken major steps to cache item data, which brings great speed improvements.
Case StudiesIntermediateRead hereBy eBay engineers · eBay
Pycache: In-process Caching at Quora
When rendering a Web page, Quora webservers need to access many different kinds of data. Some are easy to compute (what's the name for the user with ID 2667222?), and some are more difficult (how many users follow any of the topics that …
Case StudiesIntermediateBy Quora engineers · Quora
Ratings & Reviews (2 parts) at Flipkart
This article follows from the Ratings & Reviews @ Flipkart [Part 1]. In the previous article we discussed about the architecture of the…
Case StudiesIntermediateBy Flipkart engineers · Flipkart
Redis
The source of the in-memory data store, a compact C codebase worth reading.
GitHubAdvancedBy Redis · Redis Ltd.
Redis at Trivago
A real-world engineering write-up from Trivago on distributed Caching.
Case StudiesIntermediateBy Trivago engineers · Trivago
Redis Blog
Redis features, data structures and use cases.
BlogsIntermediateBy Redis engineers · Redis Ltd.