The system design library
Search and filter every curated system design video, article, repository and paper in one place.
91 resources
Ashish Pratap Singh
System design concepts, low-level design and interview problems explained from first principles.
YouTubeBeginnerBy Ashish Pratap Singh
ByteMonk
Short animated explainers of system design concepts, distributed systems and how large platforms are built.
YouTubeBeginnerBy ByteMonk
Scalable Web Architecture and Distributed Systems
A full chapter on the building blocks of large websites: availability, performance, reliability, scalability, caches, proxies, indexes, load balancers and queues. Free to read here under CC BY 3.0.
BlogsBeginner40 minRead hereFree from the authorBy Kate Matsudaira · The Architecture of Open Source Applications
Active Directory Password Blacklisting at Yelp
Active Directory Password Blacklisting Leeren Chang, Software Engineer Apr 16, 2018 Many enterprise professionals use passwords that are weak and easily compromised. Equipped with this knowledge, as well as the...
Case StudiesIntermediateRead hereBy Yelp engineers · Yelp
Akutan: Distributed Knowledge Graph Store at eBay
We're excited to announce the public release of Akutan, a distributed knowledge graph store, under the Apache 2.0 open source license. Akutan is the result of four person-years of exploration and engineering effort, so there's a lot to u…
Case StudiesIntermediateRead hereBy eBay engineers · eBay
AWS Networking Blog
Modernizing a monolith into microservices may require placing each new service in its own AWS account for isolation, independent scaling, and clear ownership. During that migration you hit a hard question: how do you shift a small, preci…
BlogsIntermediateBy Amazon Web Services engineers · Amazon Web Services
Backend Developer Roadmap
A visual guide to the skills a backend engineer builds, from databases to caching and APIs.
CoursesBeginnerBy roadmap.sh community · roadmap.sh
Build Your Own X
Tutorials for building your own Redis, database, Docker, web server and more, to learn how they work.
GitHubIntermediateBy CodeCrafters · GitHub
ByteByteGo Newsletter
A weekly illustrated newsletter on system design topics and how well-known systems work.
Podcasts & NewslettersBeginnerBy Alex Xu and Sahn Lam · ByteByteGo
Cannes: ML saves $1.7M a year on document previews at Dropbox
Recently, we translated the predictive power of machine learning (ML) into $1.7 million a year in infrastructure cost savings by optimizing how Dropbox generates and caches document previews. Machine learning at Dropbox already powers co…
Case StudiesIntermediateRead hereBy Dropbox engineers · Dropbox
CDN Services at Spotify
Spotify built its business on flawless content delivery. Our streaming platform serves up more than 50 million tracks (plus an array of images and other assets) to more than 230 million monthly active users around the world — making us o…
Case StudiesIntermediateRead hereBy Spotify engineers · Spotify
Cloudflare Blog
Deep technical posts on networking, DNS, CDN, security and edge computing from a company that runs a huge global network.
BlogsIntermediateBy Cloudflare engineers · Cloudflare
Cloudflare Engineering
Cloudflare's engineering posts, on topics like memory optimisation, Rust Workers, server hardware and data platforms.
BlogsIntermediateBy Cloudflare engineers · Cloudflare
Consistent Hashing and Random Trees (paper)
The original consistent-hashing paper, written for distributing web caches.
PapersAdvancedRead hereBy Karger et al. · MIT
Cross Shard Transactions at 10 Million RPS at Dropbox
How Dropbox added cross-shard transactions to Edgestore, its metadata store, with a modified two-phase commit proven on a live system at 10 million requests a second.
Case StudiesAdvancedRead hereBy Dropbox engineers · Dropbox
Cross-Region Caching Library at Wix
At the Wix server infrastructure group we work daily on a set of tools that help make the lives of our backend developers easier, while also helping them deliver their code to production faster and safer. Wix handles huge traffic with mo…
Case StudiesIntermediateRead hereBy Wix engineers · Wix
Distributed Cache at Zalando
Using Akka cluster-sharding and Akka HTTP on Kubernetes
Case StudiesIntermediateRead hereBy Zalando engineers · Zalando
Distributed Cache for S3 at ClickHouse
ClickHouse Cloud now has a distributed cache for object storage: shared, low-latency, and built for speed. This post dives into the architecture, why it matters, and how it performs.
Case StudiesIntermediateRead hereBy ClickHouse engineers · ClickHouse
Distributed Caching
This blog post is part 2 in the “Scaling Wix to over 100M Users” series. Read part 1 here. When Wix started, we used the Tomcat, Hibernate, and Ehcache stack with a MySQL database and Flash front end. Why did we choose that stack? Simply…
Case StudiesIntermediateRead hereBy Wix engineers · Wix
Distributed Locks using Redis at GoSquared
How to achieve crash-proof, solid distributed locks using Redis.
Case StudiesIntermediateRead hereBy GoSquared engineers · GoSquared
Ensuring Resilience to Disaster at Quora
Quora's mission is to share and grow the world's knowledge, and we're committed to making sure Quora is a knowledge repository that will be around forever. To this end, we perform daily backups of all of our ground-truth datastores—MySQL…
Case StudiesIntermediateBy Quora engineers · Quora
Erlang Solutions Engineering Blog
As supporters of open source tech and Erlang, Elixir, OTP on the BEAM, we share our knowledge and insights with the Community so that we can all grow.
BlogsIntermediateBy Erlang Solutions engineers · Erlang Solutions
Estimating the Cache Efficiency using Big Data at Allegro
Caching is a good and well-known technique used to increase application performance and decrease overall system load. Usually small or medium data sets, which are often read and rarely changed, are considered as a good candidate for cach…
Case StudiesIntermediateRead hereBy Allegro engineers · Allegro
Failover with Redis Sentinel at Vinted
Why Vinted chose Redis Sentinel over Redis Cluster for failover, with notes on failover timing, migration steps and monitoring.
Case StudiesIntermediateRead hereBy Vinted engineers · Vinted