The system design library
Search and filter every curated system design video, article, repository and paper in one place.
31 resources
Interview Pen
Full system design walkthroughs with whiteboard diagrams and a clear structure.
YouTubeIntermediateBy Interview Pen
Scalable Web Architecture and Distributed Systems
A full chapter on the building blocks of large websites: availability, performance, reliability, scalability, caches, proxies, indexes, load balancers and queues. Free to read here under CC BY 3.0.
BlogsBeginner40 minRead hereFree from the authorBy Kate Matsudaira · The Architecture of Open Source Applications
AWS Networking Blog
Modernizing a monolith into microservices may require placing each new service in its own AWS account for isolation, independent scaling, and clear ownership. During that migration you hit a hard question: how do you shift a small, preci…
BlogsIntermediateBy Amazon Web Services engineers · Amazon Web Services
Deterministic Aperture: A Distributed, Load Balancing Algorithm at Twitter
As parts of the Twitter application grow, we can scale demands on capacity by adding more instances or replicas to a respective service cluster (i.e., horizontal scaling)
Case StudiesIntermediateBy Twitter engineers · Twitter
Envoy Proxy
The source of the high-performance proxy behind many service meshes.
GitHubAdvancedBy Envoy · CNCF / Envoy
Google SRE Book: Handling Overload
Client-side throttling, per-client quotas and criticality levels for staying up when demand exceeds capacity.
BlogsAdvancedBy Google SRE team · Google
Google SRE Book: Load Balancing in the Datacenter
Algorithms for spreading requests inside a data centre, including subsetting and weighted round robin.
BlogsAdvancedBy Google SRE team · Google
HAProxy
The home of the widely used open-source load balancer and proxy.
DocumentationIntermediateBy HAProxy Technologies · HAProxy
Implementing health checks
Kinds of health checks, how load balancers use them, and how a careless check can take down a whole fleet.
BlogsIntermediateBy Amazon Builders' Library · Amazon Web Services
Intelligent DNS based load balancing at Dropbox
The Dropbox Traffic team is charged with innovating our application networking stack to improve the experience for every one of our users—over half a billion of them. This article describes our work with NS1 to optimize our intelligent D…
Case StudiesIntermediateRead hereBy Dropbox engineers · Dropbox
Kubernetes: Ingress
Routing external HTTP traffic to services inside a cluster.
DocumentationIntermediateBy Kubernetes · CNCF / Kubernetes
Load Balancing
This post is going to look at one aspect of how sites like Facebook handle billions of requests and stay highly available: load balancing.
Case StudiesIntermediateRead hereBy Vivekpanyam engineers · Vivekpanyam
Load Balancing at Github
Over the last year we've developed our new load balancer, called GLB (GitHub Load Balancer).
Case StudiesIntermediateRead hereBy Github engineers · Github
Load Balancing infrastructure to support more than 1.3 billion users at Facebook
A SREcon talk on how Facebook's traffic team uses DNS and software load balancers to route and balance global traffic for over a billion users.
Case StudiesIntermediateBy Facebook engineers · Facebook
Maglev: A Fast and Reliable Software Network Load Balancer (paper)
How Google runs its network load balancing in software on commodity servers, using a consistent-hashing variant to keep connections stable.
PapersAdvancedBy Eisenbud et al. · Google
Monitor DNS systems at Stripe
The secret life of DNS packets: investigating complex networks.
Case StudiesIntermediateRead hereBy Stripe engineers · Stripe
Rate Limiting with NGINX
Configuring request limits and bursts in NGINX with the leaky-bucket model.
BlogsBeginnerBy NGINX · F5 / NGINX
Scaling Load Balancing Infra to Support 1.3 Billion Users at Facebook - Patrick Shuff, Production Engineer at Facebook
Want to learn how Facebook scales their load balancing infrastructure to support more than 1.3 billion users? We will be revealing the technologies and metho...
YouTubeIntermediateBy Facebook
Top Five (Load Balancing) Scalability Patterns
Master the top five scalability patterns for modern applications. Read the F5 blog to learn how to build highly available and resilient digital architectures.
Case StudiesIntermediateRead hereBy F5 engineers · F5
Traffic Infrastructure (Edge Network) at Dropbox
As you can see, by simply putting the PoP close to the user one can improve latency by more than factor of two.
Case StudiesIntermediateRead hereBy Dropbox engineers · Dropbox
Traffic Steering using Rum DNS at LinkedIn
Do you serve customers across the world with varying network conditions? Do you struggle with automatically sending your users away from an unavailable POP/DC to the next best one? Wouldn’t it be great if you magically knew about the reg…
Case StudiesIntermediateBy LinkedIn engineers · LinkedIn
What is Envoy
The proxy behind many service meshes and gateways, and its core ideas.
DocumentationIntermediateBy Envoy · CNCF / Envoy
Active-Active for Multi-Regional Resiliency
How Netflix routes traffic across regions and survives regional outages.
Case StudiesAdvancedBy Netflix Engineering · Netflix
Google SRE Book
Free online book on running reliable production systems at Google scale.
CoursesAdvancedBy Betsy Beyer et al. · Google