The system design library
Search and filter every curated system design video, article, repository and paper in one place.
272 resources
Interview Pen
Full system design walkthroughs with whiteboard diagrams and a clear structure.
YouTubeIntermediateBy Interview Pen
Mining of Massive Datasets
Large-scale data processing: MapReduce, similarity search, recommendation and streams. The authors offer the whole book as a free download.
BooksAdvancedFree from the authorBy Jure Leskovec, Anand Rajaraman, Jeff Ullman · Stanford University
Scalable Web Architecture and Distributed Systems
A full chapter on the building blocks of large websites: availability, performance, reliability, scalability, caches, proxies, indexes, load balancers and queues. Free to read here under CC BY 3.0.
BlogsBeginner40 minRead hereFree from the authorBy Kate Matsudaira · The Architecture of Open Source Applications
30x Performance Improvements on MySQLStreamer at Yelp
Making 30x performance improvements on Yelp’s MySQLStreamer Abrar Sheikh, Software Engineer Feb 5, 2018 Introduction MySQLStreamer is an important application in Yelp’s Data Pipeline infrastructure. It’s responsible for streaming high-vo…
Case StudiesIntermediateRead hereBy Yelp engineers · Yelp
A 360 Degree View of the Entire Netflix Stack - High Scalability -
This is a guest repost by Chris Ueland , creator of Scale Scale , with a creative hig...
Case StudiesIntermediateRead hereBy High Scalability engineers · High Scalability
Achieving Rapid Response Times in Large Online Services - Jeff Dean, Google Senior Fellow
Jeff Dean's keynote from the 2014 O'Reilly Velocity conference in Santa Clara, CA.Today's large-scale web services provide rapid responses to interactive req...
YouTubeIntermediateBy YouTube
Agrarian-Scale Kubernetes (3 parts) at New York Times
A real-world engineering write-up from New York Times on microservices and Orchestration.
Case StudiesIntermediateBy New York Times engineers · New York Times
Airflow at Adyen
Explore Adyen's journey and challenges in achieving reliable Apache Airflow operations at scale for data engineering.
Case StudiesIntermediateRead hereBy Adyen engineers · Adyen
All Things Distributed
The Amazon CTO's blog on architecture, scale and the history of AWS services.
BlogsIntermediateBy Werner Vogels · Amazon
Amazon Architecture - High Scalability -
This is a wonderfully informative Amazon update based on Joachim Rohde's discovery of an interview...
Case StudiesIntermediateRead hereBy High Scalability engineers · High Scalability
Amazon Aurora: Design Considerations for High Throughput Cloud-Native Relational Databases (paper)
Why Aurora moves the redo log to a distributed storage layer, so replication and crash recovery become cheap.
PapersAdvancedRead hereBy Verbitski et al. · Amazon Web Services
Amazon Redshift and the art of performance optimization in the cloud
The cloud gives excellent mechanisms to improve performance as Concurrency Scaling for Redshift shows
Case StudiesIntermediateRead hereBy Allthingsdistributed engineers · Allthingsdistributed
Anatomy of a System Design Interview
<em>How can you design a large scale distributed system during an interview?</em>
BlogsIntermediateBy Hackernoon engineers · Hackernoon
API Best Practices: Webhooks, Deprecation, and Design
Provides recommendations for building scalable and developer-friendly APIs.
BlogsIntermediateBy Zapier engineers · Zapier
Athena: Automated Build Health Management System at Dropbox
At Dropbox, we run more than 35,000 builds and millions of automated tests every day. With so many tests, a few are bound to fail non-deterministically or “flake.” Some new code submissions are bound to break the build, which prevents de…
Case StudiesIntermediateRead hereBy Dropbox engineers · Dropbox
Atlassian Engineering
How Atlassian builds and runs its cloud products at scale.
BlogsIntermediateBy Atlassian engineers · Atlassian
Automated Fake Account Detection at LinkedIn
To maintain a safe and trusted professional community on LinkedIn, we require that every LinkedIn profile must uniquely represent a real person. One of the ways we ensure that accounts are real is by building automated detection systems …
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn
AWS Compute Blog
AWS Lambda now exposes Availability Zone metadata through an endpoint in the execution environment, so your function can discover its AZ ID with an HTTP request. Use it to prefer same-AZ endpoints for services like ElastiCache, Amazon RD…
BlogsIntermediateBy Amazon Web Services engineers · Amazon Web Services
AWS Networking Blog
Modernizing a monolith into microservices may require placing each new service in its own AWS account for isolation, independent scaling, and clear ownership. During that migration you hit a hard question: how do you shift a small, preci…
BlogsIntermediateBy Amazon Web Services engineers · Amazon Web Services
Bank Backend at Monzo
At Monzo, we’re building a banking system from scratch. Our systems must be available 24x7 no matter what happens, scalable to hundreds of millions of customers around the world, and very extensible. This first post in a series about our…
Case StudiesIntermediateRead hereBy Monzo engineers · Monzo
Bazaarvoice Engineering Blog
Bazaarvoice's R&D blog on platform engineering, user-generated-content APIs, web performance and database migrations.
BlogsIntermediateBy Bazaarvoice engineers · Bazaarvoice
Booking.com Tech Blog
Booking.com is the world's leading online accommodation experience provider, operating across 220+ countries in more than 45 languages. Our team of UX designers and writers, developers, database engineers and Sysadmins are solving compli…
BlogsIntermediateBy Booking.com engineers · Booking.com
BookKeeper: Distributed Log Storage at Yahoo
Apache Software Foundation recently announced that BookKeeper has been promoted as an Apache Top Level Project. BookKeeper is near and dear to Yahoo: it was actually created here in 2009 to provide horizontally scalable, reliable, replic…
Case StudiesIntermediateBy Yahoo engineers · Yahoo
Boosting Site Speed Using Brotli Compression at LinkedIn
A real-world engineering write-up from LinkedIn on performance Optimization by Brotli Compression.
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn