The system design library
Search and filter every curated system design video, article, repository and paper in one place.
107 resources
Site Reliability Engineering
How Google runs production systems: SLOs, error budgets, monitoring and incident response. Free to read online from Google.
BooksIntermediateFree from the authorBy Google SRE team · Google
Alerting on Service-Level Objectives (SLOs) at SoundCloud
If there is anything like a silver bullet for creating meaningful and actionable alerts with a high signal-to-noise ratio, it is alerting based on service-level objectives (SLOs). Fulfilling a well-defined SLO is the very definition of m…
Case StudiesIntermediateRead hereBy SoundCloud engineers · SoundCloud
Analyzing V8 Garbage Collection Logs at Alibaba
Alibaba is arguably the world’s biggest online commerce company. It serves millions of users and hosts millions of merchants and businesses. As of August 2016, Alibaba had 434 million users with 427 million active mobile monthly users. D…
Case StudiesIntermediateRead hereBy Alibaba engineers · Alibaba
Athena: Automated Build Health Management System at Dropbox
At Dropbox, we run more than 35,000 builds and millions of automated tests every day. With so many tests, a few are bound to fail non-deterministically or “flake.” Some new code submissions are bound to break the build, which prevents de…
Case StudiesIntermediateRead hereBy Dropbox engineers · Dropbox
AWS Containers Blog
AWS posts on running containers, covering Amazon EKS, ECS, container registries and observability.
BlogsIntermediateBy Amazon Web Services engineers · Amazon Web Services
AWS DevOps Blog
AWS CodeDeploy now offers a purpose-built RESTART deployment mode that reapplies the last successful revision to EC2 and on-premises fleets. It keeps restarts inside CodeDeploy with the same batch sizing, health checks, alarm monitoring,…
BlogsIntermediateBy Amazon Web Services engineers · Amazon Web Services
BookKeeper: Distributed Log Storage at Yahoo
Apache Software Foundation recently announced that BookKeeper has been promoted as an Apache Top Level Project. BookKeeper is near and dear to Yahoo: it was actually created here in 2009 to provide horizontally scalable, reliable, replic…
Case StudiesIntermediateBy Yahoo engineers · Yahoo
Boosting Site Speed Using Brotli Compression at LinkedIn
A real-world engineering write-up from LinkedIn on performance Optimization by Brotli Compression.
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn
Brendan Gregg's Website
Systems performance: methodologies, flame graphs, Linux and cloud performance analysis.
BlogsAdvancedBy Brendan Gregg · brendangregg.com
Brotli at Treebo
Providing a better customer experience has lately become the centre of business strategies and in order to provide better customer…
Case StudiesIntermediateBy Treebo engineers · Treebo
Canopy: Scalable Distributed Tracing & Analysis at Facebook
Haozhe Gao and Joe O’Neill present Canopy, Facebook’s performance and efficiency tracing infrastructure. They talk about the lessons learned applying Canopy to a wide range of use cases at Facebook and present case studies of its use in …
Case StudiesIntermediateBy Facebook engineers · Facebook
Centralized Application Logging at eBay
CAL Ingress, the main component of eBay's Centralized Application Logging (CAL) system, is responsible for collecting, processing, and dispatching application server local logs from thousands of CAL clients in the cloud. This article int…
Case StudiesIntermediateRead hereBy eBay engineers · eBay
Containerization at Pinterest
Lida Li, Rodrigo Menezes & Yongwen Xu | Pinterest Engineers, Cloud Management Platform & SRE
Case StudiesIntermediateBy Pinterest engineers · Pinterest
Couchbase Ecosystem at LinkedIn
The tools, libraries and monitoring services LinkedIn built around its large Couchbase deployment so it could be operated at scale.
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn
Dapper: a Large-Scale Distributed Systems Tracing Infrastructure (paper)
The paper behind distributed tracing: spans, trace ids and low-overhead sampling.
PapersAdvancedBy Sigelman et al. · Google
Data Checking at Dropbox
A SREcon talk on designing consistency checkers that verify data at rest: goals, components, alert triage and auto-remediation.
Case StudiesIntermediateBy Dropbox engineers · Dropbox
Data Pipeline Monitoring System at LinkedIn
Monitoring big data pipelines often equates to waiting for a long-running batch job to complete and observing the status of the execution. The status can result in “Failed” or “Successful” or even “Incomplete.” From there, it’s the team’…
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn
Datadog Engineering Blog
How an observability company builds high-volume time-series and tracing systems.
BlogsAdvancedBy Datadog engineers · Datadog
Debugging Java Memory Leaks at Allegro
We all make errors, but some errors seem so ridiculous we wonder how anyone, let alone we ourselves, could have done such a thing. This is, of course, easy to notice only after the fact. Below, I describe a series of such errors which we…
Case StudiesIntermediateRead hereBy Allegro engineers · Allegro
DevOps Roadmap
A visual path through DevOps tools and ideas.
CoursesBeginnerBy roadmap.sh community · roadmap.sh
Distributed Logging
A recent Stack Overflow post described one programmer’s logging style. Here’s what he logs: INFO Level * The start and end of the method * The start and end of any major loops * The start of any major case/switch statements DEBUG Level *…
Case StudiesIntermediateRead hereBy Codinghorror engineers · Codinghorror
Distributed Monitoring and Alerting
A case study in how Google monitors its complex systems.
Case StudiesIntermediateRead hereBy Oreilly engineers · Oreilly
Distributed Tracing at HelloFresh
How distributed tracing helped us to have better visibility of our architecture
Case StudiesIntermediateBy HelloFresh engineers · HelloFresh
Distributed Tracking, Tracing, and Measuring
Five questions for Ben Sigelman about adopting distributed tracing tools and optimizing performance of complex, distributed systems.
Case StudiesIntermediateRead hereBy Oreilly engineers · Oreilly