The system design library
Search and filter every curated system design video, article, repository and paper in one place.
75 resources
Site Reliability Engineering
How Google runs production systems: SLOs, error budgets, monitoring and incident response. Free to read online from Google.
BooksIntermediateFree from the authorBy Google SRE team · Google
Alerting on Service-Level Objectives (SLOs) at SoundCloud
If there is anything like a silver bullet for creating meaningful and actionable alerts with a high signal-to-noise ratio, it is alerting based on service-level objectives (SLOs). Fulfilling a well-defined SLO is the very definition of m…
Case StudiesIntermediateRead hereBy SoundCloud engineers · SoundCloud
Analyzing V8 Garbage Collection Logs at Alibaba
Alibaba is arguably the world’s biggest online commerce company. It serves millions of users and hosts millions of merchants and businesses. As of August 2016, Alibaba had 434 million users with 427 million active mobile monthly users. D…
Case StudiesIntermediateRead hereBy Alibaba engineers · Alibaba
Athena: Automated Build Health Management System at Dropbox
At Dropbox, we run more than 35,000 builds and millions of automated tests every day. With so many tests, a few are bound to fail non-deterministically or “flake.” Some new code submissions are bound to break the build, which prevents de…
Case StudiesIntermediateRead hereBy Dropbox engineers · Dropbox
BookKeeper: Distributed Log Storage at Yahoo
Apache Software Foundation recently announced that BookKeeper has been promoted as an Apache Top Level Project. BookKeeper is near and dear to Yahoo: it was actually created here in 2009 to provide horizontally scalable, reliable, replic…
Case StudiesIntermediateBy Yahoo engineers · Yahoo
Boosting Site Speed Using Brotli Compression at LinkedIn
A real-world engineering write-up from LinkedIn on performance Optimization by Brotli Compression.
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn
Brendan Gregg's Website
Systems performance: methodologies, flame graphs, Linux and cloud performance analysis.
BlogsAdvancedBy Brendan Gregg · brendangregg.com
Brotli at Treebo
Providing a better customer experience has lately become the centre of business strategies and in order to provide better customer…
Case StudiesIntermediateBy Treebo engineers · Treebo
Canopy: Scalable Distributed Tracing & Analysis at Facebook
Haozhe Gao and Joe O’Neill present Canopy, Facebook’s performance and efficiency tracing infrastructure. They talk about the lessons learned applying Canopy to a wide range of use cases at Facebook and present case studies of its use in …
Case StudiesIntermediateBy Facebook engineers · Facebook
Centralized Application Logging at eBay
CAL Ingress, the main component of eBay's Centralized Application Logging (CAL) system, is responsible for collecting, processing, and dispatching application server local logs from thousands of CAL clients in the cloud. This article int…
Case StudiesIntermediateRead hereBy eBay engineers · eBay
Dapper: a Large-Scale Distributed Systems Tracing Infrastructure (paper)
The paper behind distributed tracing: spans, trace ids and low-overhead sampling.
PapersAdvancedBy Sigelman et al. · Google
Data Checking at Dropbox
A SREcon talk on designing consistency checkers that verify data at rest: goals, components, alert triage and auto-remediation.
Case StudiesIntermediateBy Dropbox engineers · Dropbox
Data Pipeline Monitoring System at LinkedIn
Monitoring big data pipelines often equates to waiting for a long-running batch job to complete and observing the status of the execution. The status can result in “Failed” or “Successful” or even “Incomplete.” From there, it’s the team’…
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn
Datadog Engineering Blog
How an observability company builds high-volume time-series and tracing systems.
BlogsAdvancedBy Datadog engineers · Datadog
Debugging Java Memory Leaks at Allegro
We all make errors, but some errors seem so ridiculous we wonder how anyone, let alone we ourselves, could have done such a thing. This is, of course, easy to notice only after the fact. Below, I describe a series of such errors which we…
Case StudiesIntermediateRead hereBy Allegro engineers · Allegro
DevOps Roadmap
A visual path through DevOps tools and ideas.
CoursesBeginnerBy roadmap.sh community · roadmap.sh
Distributed Logging
A recent Stack Overflow post described one programmer’s logging style. Here’s what he logs: INFO Level * The start and end of the method * The start and end of any major loops * The start of any major case/switch statements DEBUG Level *…
Case StudiesIntermediateRead hereBy Codinghorror engineers · Codinghorror
Distributed Monitoring and Alerting
A case study in how Google monitors its complex systems.
Case StudiesIntermediateRead hereBy Oreilly engineers · Oreilly
Distributed Tracing at HelloFresh
How distributed tracing helped us to have better visibility of our architecture
Case StudiesIntermediateBy HelloFresh engineers · HelloFresh
Distributed Tracking, Tracing, and Measuring
Five questions for Ben Sigelman about adopting distributed tracing tools and optimizing performance of complex, distributed systems.
Case StudiesIntermediateRead hereBy Oreilly engineers · Oreilly
Dynatrace Blog
Tutorials, tips and resources for engineers on cloud technologies and observability. Learn from the engineers shaping the future of technology.
BlogsIntermediateBy Dynatrace engineers · Dynatrace
Garbage Collection in Go Application at Twitch
A real-world engineering write-up from Twitch on performance Optimization by Tuning Garbage Collection.
Case StudiesIntermediateBy Twitch engineers · Twitch
Garbage Collection in Java Applications at LinkedIn
High-performance applications form the backbone of the modern web. At LinkedIn, a number of internal high-throughput services cater to thousands of user requests per second. For optimal user experience, it is very important to serve thes…
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn
Garbage Collection in Redux Applications at SoundCloud
This post describes why and how we implemented a garbage collector in our Xbox application on top of Redux and in addition to the JavaScript engine’s regular garbage collector.
Case StudiesIntermediateRead hereBy SoundCloud engineers · SoundCloud