The system design library
Search and filter every curated system design video, article, repository and paper in one place.
150 resources
codeKarle
Low-level and high-level design of real products, worked through step by step.
YouTubeIntermediateBy codeKarle
Mining of Massive Datasets
Large-scale data processing: MapReduce, similarity search, recommendation and streams. The authors offer the whole book as a free download.
BooksAdvancedFree from the authorBy Jure Leskovec, Anand Rajaraman, Jeff Ullman · Stanford University
Readings in Database Systems (the Red Book)
Essays and papers on how database systems are built, with an introduction to each, free online from the editors.
BooksAdvancedFree from the authorBy Peter Bailis, Joseph Hellerstein, Michael Stonebraker · Red Book
30x Performance Improvements on MySQLStreamer at Yelp
Making 30x performance improvements on Yelp’s MySQLStreamer Abrar Sheikh, Software Engineer Feb 5, 2018 Introduction MySQLStreamer is an important application in Yelp’s Data Pipeline infrastructure. It’s responsible for streaming high-vo…
Case StudiesIntermediateRead hereBy Yelp engineers · Yelp
Akutan: Distributed Knowledge Graph Store at eBay
We're excited to announce the public release of Akutan, a distributed knowledge graph store, under the Apache 2.0 open source license. Akutan is the result of four person-years of exploration and engineering effort, so there's a lot to u…
Case StudiesIntermediateRead hereBy eBay engineers · eBay
Amazon Aurora: Design Considerations for High Throughput Cloud-Native Relational Databases (paper)
Why Aurora moves the redo log to a distributed storage layer, so replication and crash recovery become cheap.
PapersAdvancedRead hereBy Verbitski et al. · Amazon Web Services
Amazon Redshift and the art of performance optimization in the cloud
The cloud gives excellent mechanisms to improve performance as Concurrency Scaling for Redshift shows
Case StudiesIntermediateRead hereBy Allthingsdistributed engineers · Allthingsdistributed
Amazon S3 strong consistency
What strong read-after-write consistency means for S3 and how it simplifies applications.
DocumentationIntermediateBy Amazon Web Services
Apache Cassandra
The source of the wide-column, leaderless database.
GitHubAdvancedBy Apache Software Foundation · GitHub
Architecture Notes
Illustrated explanations of how databases, protocols and systems work.
Podcasts & NewslettersBeginnerBy Architecture Notes · architecturenotes.co
AWS Big Data Blog
AWS posts and announcements on analytics and data topics, such as Redshift, EMR and Apache Iceberg tables.
BlogsIntermediateBy Amazon Web Services engineers · Amazon Web Services
AWS Database Blog
Guidance on choosing, migrating and tuning relational and NoSQL databases.
BlogsIntermediateBy AWS database teams · Amazon Web Services
Backend Developer Roadmap
A visual guide to the skills a backend engineer builds, from databases to caching and APIs.
CoursesBeginnerBy roadmap.sh community · roadmap.sh
Black-Box Auditing: Verifying End-to-End Replication Integrity between MySQL and Redshift at Yelp
Black-Box Auditing: Verifying End-to-End Replication Integrity between MySQL and Redshift Jacob Park, Software Engineering Intern Apr 12, 2018 Since Yelp introduced its real-time streaming data infrastructure, “Data Pipeline”, it has...
Case StudiesIntermediateRead hereBy Yelp engineers · Yelp
Build Your Own X
Tutorials for building your own Redis, database, Docker, web server and more, to learn how they work.
GitHubIntermediateBy CodeCrafters · GitHub
Building and Deploying MySQL Raft at Meta
We’re rolling out MySQL Raft with the aim to eventually replace our current MySQL semisynchronous databases. The biggest win of MySQL Raft was simplification of the operation and making MyS…
Case StudiesAdvancedRead hereBy Meta engineers · Meta
Cassandra architecture overview
The ring, replication, tunable consistency and the storage engine of Cassandra.
DocumentationIntermediateBy Apache Cassandra · Apache Software Foundation
Cassandra for Keeping Counts In Sync at SoundCloud
Track play counts are essential for providing a good creator experience on the SoundCloud platform. They not only help creators keep track of their most popular songs, but they also give creators a better understanding of their fanbase a…
Case StudiesIntermediateRead hereBy SoundCloud engineers · SoundCloud
Cassandra: A Decentralized Structured Storage System (paper)
The paper describing Cassandra's design: a Dynamo-style ring and replication with a Bigtable-style data model and storage engine.
PapersIntermediateRead hereBy Lakshman and Malik · Facebook
ClickHouse Blog
Learn about the latest ClickHouse tips, tricks and company announcements.
BlogsIntermediateBy ClickHouse engineers · ClickHouse
CMU 15-445: Database Systems
A university course on database internals with free lecture videos, covering storage, indexing, execution and concurrency.
CoursesAdvancedBy Andy Pavlo · Carnegie Mellon University
CMU Database Group
Lectures and talks on database systems, including the 15-445 course.
YouTubeAdvancedBy Carnegie Mellon University
Cockroach Labs Blog
Distributed SQL internals: consensus, transactions and multi-region design.
BlogsAdvancedBy Cockroach Labs engineers · Cockroach Labs