The system design library
Search and filter every curated system design video, article, repository and paper in one place.
201 resources
30x Performance Improvements on MySQLStreamer at Yelp
Making 30x performance improvements on Yelp’s MySQLStreamer Abrar Sheikh, Software Engineer Feb 5, 2018 Introduction MySQLStreamer is an important application in Yelp’s Data Pipeline infrastructure. It’s responsible for streaming high-vo…
Case StudiesIntermediateRead hereBy Yelp engineers · Yelp
Agrarian-Scale Kubernetes (3 parts) at New York Times
A real-world engineering write-up from New York Times on microservices and Orchestration.
Case StudiesIntermediateBy New York Times engineers · New York Times
Akutan: Distributed Knowledge Graph Store at eBay
We're excited to announce the public release of Akutan, a distributed knowledge graph store, under the Apache 2.0 open source license. Akutan is the result of four person-years of exploration and engineering effort, so there's a lot to u…
Case StudiesIntermediateRead hereBy eBay engineers · eBay
Alibaba Cloud Blog
Alibaba Cloud Community is an open platform for developers and users to learn the latest technologies in cloud computing, share technical knowlege know-how, and interact with the techical community.
BlogsIntermediateBy Alibaba Cloud engineers · Alibaba Cloud
Amazon Aurora: Design Considerations for High Throughput Cloud-Native Relational Databases (paper)
Why Aurora moves the redo log to a distributed storage layer, so replication and crash recovery become cheap.
PapersAdvancedRead hereBy Verbitski et al. · Amazon Web Services
Amazon Redshift and the art of performance optimization in the cloud
The cloud gives excellent mechanisms to improve performance as Concurrency Scaling for Redshift shows
Case StudiesIntermediateRead hereBy Allthingsdistributed engineers · Allthingsdistributed
Amazon Science
Technical deep-dives and perspectives from our scientists who are pushing boundaries across multiple scientific disciplines while solving real-world challenges. Explore how our teams combine research excellence, world-class data, and adv…
BlogsIntermediateBy Amazon engineers · Amazon
Android Developers Blog
The latest updates from the Android team: new features and platform releases, looks at what’s launching and why it matters.
BlogsIntermediateBy Google engineers · Google
Architecture of Nubank
Edward Wible and Rafael Ferreira discuss the key elements that make Nubank tick for millions of customers every day, including transaction authorization, messaging infrastructure (Kafka), real-time double-entry accounting (Datomic), cust…
Case StudiesIntermediateBy InfoQ engineers · InfoQ
Athena: Automated Build Health Management System at Dropbox
At Dropbox, we run more than 35,000 builds and millions of automated tests every day. With so many tests, a few are bound to fail non-deterministically or “flake.” Some new code submissions are bound to break the build, which prevents de…
Case StudiesIntermediateRead hereBy Dropbox engineers · Dropbox
Atlassian Engineering
How Atlassian builds and runs its cloud products at scale.
BlogsIntermediateBy Atlassian engineers · Atlassian
Auth0 Engineering Blog
Everything you need to know about Identity Infrastructure, Access Management, SSO and JWT Authentication. Company updates & Technology Tr...
BlogsIntermediateBy Auth0 engineers · Auth0
Autoscaling Bigtable Clusters based on CPU Load at Spotify
At Spotify we are moving to managed infrastructure solutions to focus more on our core competencies. In the databases space that means moving to .
Case StudiesIntermediateRead hereBy Spotify engineers · Spotify
Autoscaling Jenkins at Trivago
I love to take complex and tedious processes and automate the pain out of them until they are reduced to three or four steps!As part of the release team ...
Case StudiesIntermediateBy Trivago engineers · Trivago
Avenue Code Engineering Blog
Follow the main news in the area of technology. Software development, design and UX, ML, DevOps and much more!
BlogsIntermediateBy Avenue Code engineers · Avenue Code
AWS Containers Blog
AWS posts on running containers, covering Amazon EKS, ECS, container registries and observability.
BlogsIntermediateBy Amazon Web Services engineers · Amazon Web Services
AWS DevOps Blog
AWS CodeDeploy now offers a purpose-built RESTART deployment mode that reapplies the last successful revision to EC2 and on-premises fleets. It keeps restarts inside CodeDeploy with the same batch sizing, health checks, alarm monitoring,…
BlogsIntermediateBy Amazon Web Services engineers · Amazon Web Services
Black-Box Auditing: Verifying End-to-End Replication Integrity between MySQL and Redshift at Yelp
Black-Box Auditing: Verifying End-to-End Replication Integrity between MySQL and Redshift Jacob Park, Software Engineering Intern Apr 12, 2018 Since Yelp introduced its real-time streaming data infrastructure, “Data Pipeline”, it has...
Case StudiesIntermediateRead hereBy Yelp engineers · Yelp
Blue Green Deployment
Running two identical environments and switching traffic between them for near-zero-downtime releases.
BlogsBeginnerBy Martin Fowler
Box Engineering Blog
Posts from Box's engineering teams on its desktop and iOS apps, build tooling, AI-assisted IT support and data infrastructure.
BlogsIntermediateBy Box engineers · Box
Brendan Gregg's Website
Systems performance: methodologies, flame graphs, Linux and cloud performance analysis.
BlogsAdvancedBy Brendan Gregg · brendangregg.com
Build Your Own X
Tutorials for building your own Redis, database, Docker, web server and more, to learn how they work.
GitHubIntermediateBy CodeCrafters · GitHub
Building and Deploying MySQL Raft at Meta
We’re rolling out MySQL Raft with the aim to eventually replace our current MySQL semisynchronous databases. The biggest win of MySQL Raft was simplification of the operation and making MyS…
Case StudiesAdvancedRead hereBy Meta engineers · Meta
Building Microservices (2nd edition)
Sam Newman's guide to service boundaries, communication, deployment and organisation.
BooksIntermediateSold by publisherBy Sam Newman · O'Reilly