The system design library
Search and filter every curated system design video, article, repository and paper in one place.
95 resources
8th Light Engineering Blog
Articles from the 8th Light consultancy on AI-assisted software delivery, agentic AI and software work in healthcare.
BlogsIntermediateBy 8th Light engineers · 8th Light
Accelerator: Fast Data Processing Framework at eBay
The Expertmaker Accelerator is a well-proven data processing framework that provides fast data access, parallel execution, and automatic organization of source code, input data, and results. It can be used for daily data analysis tasks a…
Case StudiesIntermediateBy eBay engineers · eBay
Altus Care: Applying a Chatbot to Platform Engineering at eBay
eBay developers recently combined several commonly used technologies, including Lucene search and the Stanford Natural Language Processor, to create Altus Care, a chatbot that provides an instant one-stop support solution for internal eB…
Case StudiesIntermediateBy eBay engineers · eBay
Architecture of Chat Service (3 parts) at Riot Games
Playing League of Legends for years now, I’ve formed a meaningful network of social connections with other gamers around the world. Whether they’re friends from work, former classmates, or players I’ve been matchmade with, they all have an…
Case StudiesIntermediateRead hereBy Riot Games engineers · Riot Games
Architecture of Nubank
Edward Wible and Rafael Ferreira discuss the key elements that make Nubank tick for millions of customers every day, including transaction authorization, messaging infrastructure (Kafka), real-time double-entry accounting (Datomic), cust…
Case StudiesIntermediateBy InfoQ engineers · InfoQ
Architectures of Finance, Banking, and Payment Systems
Enabling real-time payments improves the speed of the online payment experiences to customers and allows banks to drive higher payment volumes, ideally at lower costs as well as engage new customer segments.
Case StudiesIntermediateBy Redhat engineers · Redhat
Autoscaling Pub-Sub Consumers at Spotify
is responsible for delivering hundreds of billions of events every day. Most of the events are generated as a response to a user action, such as playing a song, following an artist or clicking on an ad. All in all, more than 300 differen…
Case StudiesIntermediateRead hereBy Spotify engineers · Spotify
AWS Networking Blog
Modernizing a monolith into microservices may require placing each new service in its own AWS account for isolation, independent scaling, and clear ownership. During that migration you hit a hard question: how do you shift a small, preci…
BlogsIntermediateBy Amazon Web Services engineers · Amazon Web Services
Black-Box Auditing: Verifying End-to-End Replication Integrity between MySQL and Redshift at Yelp
Black-Box Auditing: Verifying End-to-End Replication Integrity between MySQL and Redshift Jacob Park, Software Engineering Intern Apr 12, 2018 Since Yelp introduced its real-time streaming data infrastructure, “Data Pipeline”, it has...
Case StudiesIntermediateRead hereBy Yelp engineers · Yelp
Brooklin: Distributed Service for Near Real-Time Data Streaming at LinkedIn
Brooklin—a distributed service for streaming data in near real-time and at scale—has been running in production at LinkedIn since 2016, powering thousands of data streams and over 2 trillion messages per day. Today, we are pleased to ann…
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn
Building Real Time Infrastructure at Facebook - Jeff Barber and Shie Erlich, Software Engineer at Facebook
Jeff was writing code before Al Gore invented the Internet. Starting in college with building game engines for no games, his passion led him directly into infrastructure. After starting a company, doing a tour of duty at Amazon working o…
Case StudiesIntermediateBy Facebook engineers · Facebook
Cape: Event Stream Processing Framework at Dropbox
We launched Cape towards the end of 2016 to replace Livefill, which we last talked about in 2014. In this post, we’ll give an overview of Cape and its key features, high-level architecture, and varied use cases at Dropbox.
Case StudiesIntermediateRead hereBy Dropbox engineers · Dropbox
Capital One Blog
Capital One uses real-time data at scale, AI and machine learning, and the power of the cloud to solve challenging industry problems and build products, services, and experiences that can make a real difference in millions of peoples’ li…
BlogsIntermediateBy Capital One engineers · Capital One
CDN Services at Spotify
Spotify built its business on flawless content delivery. Our streaming platform serves up more than 50 million tracks (plus an array of images and other assets) to more than 230 million monthly active users around the world — making us o…
Case StudiesIntermediateRead hereBy Spotify engineers · Spotify
CI/CD at Betterment
As we improve and scale our CD platform, shortening the feedback loop with notifications was a small, effective, and important piece.
Case StudiesIntermediateRead hereBy Betterment engineers · Betterment
Cloudinary Blog
Cloudinary's blog on image and video management and delivery, accessibility, moderation and digital asset management.
BlogsIntermediateBy Cloudinary engineers · Cloudinary
Concourse: Generating Personalized Content Notifications in Near-Real-Time at LinkedIn
Social media are computer-mediated platforms that facilitate creation and sharing of information, ideas, career interests, and other forms of expression via virtual communities and networks. In the last few years, notifications have been…
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn
Configuration Management for Distributed Systems at Flickr
Configuration repository and editor: Where your configuration lives. We’re using Git for storing configuration files and GitHub as an ad hoc editor.
Case StudiesIntermediateRead hereBy Flickr engineers · Flickr
Continuous Integration and Deployment with Bazel at Dropbox
Dropbox server-side software lives in a large monorepo. One lesson we’ve learned scaling the monorepo is to minimize the number of global operations that operate on the repository as a whole. Years ago, it was reasonable to run our entir…
Case StudiesIntermediateRead hereBy Dropbox engineers · Dropbox
Continuous Integration Stack at Facebook
Over time, the software industry has come up with several ways to deliver code faster, safer, and with better quality. Many of these efforts center on ideas such as continuous integration, continuous delivery, agile development, DevOps, …
Case StudiesIntermediateRead hereBy Facebook engineers · Facebook
Cross Shard Transactions at 10 Million RPS at Dropbox
How Dropbox added cross-shard transactions to Edgestore, its metadata store, with a modified two-phase commit proven on a live system at 10 million requests a second.
Case StudiesAdvancedRead hereBy Dropbox engineers · Dropbox
Cross-Region Caching Library at Wix
At the Wix server infrastructure group we work daily on a set of tools that help make the lives of our backend developers easier, while also helping them deliver their code to production faster and safer. Wix handles huge traffic with mo…
Case StudiesIntermediateRead hereBy Wix engineers · Wix
DataSift Architecture: Realtime Datamining at 120,000 Tweets Per Second - High Scalability -
I remember the excitement of when Twitter first opened up their firehose. As an early adopter o...
Case StudiesIntermediateRead hereBy High Scalability engineers · High Scalability
Delaying Asynchronous Message Processing with RabbitMQ at Indeed
By implementing a delay queue for our message processing, we improved the resilience of our internal systems and were able to deliver jobs more reliably.
Case StudiesIntermediateRead hereBy Indeed engineers · Indeed