The system design library
Search and filter every curated system design video, article, repository and paper in one place.
48 resources
Concurrent and Distributed Systems (Cambridge lecture notes)
Eight lectures on time, broadcast, replication, consensus and transactions, with notes, slides and video. Free from the author under CC BY-SA.
BooksIntermediateFree from the authorBy Martin Kleppmann · University of Cambridge
System Design Interview
A small set of detailed videos on how distributed systems and common interview designs work.
YouTubeIntermediateBy System Design Interview
Back-end at Flickr
By Peter Welch, Senior Principal Engineer Today, Yahoo Mail introduced a feature that allows you to automatically sync your mobile photos to Yahoo Mail so that they’re readily available when you’re composing an email from your computer. …
Case StudiesIntermediateBy Flickr engineers · Flickr
Brandwatch Engineering Blog
Brandwatch, a Cision company, is an AI-powered social media management, consumer intelligence, and influencer marketing suite trusted by half of the Forbes 100.
BlogsIntermediateBy Brandwatch engineers · Brandwatch
CaffeOnSpark: Distributed Deep Learning on Big Data Clusters at Yahoo
yahoohadoop: By Andy Feng(@afeng76), Jun Shi and Mridul Jain (@mridul_jain), Yahoo Big ML Team Introduction Deep learning (DL) is a critical capability required by Yahoo product teams (ex. Flickr, Image Search) to gain intelligence from …
Case StudiesIntermediateBy Yahoo engineers · Yahoo
CDN Services at Spotify
Spotify built its business on flawless content delivery. Our streaming platform serves up more than 50 million tracks (plus an array of images and other assets) to more than 230 million monthly active users around the world — making us o…
Case StudiesIntermediateRead hereBy Spotify engineers · Spotify
Cinchcast Architecture - Producing 1,500 Hours of Audio Every Day - High Scalability -
This is a guest post by Dr. Aleksandr Yampolskiy , CTO of Cinchcast and BlogTalkRadio , wher...
Case StudiesIntermediateRead hereBy High Scalability engineers · High Scalability
Cloud Object Store at Yahoo
Yahoo stores more than 250 Billion objects and half an exabyte of perpetually durable user content such as photos, videos, email, and blog posts. Object storage at Yahoo is growing at 20-25% annually. The growth is primarily driven by mo…
Case StudiesIntermediateBy Yahoo engineers · Yahoo
Cloudinary Blog
Cloudinary's blog on image and video management and delivery, accessibility, moderation and digital asset management.
BlogsIntermediateBy Cloudinary engineers · Cloudinary
CMU 15-445: Database Systems
A university course on database internals with free lecture videos, covering storage, indexing, execution and concurrency.
CoursesAdvancedBy Andy Pavlo · Carnegie Mellon University
Concourse: Generating Personalized Content Notifications in Near-Real-Time at LinkedIn
Social media are computer-mediated platforms that facilitate creation and sharing of information, ideas, career interests, and other forms of expression via virtual communities and networks. In the last few years, notifications have been…
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn
CS Video Courses
A list of university computer-science courses with free videos.
GitHubBeginnerBy Developer-Y · GitHub
Curalate Engineering Blog
A blog about developing at Curalate. How we handle big data architecture, design for the consumer web, and help our customers get the most out of their imagery.
BlogsIntermediateBy Curalate engineers · Curalate
Data Checking at Dropbox
A SREcon talk on designing consistency checkers that verify data at rest: goals, components, alert triage and auto-remediation.
Case StudiesIntermediateBy Dropbox engineers · Dropbox
Deep Learning for Frame Detection in Product Images at Allegro
At Allegro we are faced with a technical challenge: how to recognize whether a given image (a product thumbnail) shows just a product itself. One of the things that we would like to detect is when the product is surrounded by a frame. In…
Case StudiesIntermediateRead hereBy Allegro engineers · Allegro
Deploying Brotli for Static Content at Dropbox
Most representations of data contain a lot of redundancy, which provides an opportunity for greater communication efficiency by compressing the content. Compression is either built-in into the data format — like in the case of images, fo…
Case StudiesIntermediateRead hereBy Dropbox engineers · Dropbox
Evolution of Container Usage at Netflix
Containers are already adding value to our proven globally available cloud platform based on Amazon EC2 virtual machines. We’ve shared pieces of Netflix’s container story in the past (video, slides), but this blog post will discuss conta…
Case StudiesIntermediateBy Netflix engineers · Netflix
Facebook’s photo storage
This paper describes Haystack, an object storage system optimized for Facebook’s Photos application. Facebook currently stores over 260 billion images, which translates to over 20 petabytes of data.
PapersIntermediateRead hereBy USENIX
Fixing Linux filesystem performance regressions at LinkedIn
The learnings we took away from these prior efforts allowed us to build a more refined and automated process for reimaging servers going forward, and to more crisply define the lifecycle of the servers on which we deploy LinkedIn’s produ…
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn
Flickr Architecture - High Scalability -
Update: Flickr hits 2 Billion photos served. That's a lot of hamburgers. Flickr is both my favori...
Case StudiesIntermediateRead hereBy High Scalability engineers · High Scalability
How Spotify Streams Music
We flipped one server flag and got more download bandwidth for Spotify users. That is the TL;DR of this A/B experiment with BBR, a new TCP option.
BlogsIntermediateBy Spotify engineers · Spotify
How Twitter Handles 3,000 Images Per Second - High Scalability -
Today Twitter is creating and persisting 3,000 (200 GB) images per second. Even better, in 2015...
Case StudiesIntermediateRead hereBy High Scalability engineers · High Scalability
Image Recovery at Scale Using S3 Versioning at Trivago
If you’re using Amazon Web Services, then there is a higher possibility that you’re familiar with Amazon S3. Amazon S3 ( Simple Storage Service ) is a wid...
Case StudiesIntermediateBy Trivago engineers · Trivago
Instagram Architecture: 14 Million users, Terabytes of Photos, 100s of Instances, Dozens of Technologies - High Scalability -
Instagram is a free photo sharing and social networking service for your iPhone that has been ...
Case StudiesIntermediateRead hereBy High Scalability engineers · High Scalability