The system design library
Search and filter every curated system design video, article, repository and paper in one place.
10 resources
Clock Skew when Syncing Password Payloads at Drobbox
How Dropbox Passwords fixed sync errors from clock skew by replacing a two-way timestamp merge with a three-way merge against a base payload.
Case StudiesIntermediateRead hereBy Drobbox engineers · Drobbox
Druid - Real-time Analytics Database
Apache Druid, a real-time analytics database: the project site and its documentation.
DocumentationIntermediateBy Apache engineers · Apache
Druid at eBay
Large scale event processing from logs to provide monitoring insights
Case StudiesIntermediateRead hereBy eBay engineers · eBay
Heroic: Time Series Database at Spotify
This is the second part in a series about Monitoring at Spotify. In the I discussed our history of operational monitoring. In this part I’ll be presenting Heroic, our scalable time series database which is now free software.
Case StudiesIntermediateRead hereBy Spotify engineers · Spotify
MetricsDB: TimeSeries Database for storing metrics at Twitter
Using a custom storage backend instead of traditional key value store reduced the overall capacity requirements by a factor of 10. This also reduced latency by a factor of five.
Case StudiesIntermediateBy Twitter engineers · Twitter
Protector: Circuit Breaker for Time Series Databases at Trivago
At trivago we store a subset of our realtime metric data in InfluxDB and we are quite impressed by the load it can handle. Despite all the joy, we had to learn some lessons the hard way. It is p...
Case StudiesIntermediateBy Trivago engineers · Trivago
Roshi: Distributed Storage System for Time-Series Event at SoundCloud
Let’s talk about the stream. The SoundCloud stream represents stuff that’s relevant to you primarily via your social graph, arranged in time order, newest-first. The atom of that data model, an event, is a simple enough thing. Timestamp …
Case StudiesIntermediateRead hereBy SoundCloud engineers · SoundCloud
Spanner: Google's Globally Distributed Database (paper)
A globally distributed database that gives strongly consistent transactions by combining consensus groups with clocks whose uncertainty is bounded.
PapersAdvancedBy Corbett et al. · Google
Time Series Databases
Learn what time series data is, how it powers real-time monitoring and long-term analysis, and why high-resolution, high-cardinality workloads challenge trad...
Case StudiesIntermediateRead hereBy Influxdata engineers · Influxdata
Time, Clocks, and the Ordering of Events in a Distributed System (paper)
The classic paper that introduced logical clocks and the happened-before relation, the foundation for vector clocks and causality tracking.
PapersAdvancedBy Leslie Lamport · Microsoft Research