The system design library
Search and filter every curated system design video, article, repository and paper in one place.
46 resources
Mining of Massive Datasets
Large-scale data processing: MapReduce, similarity search, recommendation and streams. The authors offer the whole book as a free download.
BooksAdvancedFree from the authorBy Jure Leskovec, Anand Rajaraman, Jeff Ullman · Stanford University
Aroma: Using ML for Code Recommendation at Facebook
Thousands of engineers write the code to create our apps, which serve billions of people worldwide. This is no trivial task—our services have grown so diverse and complex that the codebase contains…
Case StudiesIntermediateRead hereBy Facebook engineers · Facebook
Building a scalable ELK stack at Envato
A real-world engineering write-up from Envato on distributed Searching.
Case StudiesIntermediateBy Envato engineers · Envato
Cross-Lingual End-to-End Product Search with Deep Learning at Zalando
How We Built the Next Generation Product Search from Scratch using a Deep Neural Network
Case StudiesIntermediateRead hereBy Zalando engineers · Zalando
Data-Driven Autocorrection System at Canva
This post explains how we built a data-driven system that can perform autocorrection at scale across languages.
Case StudiesIntermediateRead hereBy Canva engineers · Canva
Distributed Searching
A real-world engineering write-up from Washington on distributed Searching.
PapersIntermediateBy Washington
eBay Tech
Search, marketplace and platform engineering posts from eBay.
BlogsIntermediateBy eBay engineers · eBay
Elastic Blog
Search, logging and observability engineering with Elasticsearch.
BlogsIntermediateBy Elastic engineers · Elastic
Elasticsearch Guide
The reference for indexing, searching and scaling Elasticsearch.
DocumentationIntermediateBy Elastic
Elasticsearch Performance Tuning Practice at eBay
Elasticsearch is an open source search and analytic engine based on Apache Lucene that allows users to store, search, analyze data in near real time. While Elasticsearch is designed for fast queries, the performance depends largely on th…
Case StudiesIntermediateBy eBay engineers · eBay
Elasticsearch: scalability and resilience
How clusters, nodes, shards and replicas work and how to plan shard counts.
DocumentationIntermediateBy Elastic
ELK (Elasticsearch, Logstash, Kibana) Stack
As part of the widespread movement towards open source software, the ELK Stack has become the most common log management platform in the world.
Case StudiesIntermediateRead hereBy Logz engineers · Logz
Facebook AI Research Engineering Blog
Facebook Artificial Intelligence Research (FAIR) seeks to understand and develop systems with human-level intelligence by advancing the longer-term academic problems surrounding AI. Our research co…
BlogsIntermediateBy Facebook AI Research engineers · Facebook AI Research
Fast Order Search using Data Pipeline and Elasticsearch at Yelp
Fast Order Search Using Yelp’s Data Pipeline and Elasticsearch Dmitriy Kunitskiy, Software Engineer Jun 1, 2018 Since its inception in 2013, Yelp has grown its transactions platform to tens of...
Case StudiesIntermediateRead hereBy Yelp engineers · Yelp
Galene: Search Architecture of LinkedIn
Introducing LinkedIn’s new search architecture Authors: Sriram Sankar, Asif Makhani Search is one of the most intensely studied problems in software engineering. It brings together information retrieval, machine learning, distributed sys…
Case StudiesIntermediateRead hereBy LinkedIn engineers · LinkedIn
Improving Search Engine Efficiency by over 25% at eBay
The search engine plays an essential role in e-Commerce: it connects the user
Case StudiesIntermediateBy eBay engineers · eBay
Introduction to Information Retrieval: assessing relevance
How relevance judgments are collected and how agreement between judges is measured.
BooksIntermediateFree from the authorBy Manning, Raghavan and Schutze · Stanford University
Introduction to Information Retrieval: evaluation
Precision, recall, MAP and NDCG for judging a search system, with test collections.
BooksIntermediateFree from the authorBy Manning, Raghavan and Schutze · Stanford University
Introduction to Information Retrieval: inverse document frequency
The textbook definition of document frequency, idf and tf-idf weighting with worked examples.
BooksIntermediateFree from the authorBy Manning, Raghavan and Schutze · Stanford University
Large-Scale Machine Learning Pipeline for Job Recommendations at Indeed
large-scale machine learning pipeline for job recommendations at Indeed
Case StudiesIntermediateRead hereBy Indeed engineers · Indeed
Latest News from Google Research Blog
The Google blog: an index of its posts, to pick the ones on the topic you are studying.
BlogsIntermediateBy Google engineers · Google
Log Parsing with Logstash and Google Protocol Buffers at Trivago
At trivago we rely heavily on the ELK stack for our log processing. We stream our webserver access logs, error logs, performance benchmarks and all kind of diagnostic data into Kafka and process...
Case StudiesIntermediateBy Trivago engineers · Trivago
Lucene BM25Similarity
The class implementing BM25 in Lucene, the library under Elasticsearch and Solr.
DocumentationAdvancedBy Apache Lucene · Apache Software Foundation