Confluent

Learn system design with Confluent, step by step

384 videos in 4 steps, about 123 h 27 min of watching. Start at step 1 and move down.

1. 1Start here: the basicsNo background needed. What the main ideas are and why they exist.102 videos · 11 h 36 min0/102

   • 1.1 3. Apache Kafka Fundamentals | Apache Kafka FundamentalsBeginner · 24 min · 561.6K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 1.2 What is Apache Kafka®?Beginner · 12 min · 461K views · 2019 (older)Passing work and events between services without waiting for each other.
   • 1.3 4. How Kafka Works | Apache Kafka FundamentalsBeginner · 27 min · 238.2K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 1.4 Apache Kafka 101: Introduction (2023)Beginner · 5 min · 208.8K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 1.5 Apache Kafka 101: Partitioning (2023)Beginner · 4 min · 178.6K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 1.6 2. Motivations and Customer Use Cases | Apache Kafka FundamentalsBeginner · 10 min · 168.5K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 1.7 Apache Kafka 101: Topics (2023)Beginner · 6 min · 147.7K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 1.8 Apache Kafka 101: Kafka Streams (2023)Beginner · 8 min · 142.1K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 1.9 Kafka Streams 101: Getting Started (2023)Beginner · 12 min · 136.1K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 1.10 Apache Kafka 101: Your First Kafka Application in 10 Minutes or Less (Hands On - 2023)Beginner · 10 min · 132.7K views · 2022Passing work and events between services without waiting for each other.

   Show all 102
2. 2The building blocksCaches, queues, databases, load balancers: the parts every design is made of.203 videos · 49 h 23 min0/203

   • 2.1 Inside ksqlDB: Elastic Scaling and Fault Tolerance in ksqlDBIntermediate · 3 min · 2.7K views · 2021 (older)How a system grows from one server to many without falling over.
   • 2.2 Allium’s Blueprint for Scaling Blockchain Data with Data Streaming | Life Is But A Stream PodcastIntermediate · 43 min · 2.1K views · 2025How a system grows from one server to many without falling over.
   • 2.3 From PoC to Scale with Data Streaming and Governance | Life Is But A Stream PodcastIntermediate · 49 min · 1.9K views · 2025How a system grows from one server to many without falling over.
   • 2.4 Why is Elastic Scaling with Confluent Important to Your Business?Intermediate · 2 min · 1.7K views · 2022How a system grows from one server to many without falling over.
   • 2.5 Inside ksqlDB: High Availability in ksqlDBIntermediate · 3 min · 2.6K views · 2021 (older)What you give up to stay available or correct when machines fail.
   • 2.6 Neha Narkhede | Kafka Summit London 2019 Keynote | Event Streaming: Our Cloud-Native Journey LessonsIntermediate · 27 min · 57.7K views · 2019 (older)Passing work and events between services without waiting for each other.
   • 2.7 Martin Kleppmann | Kafka Summit SF 2018 Keynote (Is Kafka a Database?)Intermediate · 28 min · 56.8K views · 2018 (older)Passing work and events between services without waiting for each other.
   • 2.8 Neha Narkhede | Kafka Summit 2018 Keynote (The Present and Future of the Streaming Platform) LondonIntermediate · 24 min · 36.6K views · 2018 (older)Passing work and events between services without waiting for each other.
   • 2.9 Apache Kafka® Consumers and Consumer Group ProtocolIntermediate · 15 min · 36.3K views · 2022Passing work and events between services without waiting for each other.
   • 2.10 Martin Kleppmann | Kafka Summit London 2019 Keynote | Is Kafka a Database?Intermediate · 26 min · 35.4K views · 2019 (older)Passing work and events between services without waiting for each other.

   Show all 203
3. 3Design whole systems (HLD)Put the blocks together for a real product, step by step.21 videos · 6 h 26 min0/21

   • 3.1 Event-Driven Architecture(EDA) vs. Request/Response (RR): System Design ExplainedIntermediate · 12 min · 309.9K views · 2024Designing Explained: what it must do, the main parts, and the trade-offs.
   • 3.2 Event-Driven Architecture Patterns Explained (Pub/Sub, Queues & More)Intermediate · 9 min · 52.6K views · 2024Passing work and events between services without waiting for each other.
   • 3.3 Apache Kafka® Architecture Course Trailer | Confluent DeveloperIntermediate · 2 min · 49.4K views · 2022Passing work and events between services without waiting for each other.
   • 3.4 Event-Driven Architectures | Jay Kreps, CEO, Confluent (For Technical Leaders & Executives)Intermediate · 6 min · 16.4K views · 2018 (older)Passing work and events between services without waiting for each other.
   • 3.5 Jay Kreps | Kafka Summit SF 2018 Keynote (Kafka and Event-Oriented Architecture)Intermediate · 25 min · 12K views · 2018 (older)Passing work and events between services without waiting for each other.
   • 3.6 How to Unlock the Power of Event-Driven Architecture | Designing Event-Driven MicroservicesIntermediate · 8 min · 11.7K views · 2024Designing Event: what it must do, the main parts, and the trade-offs.
   • 3.7 Jay Kreps | Kafka Summit 2018 Keynote (The Death and Rebirth of the Event-Driven Architecture)Intermediate · 21 min · 11.1K views · 2018 (older)Passing work and events between services without waiting for each other.
   • 3.8 MirrorMaker 2: Replicate Data Between Multicloud Kafka Clusters | Hybrid and Multicloud ArchitectureIntermediate · 5 min · 10.3K views · 2023Passing work and events between services without waiting for each other.
   • 3.9 Keynote: Gwen Shapira, Confluent | Kafka’s New Architecture | Kafka Summit 2020Intermediate · 30 min · 7.7K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 3.10 Polyglot Architecture | Designing Event-Driven MicroservicesIntermediate · 6 min · 6.5K views · 2023Designing Event: what it must do, the main parts, and the trade-offs.

   Show all 21
4. 4Go deeperInternals, trade-offs and how large systems really behave.58 videos · 56 h 2 min0/58

   • 4.1 Streaming Data at Scale with Strategic Cloud Partners | Life Is But A Stream PodcastAdvanced · 35 min · 1.6K views · 2025How a system grows from one server to many without falling over.
   • 4.2 Data Pipelines: Using CDC to Ingest Data into KafkaAdvanced · 7 min · 65.1K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 4.3 Apache Kafka® Architecture: Overview of Kafka's Internal ComponentsAdvanced · 8 min · 45K views · 2022Passing work and events between services without waiting for each other.
   • 4.4 Apache Kafka® Transactions: Message Delivery and Exactly-Once SemanticsAdvanced · 14 min · 39.7K views · 2022Passing work and events between services without waiting for each other.
   • 4.5 Flink vs Kafka Streams/ksqlDB: Comparing Stream Processing ToolsAdvanced · 56 min · 29.5K views · 2022Passing work and events between services without waiting for each other.
   • 4.6 Jay Kreps, Confluent | Kafka Summit SF 2019 Keynote ft. Dev Tagare, LyftAdvanced · 52 min · 20.8K views · 2019 (older)Passing work and events between services without waiting for each other.
   • 4.7 Common Apache Kafka Mistakes to AvoidAdvanced · 1 h 10 min · 18K views · 2022Passing work and events between services without waiting for each other.
   • 4.8 Ask Confluent #6: Kafka, Partitions, and Exactly Once ft. Jason GustafsonAdvanced · 21 min · 15.8K views · 2018 (older)Passing work and events between services without waiting for each other.
   • 4.9 Kafka Streams, Spring Boot, and Confluent Cloud | Livestreams 002Advanced · 1 h 11 min · 12.8K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 4.10 Streams Forever: Kafka Summit London 2024 Keynote | Jay Kreps, Co-founder & CEO, ConfluentAdvanced · 1 h 47 min · 12K views · 2024Passing work and events between services without waiting for each other.

   Show all 58

Order and levels are picked by us from titles and lengths. The one-line notes are ours. Every video plays from YouTube and belongs to Confluent.

Confluent’s own courses and series

Playlists the creator put together, in the order they made them.

1. Streaming Audio Podcast | Apache Kafka®, Confluent, and the CloudA series from the creator, in the order they made it.45 videos · 31 h 35 min0/45

   • 1 Flink vs Kafka Streams/ksqlDB: Comparing Stream Processing ToolsAdvanced · 56 min · 29.5K views · 2022Passing work and events between services without waiting for each other.
   • 2 Common Apache Kafka Mistakes to AvoidAdvanced · 1 h 10 min · 18K views · 2022Passing work and events between services without waiting for each other.
   • 3 Running Apache Kafka in ProductionAdvanced · 59 min · 8.1K views · 2022Passing work and events between services without waiting for each other.
   • 4 Handling Message Errors and Dead Letter Queues in Apache Kafka ft. Jason BellIntermediate · 38 min · 6.7K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 5 Build a Real Time AI Data Platform with Apache KafkaIntermediate · 37 min · 6.4K views · 2022Pushing updates to users instantly instead of making them ask.
   • 6 Powering Microservices Using Apache Kafka on Node.js with KafkaJS at Klarna ft. Tommy BrunnIntermediate · 31 min · 5.8K views · 2021 (older)When to split an application into services, and what it costs.
   • 7 How to use OpenTelemetry to Trace and Monitor Apache Kafka SystemsAdvanced · 50 min · 5.7K views · 2023Seeing what a running system is doing and finding what broke.
   • 8 Migrate Your Kafka Cluster with Minimal DowntimeAdvanced · 1 h 2 min · 4.8K views · 2023Passing work and events between services without waiting for each other.
   • 9 Handling 2 Million Apache Kafka Messages Per Second at HoneycombIntermediate · 42 min · 4.4K views · 2022Passing work and events between services without waiting for each other.
   • 10 Using Kafka-Leader-Election to Improve Scalability and PerformanceAdvanced · 51 min · 4.4K views · 2023Passing work and events between services without waiting for each other.

   Show all 45
2. Kafka Summit | Hosted by Confluent | Keynotes and more from SF, NYC, LondonA series from the creator, in the order they made it.30 videos · 15 h 53 min0/30

   • 1 Zhamak Dehghani | Kafka Summit Europe 2021 Keynote: How to Build the Data Mesh FoundationIntermediate · 30 min · 14.4K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 2 Beyond Speed: Kafka Summit London 2023 Keynote | Jay Kreps, Co-founder & CEO, ConfluentAdvanced · 1 h 27 min · 10K views · 2023Passing work and events between services without waiting for each other.
   • 3 Kafka Summit London 2022 Keynote | Jay Kreps, CEO, Confluent featuring Avi Perez, Wix.comAdvanced · 1 h 6 min · 11.3K views · 2022Passing work and events between services without waiting for each other.
   • 4 The Joy of (Kafka) Community ft. Scott Hanselman | Keynote Roundtable at Kafka Summit Americas 2021Intermediate · 31 min · 1.6K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 5 Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 2021 KeynoteIntermediate · 39 min · 8.1K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 6 Livestream | Kafka Summit Americas 2021Advanced · 1 h 11 min · 4.8K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 7 Keynote: Gwen Shapira, Confluent | Kafka’s New Architecture | Kafka Summit 2020Intermediate · 30 min · 7.7K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 8 Keynote: Jay Kreps, Confluent | Kafka ♥ Cloud | Kafka Summit 2020Intermediate · 38 min · 8.8K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 9 Keynote: Sam Newman, Building Microservices | The Tyranny Of Data | Kafka Summit 2020Intermediate · 30 min · 13.2K views · 2020 (older)When to split an application into services, and what it costs.
   • 10 Keynote: Levi Bailey, Humana | Improving Health with Event-Driven Architectures | Kafka Summit 2020Intermediate · 32 min · 1.9K views · 2020 (older)Passing work and events between services without waiting for each other.

   Show all 30
3. Designing Event-Driven MicroservicesA series from the creator, in the order they made it.25 videos · 2 h 47 min0/25

   • 1 Introduction | Designing Event-Driven MicroservicesBeginner · 3 min · 14.9K views · 2024When to split an application into services, and what it costs.
   • 2 From Monoliths to Microservices | Designing Event-Driven MicroservicesIntermediate · 7 min · 14.5K views · 2023When to split an application into services, and what it costs.
   • 3 Event-Driven Microservices in Banking and Fraud Detection | Designing Event-Driven MicroservicesIntermediate · 11 min · 11.2K views · 2024When to split an application into services, and what it costs.
   • 4 Autonomous Microservices | Designing Event-Driven MicroservicesIntermediate · 7 min · 7.5K views · 2023When to split an application into services, and what it costs.
   • 5 Data Ownership | Designing Event-Driven MicroservicesIntermediate · 6 min · 5.1K views · 2023When to split an application into services, and what it costs.
   • 6 Defining Asynchronous Microservice APIs for Fraud Detection | Designing Event-Driven MicroservicesIntermediate · 8 min · 5.2K views · 2024Doing many things at once without breaking shared data.
   • 7 The Strangler Pattern | Designing Event-Driven MicroservicesIntermediate · 6 min · 17.3K views · 2023When to split an application into services, and what it costs.
   • 8 Branch by Abstraction | Designing Event-Driven MicroservicesIntermediate · 6 min · 5.7K views · 2023When to split an application into services, and what it costs.
   • 9 Polyglot Architecture | Designing Event-Driven MicroservicesIntermediate · 6 min · 6.5K views · 2023Designing Event: what it must do, the main parts, and the trade-offs.
   • 10 Continuous Integration and Delivery (CI/CD) | Designing Event-Driven MicroservicesIntermediate · 7 min · 7.3K views · 2023When to split an application into services, and what it costs.

   Show all 25
4. Kafka Streams Tutorials | Kafka Streams 101 (2023)A series from the creator, in the order they made it.23 videos · 2 h 8 min0/23

   • 1 Kafka Streams 101 Course Trailer | Confluent Developer (2023)Beginner · 2 min · 76.4K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 2 Kafka Streams 101: Getting Started (2023)Beginner · 12 min · 136.1K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 3 Kafka Streams 101: Basic Operations (2023)Beginner · 6 min · 49.2K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 4 Kafka Streams 101: Basic Operations (Hands On) (2023)Beginner · 2 min · 34.1K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 5 Kafka Streams 101: KTable (2023)Beginner · 6 min · 45.3K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 6 Kafka Streams 101: KTable (Hands On 2023)Beginner · 2 min · 26.7K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 7 Kafka Streams 101: Data Serialization (2023)Beginner · 5 min · 25.9K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 8 Kafka Streams 101: Joins (2023)Beginner · 9 min · 31.2K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 9 Kafka Streams 101: Joins (Hands On 2023)Beginner · 3 min · 16K views · 2021 (older)Passing work and events between services without waiting for each other.
   • 10 Kafka Streams 101: Stateful Operations (2023)Beginner · 7 min · 23.1K views · 2021 (older)Passing work and events between services without waiting for each other.

   Show all 23
5. Quick Concepts and How-Tos for DevelopersA series from the creator, in the order they made it.17 videos · 59 min0/17

   • 1 Kafka Events Explained | Apache Kafka® On The GoIntermediate · 2 min · 6.1K views · 2022Passing work and events between services without waiting for each other.
   • 2 Kafka Partitions Explained | Apache Kafka® On The GoIntermediate · 2 min · 3.3K views · 2022Passing work and events between services without waiting for each other.
   • 3 Kafka Consumer Groups Explained | Apache Kafka® On The GoIntermediate · 2 min · 3.1K views · 2022Passing work and events between services without waiting for each other.
   • 4 Kafka Producers Explained | Apache Kafka® On The GoIntermediate · 2 min · 2.5K views · 2022Passing work and events between services without waiting for each other.
   • 5 Kafka Topics Explained | Apache Kafka® On The GoIntermediate · 2 min · 2.3K views · 2022Passing work and events between services without waiting for each other.
   • 6 Kafka Consumers Explained | Apache Kafka® On The GoIntermediate · 2 min · 2K views · 2022Passing work and events between services without waiting for each other.
   • 7 What is a Schema? | Apache Kafka® On The GoBeginner · 2 min · 1.9K views · 2023Passing work and events between services without waiting for each other.
   • 8 What is Kafka Replication? | Apache Kafka® On The GoBeginner · 2 min · 1.5K views · 2023Passing work and events between services without waiting for each other.
   • 9 Amazon S3 Kafka Connector Setup & ConfigurationIntermediate · 7 min · 10.4K views · 2023Passing work and events between services without waiting for each other.
   • 10 Introduction to Event Terms and Roles | Apache Kafka® ExplainedBeginner · 4 min · 2.7K views · 2023Passing work and events between services without waiting for each other.

   Show all 17
6. Livestreams with Viktor Gamov | Cloud-Native Apache Kafka® and Serverless Stream ProcessingA series from the creator, in the order they made it.15 videos · 21 h 16 min0/15

   • 1 Kafkathon 2020, Kafka Summit, Spring Boot, and Confluent Cloud | Livestreams 001Advanced · 59 min · 5.6K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 2 Kafka Streams, Spring Boot, and Confluent Cloud | Livestreams 002Advanced · 1 h 11 min · 12.8K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 3 Avro, Protobuf, Spring Boot, Kafka Streams and Confluent Cloud | Livestreams 003Advanced · 1 h 31 min · 9.5K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 4 Confluent Cloud Automated Workflow and Postgres Replication Using Kafka Connect | Livestreams 005Advanced · 1 h 1 min · 2.1K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 5 Reactive Microservices with ksqlDB, Reactor, Spring WebFlux, and WebSockets | Livestreams 010Advanced · 1 h 9 min · 3.8K views · 2020 (older)Pushing updates to users instantly instead of making them ask.
   • 6 Materialized Views with Kafka Streams and Spring Boot | Livestreams 011Advanced · 56 min · 5.7K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 7 Event-Driven Microservices with Spring Boot and Confluent Cloud | Livestreams 012Advanced · 2 h 3 min · 7K views · 2020 (older)When to split an application into services, and what it costs.
   • 8 Kafka Streams Scalability and Kubernetes | Livestreams 014Advanced · 1 h 5 min · 2.2K views · 2020 (older)How applications are packaged and run across many machines.
   • 9 Choosing Christmas Movies with Kubernetes, Spring Boot, and Apache Kafka | Livestreams 015Advanced · 2 h 2 min · 6.2K views · 2020 (older)How applications are packaged and run across many machines.
   • 10 What’s New in Kafka Streams Metrics API 2.7.0 | Livestreams 016Advanced · 1 h 1 min · 1.6K views · 2021 (older)How services expose and call each other's features.

   Show all 15
7. Apache Kafka Tutorials | Kafka 101A series from the creator, in the order they made it.16 videos · 1 h 21 min0/16

   • 1 Apache Kafka 101: Introduction (2023)Beginner · 5 min · 208.8K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 2 Apache Kafka 101: Your First Kafka Application in 10 Minutes or Less (Hands On - 2023)Beginner · 10 min · 132.7K views · 2022Passing work and events between services without waiting for each other.
   • 3 Apache Kafka 101: Topics (2023)Beginner · 6 min · 147.7K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 4 Apache Kafka 101: Partitioning (2023)Beginner · 4 min · 178.6K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 5 Apache Kafka 101: Partitioning (Hands On - 2023)Beginner · 3 min · 56K views · 2022Passing work and events between services without waiting for each other.
   • 6 Apache Kafka 101: Brokers (2023)Beginner · 2 min · 81.2K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 7 Apache Kafka 101: Replication (2023)Beginner · 2 min · 74.5K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 8 Apache Kafka 101: Producers (2023)Beginner · 3 min · 76.1K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 9 Apache Kafka 101: Consumers (2023)Beginner · 7 min · 114.6K views · 2020 (older)Passing work and events between services without waiting for each other.
   • 10 Apache Kafka 101: Consumers (Hands On - 2023)Beginner · 4 min · 41K views · 2022Passing work and events between services without waiting for each other.

   Show all 16
8. Apache Kafka® Architecture | Kafka's Internal Components and How They WorkA series from the creator, in the order they made it.14 videos · 2 h 15 min0/14

   • 1 Apache Kafka® Architecture Course Trailer | Confluent DeveloperIntermediate · 2 min · 49.4K views · 2022Passing work and events between services without waiting for each other.
   • 2 Apache Kafka® Architecture: Overview of Kafka's Internal ComponentsAdvanced · 8 min · 45K views · 2022Passing work and events between services without waiting for each other.
   • 3 Apache Kafka® Brokers: Introduction to the Data PlaneBeginner · 8 min · 29.2K views · 2022Passing work and events between services without waiting for each other.
   • 4 Apache Kafka® Producer Client (Hands On)Intermediate · 8 min · 16.1K views · 2022Passing work and events between services without waiting for each other.
   • 5 Data Plane – Apache Kafka®'s Replication ProtocolIntermediate · 12 min · 21.1K views · 2022Passing work and events between services without waiting for each other.
   • 6 The Apache Kafka® Control Plane – ZooKeeper vs. KRaftAdvanced · 12 min · 35.5K views · 2022How many machines agree on one answer, even when some fail.
   • 7 Apache Kafka® Consumers and Consumer Group ProtocolIntermediate · 15 min · 36.3K views · 2022Passing work and events between services without waiting for each other.
   • 8 Apache Kafka® Consumers and Consumer Group Protocol (Hands On)Intermediate · 9 min · 8.4K views · 2022Passing work and events between services without waiting for each other.
   • 9 Configuring Apache Kafka® Durability, Availability, and Ordering GuaranteesIntermediate · 9 min · 15.1K views · 2022Passing work and events between services without waiting for each other.
   • 10 Apache Kafka® Transactions: Message Delivery and Exactly-Once SemanticsAdvanced · 14 min · 39.7K views · 2022Passing work and events between services without waiting for each other.

   Show all 14

Latest uploads

• Tableflow Demo: Kafka to BigQuery Without ETL Pipelines897 views · 7 days ago