Big Data and Cloud Data Platforms
How big data systems evolved, the papers behind them, batch and stream processing, lakes and warehouses, and how to choose a cloud for your data.
4 lessons45 minIntermediate
0/4
What you'll learn
0 of 4 lessons complete
Who this is for and what you will be able to do
Who this is for
Developers and architects who store or analyse large amounts of data, or who need to pick tools and a cloud provider for a data platform.
After this course you will be able to
- Explain how big data tools evolved and which research papers started each wave
- Describe how batch and stream processing work, including windows and late data
- Choose between a data lake, a warehouse and a lakehouse
- Compare the main cloud data services and choose a provider using sound criteria
How a lesson works
Interactive diagram
See how each component connects, then run a request through it.
Plain-words toggle
Switch between the technical explanation and a plain-language one.
Practice design
Change a design of your own in the builder and see how it holds up.
Quiz and exercise
Test your understanding before moving on.
Go deeper
These lessons are written from scratch. The books below are excellent next reads.
- Designing Data-Intensive Applicationsby Martin Kleppmannchapters 10 and 11 cover batch and stream processing
- The Data Warehouse Toolkitby Ralph Kimball and Margy Rossthe classic reference on dimensional modelling