Search

Jump to a problem, path or page

Search

Jump to a problem, path or page

The path

Part 2 · Module 30

Batch and data pipelines

Processing petabyte-scale data with distributed batch computation, columnar analytical storage, data lakehouse partitioning, and streaming architectures.

Start

0 of 4 lessons23 min

30.1Distributed compute with MapReduce and SparkUp next6m

Batch and data pipelines · designlab

Settings

Dashboard Learn Handbook Labs Practice library Learning paths Review Insights Studios Mock interviews Notebook

Search

Jump to a problem, path or page

3day streak

The path

Part 2 · Module 30

Batch and data pipelines

Processing petabyte-scale data with distributed batch computation, columnar analytical storage, data lakehouse partitioning, and streaming architectures.

Start

0 of 4 lessons23 min

30.1Distributed compute with MapReduce and SparkUp next6m

30.2

Data lakes, warehouses and Parquet

30.3Batch vs streaming, lambda and kappa6m

30.4Orchestration, backfills and data quality6m

LabNightly settlement and the warehouseFinish “Lock down Tiffin” first30m

Practice what this module teaches

Multi-tenant Analytics Query Platform HLDSchedule bounded analytical queries with snapshots, isolation and cancellable workers.Advanced60 min Large Data Export Platform HLDProduce resumable authorized exports with stable snapshots and bounded resources.Advanced50 min Bulk Import Platform HLDValidate staged data, report row errors and commit retryable batches without silent duplication.Advanced50 min

3day streak