Data Processing Foundations (Ray Data) thumbnail

Data Processing Foundations (Ray Data)

Foundations

Explore the foundations of processing structured and unstructured data with Ray Data and get an overview of the key concepts and patterns for distributed data processing.

About this course

MPMax Pumperla
23 lessons
3 modules
Tags
FoundationsBeginnerData ProcessingLegacy Import
Level: Beginner
Structured and Unstructured Data Processing
Distributed Data Pipelines

Course Modules

0

Structured

In **Structured**, you’ll learn how to use Ray Data to load large structured datasets (e.g., NYC taxi Parquet files) in a distributed, lazy-executed way and inspect their schema and blocks. You’ll also practice applying scalable batch transformations with `map_batches` to engineer new features in parallel.

  • Introduction to Ray Data
  • What is Ray Data and How To Use It?
  • Data Loading
+5 more lessons
1

Unstructured Data Processing (notebooks)

  • Intro to Ray Data with Unstructured Data
  • Loading Unstructured Data
  • Lazy Execution Mode
+5 more lessons
2

Landscape

This module maps the distributed data and compute industry landscape, covering the data, compute, and orchestration layers and the tools commonly used in each. You’ll learn how these layers fit together and how to categorize major distributed computing frameworks and commercial platforms by their primary use cases.

  • Introduction to the Data Industry Landscape
  • The Compute Layer
  • The Orchestration Layer
+4 more lessons