Model Training with PyTorch and Lightning thumbnail

Model Training with PyTorch and Lightning

Workload Example

A workload example demonstrating model training with PyTorch and Lightning.

About this course

8 lessons
2 modules
Tags
Workload ExamplesIntermediateModel TrainingWorkloadsLegacy Import
Level: Intermediate
PyTorch Lightning Integration
Stable Diffusion Training

Course Modules

0

Workload

In this module, you’ll learn when to use Ray Train to scale deep learning workloads and how to train a Stable Diffusion UNet with PyTorch Lightning. You’ll build a simple Parquet-backed PyTorch Dataset/DataLoader and run single-GPU training as a baseline before moving to distributed training on a multi-GPU Ray cluster.

  • Introduction to Ray Train
  • When to use Ray Train?
  • PyTorch Example
+1 more lesson
1

Ray Train with PyTorch Lightning (Notebook)

  • Introduction to Ray Train with PyTorch Lightning
  • Single GPU Training with PyTorch Lightning
  • Ray Train DDP with PyTorch Lightning
+1 more lesson