PyTorch¶

1. Getting started¶

Introduction to PyTorch - YouTube Series (official)¶

This is my most recommended tutorial on PyTorch. It comes with videos and Jupyter notebooks. The content consists of seven parts:

1. Introduction
2. Tensors
3. Autograd
4. Building Models
5. TensorBoard Support
6. Training Models
7. Model Understanding

Learn the Basics (official)¶

The content consists of eight parts:

1. Quickstart
2. Tensors
3. Datasets & DataLoaders
4. Transforms
5. Build Model
6. Autograd
7. Optimization
8. Save & Load Model

2. Distributed PyTorch¶

• PyTorch Distributed Overview (pytorch.org)
• Distributed Data Parallel in PyTorch - Video Tutorials (Suraj Subramanian)

Guides & recipes¶

Data¶

• Datasets & DataLoaders (pytorch.org)

Optimization¶

• How to use an optimizer (pytorch.org)

Models¶

• Warmstarting model using parameters from a different model (pytorch.org)

Performance¶

• Performance tuning guide (pytorch.org)

Resources¶

• PyTorch Tutorials (official)