Christian Mills - CUDA MODE Lecture Notes

Published

April 26, 2024

Modified

May 31, 2024

Resource Links:

Discord Channel: CUDA MODE
YouTube Channel: CUDA MODE
GitHub Repository: CUDA MODE Lectures
Textbook: Programming Massively Parallel Processors

CUDA MODE Lecture 1 : How to profile CUDA kernels in PyTorch

notes

cuda

pytorch

Lecture #1 provides a practical introduction to integrating and profiling custom CUDA kernels within PyTorch programs, using tools like load_inline, Triton, and NVIDIA Nsight Compute.

CUDA MODE Lecture 2 : Ch.1-3 PMPP Book

notes

cuda

pytorch

Lecture #2 provides an introduction to parallel programming with CUDA C, covering key concepts like heterogeneous computing, data parallelism, thread organization, and memory management, and showcasing examples such as vector addition, image blurring, and matrix multiplication.