Christian Mills

In this talk, Steven Heidel from OpenAI’s fine-tuning team covers best practices, use cases, and recent updates for fine-tuning OpenAI models.

Conference Talk 18: Fine-Tuning OpenAI Models - Best Practices

notes

llms

In this talk, Simon Willison showcases LLM, a command-line tool for interacting with large language models, including how to leverage its plugin system, local model support, embedding capabilities, and integration with other Unix tools for tasks like retrieval augmented generation.

Conference Talk 17: Language Models on the Command-Line

notes

llms

In this talk, Hailey Schoelkopf from Eleuther AI provides an overview of the challenges in LLM evaluation, exploring different measurement techniques, highlighting reproducibility issues, and advocating for best practices like sharing evaluation code and using task-specific downstream evaluations.

Conference Talk 16: A Deep Dive on LLM Evaluation

notes

llms

My notes from the book Chip War: The Fight for the World’s Most Critical Technology by Chris Miller.

Notes on Chip War: The Fight for the World’s Most Critical Technology

book

notes

history

Aug 28, 2024

Notes on The Kill Chain꞉ Defending America in the Future of High-Tech Warfare

book

notes

history

My notes from the book The Kill Chain꞉ Defending America in the Future of High-Tech Warfare by Christian Brose.

Aug 27, 2024

Office Hours 7: Replicate

notes

llms

This Q&A session on the Replicate platform covers topics like enterprise readiness, model deployment, application layers for LLMs, data privacy, logging, and potential future features.

Aug 25, 2024

Notes on Weapons of Mass Instruction: A Schoolteacher’s Journey Through the Dark World of Compulsory Schooling

book

notes

education

history

My notes from the book Weapons of Mass Instruction: A Schoolteacher’s Journey Through the Dark World of Compulsory Schooling by John Taylor Gatto.

Aug 25, 2024

Conference Talk 15: Modal - Simple Scalable Serverless Services

notes

llms

In this talk, Charles Frye provides a deeper dive into Modal, exploring its capabilities beyond fine-tuning LLMs and demonstrating how it empowers users to build and deploy scalable, cost-efficient, and serverless applications with simplicity using Python.

Aug 25, 2024

Notes on The Learning Game꞉ Teaching Kids to Think for Themselves, Embrace Challenge, and Love Learning

book

education

notes

My notes from the book The Learning Game: Teaching Kids to Think for Themselves, Embrace Challenge, and Love Learning by Ana Lorena Fábrega.

Aug 3, 2024

Notes on Dumbing Us Down: The Hidden Curriculum of Compulsory Schooling

book

notes

education

history

My notes from the book Dumbing Us Down: The Hidden Curriculum of Compulsory Schooling by John Taylor Gatto.

Aug 3, 2024

Conference Talk 14: Explaining the Basics of Retrieval Augmented Generation

notes

llms

In this talk, Ben Clavié from Answer.ai deconstructs the concept of Retrieval-Augmented Generation (RAG) and walks through building a robust, basic RAG pipeline.

Aug 2, 2024

Conference Talk 13: When to Fine-Tune with Paige Bailey

notes

llms

In this talk, Paige Bailey, Generative AI Developer Relations lead at Google, discusses Google’s AI landscape with a focus on Gemini models and their applications.

Jul 25, 2024

Conference Talk 12: Slaying OOMs with PyTorch FSDP and torchao

notes

llms

In this talk, Mark Saroufim and Jane Xu, discuss techniques and tools for mitigating Out of Memory (OOM) errors in PyTorch, specifically when working with LLMs.

Jul 24, 2024

Conference Talk 10: Systematically Improving RAG Applications

notes

llms

In this talk, Jason Liu covers a a systematic approach to improving Retrieval Augmented Generation (RAG) applications.

Jul 20, 2024

Conference Talk 9: Why Fine-Tuning is Dead

notes

llms

In this talk, Emmanuel Ameisen from Anthropic argues that fine-tuning LLMs is often less effective and efficient than focusing on fundamentals like data quality, prompting, and Retrieval Augmentation Generation (RAG).

Jul 19, 2024

Conference Talk 8: Creating, curating, and cleaning data for LLMs

notes

llms

In this talk, Daniel van Strien from 🤗 outlines key considerations and techniques for creating high-quality datasets for fine-tuning LLMs.

Jul 18, 2024

Conference Talk 7: Best Practices For Fine Tuning Mistral

notes

llms

In this talk, Sophia Yang from Mistal AI covers best practices for fine-tuning Mistral language models. It covers Mistral’s capabilities, the benefits of fine-tuning over prompting, and provides practical demos using the Mistral Fine-tuning API and open-source codebase.

Jul 18, 2024

Workshop 4: Instrumenting & Evaluating LLMs

notes

llms

Workshop #4 focuses on the practical aspects of deploying fine-tuned LLMs, covering various deployment patterns, performance optimization techniques, and platform considerations.

Jul 17, 2024

Conference Talk 6: Train Almost Any LLM Model Using 🤗 autotrain

notes

llms

In this talk, Abhishek Thakur, who leads AutoTrain at 🤗, shows how to use 🤗 AutoTrain to train/fine-tune LLMs without having to write any code.

Jul 12, 2024

Office Hours 6: Johno Whitaker

notes

llms

This Q&A session covers a wide range of topics related to LLMs, including practical tips for training and optimization, insights into the current research landscape, and thoughts on future trends.

Jul 11, 2024

Conference Talk 5: Napkin Math For Fine Tuning with Johno Whitaker

notes

llms

In this talk, Jonathan Whitaker from answer.ai shows how to build intuition around training performance with a focus on GPU-poor fine tuning.

Jul 7, 2024

Office Hours 5: LangChain/LangSmith

notes

llms

This Q&A session on LangChain/LangSmith covers topics like product differentiation, features, use cases, agent workflows, data set creation, and full-stack development for ML engineers.

Jul 6, 2024

Office Hours 4: Modal with Charles Frye

notes

llms

This Q&A session covers a wide array of topics related to Modal, a platform designed to simplify the execution of Python code in the cloud.

Jul 6, 2024

Conference Talk 4: Inspect - An OSS Framework for LLM Evals

notes

llms

In this talk, J.J. Allaire walks through the core concepts and design of the Inspect framework and demonstrate its use for a variety of evaluation tasks.

Jul 6, 2024

Conference Talk 3: Prompt Engineering Workshop

notes

llms

This talk by John Berryman covers the fundamentals of language models, prompt engineering techniques, and building LLM applications.

Jun 30, 2024

Conference Talk 2: LLM Eval For Text2SQL

notes

llms

This talk by Ankur Goyal from BrainTrust covers how to build evals for LLM systems by walking through a Text2SQL use case.

Jun 29, 2024

Workshop 3: Instrumenting & Evaluating LLMs

notes

llms

Workshop #3 focuses on the crucial role of evaluation in fine-tuning and improving LLMs. It covers three main types of evaluations: unit tests, LLM as a judge, and human evaluation.

Jun 20, 2024

Office Hours 3: Gradio Q&A Session with Freddy Boulton

notes

llms

Freddy showcases Gradio’s features, advantages, and repository contributions, highlighting its potential for AI applications. He concludes with insights into its future roadmap, which includes enhanced agent workflows, real-time streaming, and improved UI features.

Jun 14, 2024

Office Hours 2: Q&A Session with Zach Mueller

notes

llms

This Q&A session covers various aspects of LLM fine-tuning, including tools, techniques, data sets, and hardware considerations.

Jun 11, 2024

Office Hours 1: Axolotl Q&A with Wing Lian

notes

llms

This Q&A session covered various topics, including template-free prompt construction, data type selection for HuggingFace datasets, DPO and RLHF, understanding chat templates and dataset types, ensuring consistent tokenization, multimodal fine-tuning, and future directions for Axolotl.

Jun 11, 2024

Conference Talk 1: Ten Commandments to Deploy Fine-Tuned Models in Production

notes

llms

This talk by Kyle Corbitt from OpenPipe outlines ten key recommendations for successfully deploying fine-tuned language models (LLMs) in production.

Jun 10, 2024

Workshop 2: Fine-Tuning with Axolotl

notes

llms

Workshop #2 builds on Workshop 1 to focus on practical fine-tuning of LLMs, covering model selection, fine-tuning techniques with Axolotl, data quality improvement, debugging, and using tools like Accelerate and Modal.

Jun 9, 2024

GPU MODE Lecture 2: Ch.1-3 PMPP Book

notes

cuda

pytorch

Lecture #2 provides an introduction to parallel programming with CUDA C, covering key concepts like heterogeneous computing, data parallelism, thread organization, and memory management, and showcasing examples such as vector addition, image blurring, and matrix multiplication.

Jun 6, 2024

Workshop 1: When and Why to Fine-Tune an LLM

notes

llms

Workshop #1 provides a practical overview of fine-tuning large language models, focusing on when it is and is not beneficial, emphasizing a workflow of simplification, prototyping, and iterative improvement using evaluations.

May 31, 2024

GPU MODE Lecture 1: How to profile CUDA kernels in PyTorch

notes

cuda

pytorch

Lecture #1 provides a practical introduction to integrating and profiling custom CUDA kernels within PyTorch programs, using tools like load_inline, Triton, and NVIDIA Nsight Compute.

Apr 26, 2024

Setting Up CUDA for Python on Ubuntu

mamba

conda

cuda

getting-started

tutorial

Learn how to setup up NVIDIA CUDA on Ubuntu with the Mamba/Conda package manager. Based on Jeremy Howard’s lecture, Getting Started With CUDA for Python Programmers.

Mar 8, 2024

Notes on The Path of Least Resistance

book

notes

personal-growth

professional-growth

My notes from the book The Path of Least Resistance: Learning to Become the Creative Force in Your Own Life by Robert Fritz.

Feb 17, 2024

Exporting Keypoint R-CNN Models from PyTorch to ONNX

pytorch

onnx

keypoint-rcnn

keypoint-estimation

tutorial

Learn how to export Keypoint R-CNN models from PyTorch to ONNX and perform inference using ONNX Runtime.

Jan 30, 2024

Training Keypoint R-CNN Models with PyTorch

pytorch

keypoint-rcnn

keypoint-estimation

tutorial

Learn how to train Keypoint R-CNN models on custom datasets with PyTorch.

Jan 29, 2024

How to Create Custom Torchvision V2 Transforms

pytorch

object-detection

instance-segmentation

tutorial

Learn how to create custom Torchvision V2 Transforms that support bounding box annotations.

Jan 23, 2024

Working with LabelMe Segmentation Annotations in Torchvision

pytorch

image-annotation

object-detection

instance-segmentation

tutorial

Learn how to work with LabelMe segmentation annotations in torchvision for instance segmentation tasks.

Learn how to work with LabelMe keypoint annotations in torchvision for keypoint estimation tasks.

Working with LabelMe Keypoint Annotations in Torchvision

pytorch

image-annotation

keypoint-estimation

tutorial

Learn how to work with LabelMe bounding box annotations in torchvision for object detection tasks.

Working with LabelMe Bounding Box Annotations in Torchvision

pytorch

image-annotation

object-detection

tutorial

Learn how to work with CVAT segmentation annotations in torchvision for instance segmentation tasks.

Working with CVAT Segmentation Annotations in Torchvision

pytorch

image-annotation

instance-segmentation

tutorial

Learn how to work with CVAT keypoint annotations in torchvision for keypoint estimation tasks.

Working with CVAT Keypoint Annotations in Torchvision

pytorch

image-annotation

keypoint-estimation

tutorial

Learn how to work with CVAT bounding box annotations in torchvision for object detection tasks.

Working with CVAT Bounding Box Annotations in Torchvision

pytorch

image-annotation

object-detection

tutorial

Learn how to work with COCO segmentation annotations in torchvision for instance segmentation tasks.

Working with COCO Segmentation Annotations in Torchvision

pytorch

image-annotation

instance-segmentation

tutorial

Learn how to work with COCO bounding box annotations in torchvision for object detection tasks.

Working with COCO Bounding Box Annotations in Torchvision

pytorch

image-annotation

object-detection

tutorial

Learn how to track objects across video frames with YOLOX and ByteTrack.

Real-Time Object Tracking with YOLOX and ByteTrack

onnx

object-detection

object-tracking

yolox

byte-track

tutorial

Oct 27, 2023

Real-Time Object Detection in Unity with ONNX Runtime and DirectML

onnx

directml

yolox

object-detection

unity

tutorial

Learn how to integrate a native plugin within the Unity game engine for real-time object detection using ONNX Runtime.

Oct 20, 2023

Building a Computer Vision Plugin for Unity with ONNX Runtime

onnx

directml

unity

tutorial

Learn how to create a native plugin for the Unity game engine to perform inference with computer vision models using ONNX Runtime.

Oct 19, 2023

Integrating OpenCV with Visual Studio C++ Projects on Windows

opencv

visual-studio

getting-started

tutorial

Learn how to set up OpenCV within a Visual Studio C++ project by creating a simple console app that loads an image file and displays it in a new window.

Oct 10, 2023

Exporting timm Image Classifiers from Fastai to TorchScript

fastai

libtorch

image-classification

tutorial

Learn how to export timm image classification models from PyTorch to TorchScript for optimized, platform-independent deployment and enhanced performance.

Oct 8, 2023

Exporting timm Image Classifiers from Fastai to ONNX

fastai

onnx

image-classification

tutorial

Learn how to export timm image classification models from Fastai to ONNX and perform inference using ONNX Runtime.

Oct 7, 2023

Fine-Tuning Image Classifiers with Fastai and the timm library for Beginners

fastai

image-classification

tutorial

Learn how to fine-tune image classification models with fastai and the timm library by creating a hand gesture recognizer in this easy-to-follow guide for beginners.

Oct 6, 2023

Exporting YOLOX Models from PyTorch to TensorFlow.js

pytorch

tensorflow

tensorflow-js

yolox

tutorial

Learn how to export YOLOX models from PyTorch to TensorFlow.js to leverage efficient object detection in web applications.

Sep 28, 2023

Exporting Mask R-CNN Models from PyTorch to ONNX

pytorch

onnx

mask-rcnn

object-detection

instance-segmentation

tutorial

Learn how to export Mask R-CNN models from PyTorch to ONNX and perform inference using ONNX Runtime.

Sep 21, 2023

Training Mask R-CNN Models with PyTorch

pytorch

mask-rcnn

object-detection

instance-segmentation

tutorial

Learn how to train Mask R-CNN models on custom datasets with PyTorch.

Sep 20, 2023

Testing Intel’s Arc A770 GPU for Deep Learning Pt. 4

pytorch

ubuntu

arc-gpu

This post covers my findings testing the first version of Intel’s PyTorch extension to support PyTorch 2.0 on native Ubuntu and Windows.

Sep 11, 2023

Exporting timm Image Classifiers from PyTorch to ONNX

pytorch

onnx

image-classification

tutorial

Learn how to export timm image classification models from PyTorch to ONNX and perform inference using ONNX Runtime.

Aug 23, 2023

Exporting YOLOX Models from PyTorch to ONNX

pytorch

onnx

object-detection

yolox

tutorial

Learn how to export YOLOX models from PyTorch to ONNX and perform inference using ONNX Runtime.

Aug 22, 2023

Training YOLOX Models for Real-Time Object Detection in PyTorch

pytorch

object-detection

yolox

tutorial

Learn how to train YOLOX models for real-time object detection in PyTorch by creating a hand gesture detection model.

Aug 21, 2023

Testing Intel’s Arc A770 GPU for Deep Learning Pt. 3

pytorch

ubuntu

arc-gpu

This post covers my findings from training style transfer models and running Stable Diffusion with the 🤗 Diffusers library on the Arc A770 with Intel’s PyTorch extension.

Jun 12, 2023

Testing Intel’s Arc A770 GPU for Deep Learning Pt. 2

pytorch

ubuntu

wsl2

image-classification

arc-gpu

This post covers my experience training image classification models with Intel’s PyTorch extension on the Arc A770 GPU.

May 30, 2023

Fine-Tuning Image Classifiers with PyTorch and the timm library for Beginners

pytorch

image-classification

tutorial

Learn how to fine-tune image classification models with PyTorch and the timm library by creating a hand gesture recognizer in this easy-to-follow guide for beginners.

May 24, 2023

How to Obtain a Kaggle API Key

kaggle

getting-started

tutorial

This tutorial provides a step-by-step guide to obtaining a Kaggle API key.

May 17, 2023

Getting Started with Google Colab

google-colab

getting-started

tutorial

Learn the fundamentals of Google Colab, a free cloud-based Jupyter Notebook environment, to write, run, and share Python code in your browser without any setup or installation.

May 14, 2023

Code Walkthrough: Unity Barracuda Inference PoseNet Package

unity

walkthrough

Walk through the code for the Unity Barracuda Inference PoseNet package, which extends the functionality of unity-barracuda-inference-base to perform 2D human pose estimation using PoseNet models.

May 7, 2023

Code Walkthrough: Unity Human Pose 2D Toolkit Package

unity

walkthrough

Walk through the code for the Unity Human Pose 2D Toolkit package, which provides an easy-to-use and customizable solution to work with and visualize 2D human poses on a Unity canvas.

May 6, 2023

Code Walkthrough: Unity Barracuda Inference YOLOX Package

unity

walkthrough

Walk through the code for the Unity Barracuda Inference YOLOX package, which extends the functionality of unity-barracuda-inference-base to perform object detection using YOLOX models.

May 6, 2023

Code Walkthrough: Unity Barracuda Inference Image Classification Package

unity

walkthrough

Walk through the code for the Unity Barracuda Inference Image Classification package, which extends the functionality of unity-barracuda-inference-base to perform image classification using computer vision models.

May 6, 2023

Code Walkthrough: Unity YOLOX Utilities Package

unity

walkthrough

Walk through the code for the Unity YOLOX Utilities package, which provides utility functions to work with YOLOX object detection models in Unity.

May 5, 2023

Code Walkthrough: Unity Bounding Box 2D Toolkit Package

unity

walkthrough

Walk through the code for the Unity Bounding Box 2D Toolkit package, which provides an easy-to-use and customizable solution to work with and visualize 2D bounding boxes on a Unity canvas.

May 5, 2023

Code Walkthrough: Unity Barracuda Inference Base Package

unity

walkthrough

Walk through the code for the Unity Barracuda Inference Base package, which provides a foundation for performing inference with the Barracuda inference library.

May 5, 2023

Code Walkthrough: Unity Deep Learning Image Preprocessor Package

unity

walkthrough

Walk through the code for the Unity Deep Learning Image Preprocessor package, a utility for preparing image input to perform inference with deep learning models in Unity.

May 4, 2023

Code Walkthrough: Unity CV Image Gallery Package

unity

walkthrough

Walk through the code for the Unity CV Image Gallery package, an interactive image gallery to facilitate testing computer vision applications in Unity projects.

May 3, 2023

Code Walkthrough: Unity Media Display Package

unity

walkthrough

Walk through the code for the Unity Media Display package, a tool for displaying test images, videos, and webcam streams in Unity projects.

Apr 25, 2023

Exploring the Impact of Different Image Augmentations on Hand Gesture Recognition

miniai

Explore how data augmentation can improve a computer vision model’s ability to generalize to new input using a hand gesture dataset.

Mar 9, 2023

Testing Intel’s Arc A770 GPU for Deep Learning Pt. 1

directml

openvino

pytorch

unity

arc-gpu

I tested inference performance with OpenVINO and DirectML on the A770 and attempted to train models using PyTorch-DirectML.

Oct 18, 2022

Using TensorFlow.js for In-Browser Object Detection in Unity

unity

tensorflow

webgl

yolox

object-detection

tutorial

Create a TensorFlow.js plugin for the Unity game engine to perform object detection with a YOLOX model.

Oct 16, 2022

Using Fastai and TensorFlow.js for Hand Gesture Recognition in Unity Pt. 3

fastai

unity

tensorflow

webgl

tutorial

Build a Unity project as a WebGL application and host it using GitHub Pages.

Oct 6, 2022

Using Fastai and TensorFlow.js for Hand Gesture Recognition in Unity Pt. 2

fastai

unity

tensorflow

webgl

tutorial

Create a TensorFlow.js plugin for the Unity game engine.

Oct 5, 2022

Using Fastai and TensorFlow.js for Hand Gesture Recognition in Unity Pt. 1

fastai

unity

tensorflow

webgl

tutorial

Train a hand gesture classifier using fastai and export it to TensorFlow.js.

Oct 4, 2022

How to Create an OpenVINO Plugin for Unity on Windows Pt. 3

fastai

openvino

unity

tutorial

Modify the Unity project from the fastai-to-unity tutorial to classify images with OpenVINO.

Jul 18, 2022

How to Create an OpenVINO Plugin for Unity on Windows Pt. 2

fastai

openvino

unity

tutorial

Create a dynamic link library (DLL) file in Visual Studio to perform image classification with OpenVINO.

Jul 17, 2022

How to Create an OpenVINO Plugin for Unity on Windows Pt. 1

fastai

openvino

unity

tutorial

Modify the training code from the fastai-to-unity tutorial to export the model to OpenVINO.

Jul 17, 2022

How to Create a LibTorch Plugin for Unity on Windows Pt. 3

fastai

libtorch

unity

tutorial

Modify the Unity project from the fastai-to-unity tutorial to classify images with LibTorch.

Jun 28, 2022

How to Create a LibTorch Plugin for Unity on Windows Pt. 2

fastai

libtorch

unity

tutorial

Create a dynamic link library (DLL) file in Visual Studio to perform image classification using LibTorch.

Jun 28, 2022

How to Create a LibTorch Plugin for Unity on Windows Pt. 1

fastai

libtorch

unity

tutorial

Modify the training code from the fastai-to-unity tutorial to export the model to a TorchScript module.

Jun 28, 2022

Fastai to Unity Beginner Tutorial Pt. 3

fastai

unity

barracuda

tutorial

Build a Unity project as a WebGL application and host it using GitHub Pages.

Jun 8, 2022

Fastai to Unity Beginner Tutorial Pt. 2

fastai

unity

barracuda

tutorial

Classify images in a Unity project with the Barracuda inference library.

Jun 7, 2022

Fastai to Unity Beginner Tutorial Pt. 1

fastai

unity

barracuda

tutorial

Train an image classifier using the fastai library and export it to ONNX.

Jun 6, 2022

Getting Started With Deep Learning in Unity

unity

barracuda

An overview of Unity’s Barracuda inference library for executing deep learning models on user devices.

May 28, 2022

Notes on No ML Degree: How to Build an AI Portfolio

book

professional-growth

notes

My notes on Emil Wallner’s guide on how to land your first machine learning job without a degree.

May 27, 2022

Notes on Transformers Book Ch. 11

huggingface

nlp

notes

Chapter 11 explores scaling up transformers, methods to make self-attention more efficient, and multimodel transformers.

Apr 26, 2022

Notes on Transformers Book Ch. 10

huggingface

nlp

notes

Chapter 10 covers how to train a GPT-like model to generate Python source code from scratch.

Apr 25, 2022

Notes on Transformers Book Ch. 9

huggingface

nlp

notes

Chapter 9 covers how to deal with few to no labels by training a model that automatically tags GitHub issues for the Hugging Face Transformers library.

Apr 22, 2022

Notes on Transformers Book Ch. 8

huggingface

nlp

notes

Chapter 8 covers different methods to make transformer models more efficient in production.

Apr 14, 2022

Notes on Transformers Book Ch. 7

huggingface

nlp

notes

Chapter 7 covers building a question-answering model that finds answers to questions in customer reviews.

Apr 12, 2022

Notes on Transformers Book Ch. 6

huggingface

nlp

notes

Chapter 6 covers building an encoder-decoder model to condense dialogues between several people into a crisp summary.

Apr 10, 2022

Notes on Transformers Book Ch. 5

huggingface

nlp

notes

Chapter 5 covers different methods for generating text with GPT-2.

Apr 8, 2022

Notes on Transformers Book Ch. 4

huggingface

nlp

notes

Chapter 4 covers fine-tuning a multilingual transformer model to perform named entity recognition.

Apr 7, 2022

Notes on Transformers Book Ch. 3

huggingface

nlp

notes

Chapter 3 covers the Transformer architecture and different types of transformer models available on the Hugging Face Hub.

Apr 6, 2022

Notes on Transformers Book Ch. 2

huggingface

nlp

notes

Chapter 2 covers training a model to classify emotions expressed in Twitter messages.

Apr 1, 2022

Notes on Transformers Book Ch. 1

huggingface

nlp

notes

Chapter 1 covers essential advancements for transformers, recurrent architectures, the encoder-decoder framework, attention mechanisms, transfer learning in NLP, and the HuggingFace ecosystem.

Mar 30, 2022

Notes on fastai Book Ch. 19

fastai

notes

pytorch

Chapter 19 covers creating a fast.ai Learner from scratch.

Chapter 18 covers interpreting convolutional neural networks using class-activation maps.

Notes on fastai Book Ch. 18

fastai

notes

pytorch

Chapter 17 covers building a neural network from the foundations.

Notes on fastai Book Ch. 17

fastai

notes

pytorch

Chapter 16 covers momentum, RMSProp, Adam, decoupled weight decay, and fast.ai callbacks.

Notes on fastai Book Ch. 16

fastai

notes

pytorch

Chapter 15 provides a deep dive into different application architectures in the fast.ai library.

Notes on fastai Book Ch. 15

fastai

notes

pytorch

Chapter 14 covers building a ResNet from scratch.

Notes on fastai Book Ch. 14

fastai

notes

pytorch

Chapter 13 provides a deep dive into convolutional neural networks.

Notes on fastai Book Ch. 13

fastai

notes

pytorch

Chapter 12 covers building and training an LSTM from scratch.

Notes on fastai Book Ch. 12

fastai

notes

pytorch

Chapter 11 covers data munging with fast.ai’s mid-level data API.

Notes on fastai Book Ch. 11

fastai

notes

pytorch

Chapter 10 covers text preprocessing and training an RNN for text classification.

Notes on fastai Book Ch. 10

fastai

notes

pytorch

Chapter 9 provides a deep dive into tabular modeling.

Notes on fastai Book Ch. 09

fastai

notes

pytorch

Chapter 8 provides a deep dive into collaborative filtering.

Notes on fastai Book Ch. 8

fastai

notes

pytorch

Mar 28, 2022

Notes on fastai Book Ch. 7

fastai

notes

pytorch

Chapter 7 covers data normalization, progressive resizing, test-time augmentation, mixup, and label smoothing.

Chapter 6 covers multi-label classification and image regression.

Notes on fastai Book Ch. 6

fastai

notes

pytorch

Chapter 5 covers creating a custom DataBlock for an image classifier, pre-sizing, cross-entropy loss, model interpretation, picking learning rates, transfer learning, and discriminative learning rates.

Notes on fastai Book Ch. 5

fastai

notes

pytorch

Chapter 4 covers broadcasting, stochastic gradient descent, the MNIST loss function, and the sigmoid activation functions.

Notes on fastai Book Ch. 4

fastai

notes

pytorch

Chapter 3 defines data ethics, introduces essential topics in data ethics, and explains how to identify and address ethical issues.

Notes on fastai Book Ch. 3

ethics

fastai

notes

Chapter 2 covers how to train an image classification model using a custom dataset and turn it into an online application.

Notes on fastai Book Ch. 2

fastai

notes

pytorch

Chapter 1 covers the history of artificial neural networks, approaches for learning ML/DL, and using the fast.ai library for multiple deep learning tasks.

Notes on fastai Book Ch. 1

fastai

notes

pytorch

Modify the Barracuda PoseNet project to run in a browser using WebGL.

Barracuda PoseNet WebGL Tutorial

unity

barracuda

webgl

tutorial

Mar 10, 2022

Notes on the Streamlit API

python

streamlit

numpy

pandas

notes

My notes and reference examples for working with the Streamlit API.

Jan 2, 2022

Notes on Creating Data Science Apps With Streamlit

python

streamlit

numpy

pandas

notes

My notes from Chanin Nantasenamat’s video on creating data science web apps with Streamlit.

Jan 2, 2022

Notes on Backtracking Problems in Python

python

notes

My notes from Lynn Zheng’s video on solving LeetCode backtracking problems.

Dec 31, 2021

Notes on Version Control

git

notes

My notes from Tobias Gunther’s video covering tools and concepts for version control with git.

My notes from Kate Compton’s talk on practical techniques for procedural generation.

Notes on Practical Procedural Generation

procedural-generation

notes

My notes from Tobias Gunther’s video covering git branches.

Notes on Git Branches

git

notes

My notes from Tobias Gunther’s video covering advanced git tools.

Notes on Advanced Git Tools

git

notes

My notes from Squirrel Eiserloh’s presentation on 1D nonlinear transformations for game development.

Notes on 1D Nonlinear Transformations for Games

game-dev

notes

My notes from Jason Wiser’s talk on how he teaches a class that covers 5 semesters worth of game design in a single semester.

Notes on How to Teach 5 Semesters of Game Design in 1 Class

education

game-dev

notes

My notes from Martin Donald’s video on using the WaveFunctionCollapse algorithm for 3D modules.

Notes on WaveFunctionCollapse for 3D

procedural-generation

notes

Dec 28, 2021

Notes on Dungeon Generation via WaveFunctionCollapse

procedural-generation

notes

My notes from Brian Bucklew’s talk on procedurally generating dungeon levels using the WaveFunctionCollapse algorithm.

Dec 28, 2021

Notes on StyleGANv2

notes

My notes on the overview of StyleGANv2 by Henry AI Labs.

Dec 16, 2021

Notes on How to Make Money as a Freelance Developer

professional-growth

notes

Luke Ciciliano provides a guide for aspiring freelance web developers, covering whether freelancing is a good fit, how to stand out from the competition, effective sales techniques, and strategies for finding clients.

Dec 16, 2021

Notes on How To Speak

professional-growth

notes

My notes for Patrick Winston’s course on how to speak.

Dec 16, 2021

Notes on Learning Generative Models of 3D Structures

notes

In this presentation, Tao Wu provides a comprehensive overview of generative models for 3D structures, exploring various 3D representations, generative methodologies, and applications.

My notes from learning how to customize my GitHub profile.

Notes on Customizing Your GitHub Profile

github

notes

In this talk at Blender Conference 2018, Andrew Price explores the potential impact of AI and automation on the 3D industry.

Notes on The Next Leap: How A.I. will change the 3D industry

procedural-generation

notes

In this presentation from 2018, Etienne Carrier details the procedural pipeline developed for Far Cry 5 using Houdini and Houdini Engine, focusing on its objectives, tools, user workflow, underlying mechanics, and lessons learned during development.

Notes on Procedural World Generation of Ubisoft’s Far Cry 5

procedural-generation

game-dev

notes

In this talk, Herbert Wolverson explores various procedural map generation algorithms, demonstrating their implementation and applications in game development, particularly roguelikes.

Notes on Procedural Map Generation Techniques

game-dev

procedural-generation

notes

In this presentation from 2017, Ben Berman explores the use of machine learning for generating game content, focusing on techniques that produce results that appear handcrafted rather than procedurally generated.

Notes on Machine Learning and Level Generation

game-dev

notes