Stories by sbbq

PyTorch in One Hour: From Tensors to Training Neural Networks on Multiple GPUs

Intermediate ML and AI questions and answers for interview prep

Qwen3 Implemented from Scratch

Understanding and Coding the KV Cache in LLMs from Scratch

Coding LLMs from the Ground Up: A Complete Course

The State of Reasoning Models

Understanding Reasoning LLMs

Implementing a Byte Pair Encoding (BPE) Tokenizer from Scratch

AI Research Recap 2024: From New Scaling Laws to Scaling Inference Compute

Noteworthy AI Research Papers of 2024 (Part One)

Collection of 1k LLM Research Papers of 2024

Understanding Multimodal LLMs: The Main Techniques and Latest Models

Implementing the Llama 3.2 1B and 3B Architectures from Scratch

Converting GPT to Llama step-by-step code guide

New LLM Pre-Training and Post-Training Paradigms: How Modern LLMs Are Trained

LLM instruction finetuning from-scratch tutorial

Tips for LLM Pretraining and Evaluating Reward Models

Sharing Deep Learning Research Models: Building a Super Resolution App

Taking Datasets, DataLoaders, and PyTorch’s New DataPipes for a Spin

Running PyTorch on the M1 GPU