Stories by gpjt

First patient to undergo live AI-assisted brain surgery has tumour removed

Adding diagrams to my static site generator with D2

Use the built-in GELU, don't roll your own

A Quick(ish) Chinchilla Check

I use AI on this blog

Why do OpenAI's GPT-2 weights beat mine? Part three: testing overtraining

Why do OpenAI's GPT-2 weights beat mine? Part two: the bugfix

Why do OpenAI's GPT-2 weights beat mine?

Benchmarking Qwen 3.6 35B MoE (3B active) on an RTX 3090

Building intuition about LLM parameter counts

Poppy the training box, part 1: the beginnings

From bigrams to GPT-2, one component at a time (in Jax)

Building a Jax training loop for an LLM training run

Thoughts on Role Confusion

Flax debugging: making a hash of things

10Gb/s Ethernet: switching to a Broadcom SFP+ module

Jax: Commitment Issues

Jax Back Ends and Devices

Using Safetensors with Flax

First Looking into Jax

1 2 3