Stories by tosh

Clippy, the Fucking Clown

What is FIM and why does it matter in LLM-based AI

Do you remember being born? I do

GPT-4: big jump in math/reasoning

Running a bakery on Emacs and PostgreSQL (2019)

Together AI adds Mixtral-8x22B

Apple Now Assembles 14% of iPhones in India

Mixtral 8x22B on MLX

Google's new Arm-based CPU will challenge Microsoft and Amazon in the AI race

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence

Gemini System Prompt: Do not express any desire for self-preservation

Making Crash Bandicoot (2011)

PostHog: Side Project Insurance

A solid pattern to build LLM Applications

Copilot vs. Cody: Why context matters for code AI

Google RecurrentGemma: Moving Past Transformers [pdf]

Griffin: Mixing Gated Linear Recurrences with Local Attention

Kirby's Avalanche

RecurrentGemma: Mixture local attention and linear recurrences