Stories by swyx

The True Origin of Attention, from Its Author Dzmitry Bahdanau

LLM Abstraction levels inspired by Fish Eye lens

Reward Hacking in Reinforcement Learning

The New Claude 3.5 Sonnet, Computer Use, and Building SOTA Agents

Unveiling DeepSeek: A Story of Even More Chinese Technological Idealism

How to Run a Paper Club

Amazon to invest another $4B in Anthropic

LMSys Killed Model Versioning

OpenAI Realtime API: The Missing Manual

Why GPT Wrappers Are Good

The Most Dangerous Thing an AI Startup Can Do Is Build for Other AI Startups

The Bill Gates Line (2018)

Facebook/lexical: extensible text editor framework

Nous Forge Reasoning API Beta beats o1 (full) at AIME

Simple-realtime-console: OpenAI's Realtime API minus the enterprise bloat

How NotebookLM Was Made

Software, the Tough Tomato Principle, the Great Weirdening of the World (2019)

FireAttention V3: Enabling AMD as a Viable Alternative for GPU Inference

Everyone's an Owner

AI Neocloud Playbook and Anatomy

1
2
3
4
5
6
7
8
9
10