Stories by tosh

Mixtures of Experts (2023)

Qwen1.5-110B

Publish Python Packages to PyPI

OpenVoice: Instant Voice Cloning

Apple OpenELM: An Efficient Language Model Family

Open sourcing MS-DOS 4.0

Packaging CLI programs into Docker images to avoid dependency hell (2019)

John Carmack on Meta Horizon OS

Is SaaS Dead?

The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions

Poptop: A modern top command that charts system metrics

NExT: Teaching Large Language Models to Reason about Code Execution

Retrieval Head Mechanistically Explains Long-Context Factuality

Cohere-toolkit: a collection of prebuilt components for RAG applications

I built and sold Frame.io for $1.3B to Adobe

Weasel Word

Spring: Rails Application Preloader

Laws of Tech: Commoditize Your Complement (2022)

Node.js 22 is now available

I developed the fastest XML parser (2020)