Stories by tosh

Implementing FrugalGPT: Reducing LLM Costs and Improving Performance

I made an LLM Wirecutter based on Reddit conversations

Llama-3-8B-256k-PoSE

Mixtures of Experts (2023)

Qwen1.5-110B

Publish Python Packages to PyPI

OpenVoice: Instant Voice Cloning

Apple OpenELM: An Efficient Language Model Family

Open sourcing MS-DOS 4.0

Packaging CLI programs into Docker images to avoid dependency hell (2019)

John Carmack on Meta Horizon OS

Is SaaS Dead?

The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions

Poptop: A modern top command that charts system metrics

NExT: Teaching Large Language Models to Reason about Code Execution

Retrieval Head Mechanistically Explains Long-Context Factuality

Cohere-toolkit: a collection of prebuilt components for RAG applications

I built and sold Frame.io for $1.3B to Adobe

Weasel Word

Spring: Rails Application Preloader