Stories by tosh

Cramming: Training a Language Model on a Single GPU in One Day (2022)

H2O-Danube-1.8B Technical Report

H2O-Danube2-1.8B-Chat

IBM System/360

OpenAI Sora at AGI House

The Roadmap to Product/Market Fit (PMF) Maybe

LlamaIndex: A data framework for your LLM applications

LlamaBot with Ollama on my home virtual private network

Wide Gamut Color in CSS with Display-P3

SentenceTransformers: Python framework for sentence, text and image embeddings

The lifecycle of a code AI completion

Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training

In-Context Learning with Retrieved Demonstrations for Language Models

Master Plan, Part Deux (2016)

Language models are Super Mario: Absorbing abilities from homologous models

Google Gemma 1.1 2B and 7B instruct

Do we need Attention? A Mamba Primer [video]

A simple puzzle GPTs will NEVER solve

Optuna – A Hyperparameter Optimization Framework

288 289 290 291 292 293 294 295 296 297