Stories by che_shr_cat

Neural Network Diffusion

Thermodynamic AI is getting hotter

Training LLMs with AMD GPUs on Frontier Supercomputer

Beyond Chinchilla-Optimal Accounting for Inference in Language Model Scaling Law

Project CETI

GonzoML on Mamba and S6 (+previous post on S4)

Conway's Game of Life Is Omniperiodic

GonzoML on Gemini

Matryoshka Representation Learning

Mindstorms in Natural Language-Based Societies of Mind

The convolution empire strikes back

Sparse Universal Transformer

MemWalker: An alternative way for working with long documents using transformers

"Building Machines That Learn and Think Like People", 7 Years Later

Chain-of-Thought → Tree-of-Thought

Mortal Computers

Levanter – Legible, Scalable, Reproducible Foundation Models with Jax

LM-3 –- resurrecting the MIT CADR

The Annotated Diffusion Model

Road to text-guided image generation: DALL·E, CLIP, GLIDE, DALL·E 2 (unCLIP)

1
2
3
4
5