Stories by mji

RvLLM: High-performance LLM inference in Rust

My chief of staff, Claude Code

Native KV Cache Offloading to Any Filesystem with LLM-D

Mooncake Joins PyTorch Ecosystem

The K-Shaped Future of Software Engineering

How Prompt Caching Works – Paged Attention and Automatic Prefix Caching

California lawmakers pass SB 79, housing bill that brings dense housing

Reinforcement Learning with Nvidia NeMo-RL

Everyone Mark Zuckerberg has hired so far for Meta's 'superintelligence' team

The Mediocrity of Modern Google

Pace

Exaone Deep Released ━ Setting a New Standard for Reasoning AI

Sixty Hours a week? How about 4 uninterrupted hours a day?

Regatta Storage: Transform S3 into an infinite, local file system

Operate at All Levels

Study: Air purifier use at daycare centres cut kids' sick days by a third (2023)

S.F. becomes first California city to miss its housing goals

Netflix wants managers to ask whether they would rehire their employees

A day in the life of an Amazon VP

DataComp-LM: In search of the next generation training sets for language models

1 2 3 4