Stories by crowwork

Modern GPU Programming for MLSys

Building an Open ABI and FFI for ML Systems

Open ABI and FFI for Machine Learning Systems

MLCEngine: Universal LLM Deployment to Both Cloud and Local Devices

Running Google's Gemma 2B on Android

MLC Chat: Chat with Open Language Models Locally on iPad and iPhone

WebLLM NPM Package

Bringing Hardware Accelerated Language Models to Android Devices

Bringing Hardware Accelerated Language Models to Consumer Devices

MLC LLM – Large Language Models on iPhone GPU and Many More GPU Platforms

MLC LLM: Universal LLM Deployment with GPU Acceleration

Web LLM

Web Stable Diffusion

Running Stable Diffusion fully in browser with WebGPU

TinyML – How TVM Is Taming Tiny

Compiling Machine Learning to WASM and WebGPU with Apache TVM

FFI Navigator: Language Server for Cross Language FFI Calls

TVM and Deep Learning Compilation Conference 2019 Videos and Slides