Stories by philipkiely

Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs

How to build function calling and JSON mode for open-source and fine-tuned LLMs

How to double tokens per second for Llama 3 with Medusa

FP8: Efficient model inference with 8-bit floating point numbers

Three techniques to adapt LLMs for any use case

Show HN: Free Stable Diffusion 2.0 hosted interface

Try it yourself: Speech to text with Whisper

Deploying Stable Diffusion in Production Using Truss

Hosted Stable Diffusion Demo

Show HN: Truss – Serve any ML model without boilerplate code

Code generation interactive demo (Salesforce Codegen mono 2B)

Show HN: Baseten – Build ML-powered applications

How BaseTen is using “docs as code”

Short-Cycle Recurring Revenue

Redesigning an Information Product Landing Page

Cold Email for Interesting People, Second Edition

Friendship Cards

Who Will Write Your Company’s Technical Content?

1