Stories by tosh

I don't understand Mistral and context size

Llama-Terminal-Completion

Do we think the world is better off with more or less intelligence?

CUDA: Faster Mixtral Prompt Processing

I made a script that watches for new screenshots and renames them

Mixtral on MLX

Fireworks: Function Calling Model and API

Who knows what GamePlanner does, but Airbnb just bought the company

Tuple Database

Mistral 7B Fine-Tune Optimized

Benchmarking Agent Tool Use

I doubled my Internet speed with OpenWRT

Pressure testing the context window of open LLMs

Holistic Evaluation of Language Models (Helm)

NUC

Perplexity

How many Mixtral experts are optimal and at what bits-per-weight?

Qwen on MLX

Recommendation for a local LLM server, budget 100k