Stories by 3Sophons

Demo: Run LLM on your own devices. portable across GPUs/CPUs/OSes

Demo: Use WebAssembly to Run LLMs on Your Own Device with WasmEdge

Demo: Interact with open source LLMs via a web interface locally [video]

Single command to self-host open source LLMs on Mac, Jetson etc. portable

Run Nous-Hermes-2-Mixtral-8x7B with one Command on Mac, Jetson and more

LlamaEdge: Lightweight portable LLM tools for your local, edge& server devices

Demo: Selfhost Mixtral 8x7B MoE on Mac+cross devices, PORTABLE 2MB inference app

Use WASM as a cross-platform LLM backend for LangChain: Any LLMs on any device

Self-host SOLAR-10.7B-Instruct-v1.0 LLM with portable 2MB AI inference app

Selfhost LLMs like Mixtral 8x7B on the Edge & across devices.

Easy Setup Self-host Mixtral-8x7B across devices with a 2M inference app

A unikernel designed specifically for running WASM apps and compatible with WASI

Run on Mac Japanese LLM CALM2-7B with portable 2M inference app and create API

WASM and OpenShift Combine for Efficient, Scalable Applications

Secure Efficient Portable: Unleash WASM's Potential with Podman on macOS/Windows

Goodbye Poor Conf WiFi: Run Self-Hosted Mistralite LLM at AWS Re:Invent "

StarlingLM Runs Across Devices – No Python Hassles

Run BerkeleyEECS Starling 7B on any device with a single binary app. Zero Python

Getting Started with Orca-2-13B

1
2
3
4
5
6
7
8