Stories by 3Sophons

Embed LLMs in your app easily–each model tackles agentic tasks it finetuned for

Can the New Mathstral LLM Accurately Compare 9.11 and 9.9?

WebAssembly on Kubernetes: The Practice Guide

Demo: Run the 314B Grok LLM on Pure CPU with WASM?

Efficient and Portable AI / LLM Inference on the Edge Cloud

Create an LLM web service with LlamaEdge on MacBook, deploy it on Nvidia devices [video]

LlamaEdge 0.4.0 Released: Multimodal LLM support, RAG assistant API and more

Demo: Run LLava multimodal LLM with a 2M Rust app portable across GPU/CPU

Run Alicloud's Qwen LLM with a 2MB cross GPU/CPU rust app

Self-Host Across GPU/CPUs Google's Gemma LLMs with a 2MB App

Free Linux Foundation Training/ Certification for New Open Source Contributors

Complete tutorial: Run Qwen LLM across your local machines without Python/C++

Launched! WebAssembly System Interface WASI Preview 2 Discussion

Develop+Deploy RAG Bots with LlamaEdge: Across OSes, NPUs, GPUs Using Vector DB

Self-host any GUFF LLMs on Hugging Face and run across devices

Run the leaked Mistral Medium, miqu-1-70B across GPUs CPUs and OSes

Self-host StableLM-2-Zephyr-1.6B. Portable across GPUs CPUs OSes

LFX Mentorship 2024 Spring LLM Projects: Build Open Source AI Inference Infra

LlamaEdge 0.2.9 released. Now works with Hugging Face's 3000 GGUF models

Rust boosts LLM app development: Make a serverless Japanese Learning bot in mins

1
2
3
4
5
6
7
8