Stories by pveldandi

Show HN: 50+ LLMs on 2 GPUs with 2-Second Swapping? We built AI-Native Runtime

Show HN: InferX - AI Lambda-Like Inference Function as a Service

We're running 50 LLMs on 2 GPUs – no cold starts, no overprovisioning

Show HN: InferX – an AI-native OS for running 50 LLMs per GPU with hot swapping