Stories by mikepapadim

A Glance at GPU Goodness in Java: LLM Inference with TornadoVM

Show HN: GPULlama3.java Llama Compilied to PTX/OpenCL Now Integrated in Quarkus

Detaching GraalVM from the Java Ecosystem Train

LLM Inference in pure Java with a GPU acceleration enabled

GPU-enabled Llama 3 inference in Java from scratch

GPULlama3.java – Llama3.java on Steroids

Llama Deck:CLI for running multiple language implementations of LLM inference

Llama3 Inference in Pure Java

Building libraries for LLM inference in pure modern Java

Java VectorAPI compatiblity with TornadoVM GPU programming framework

Java GPU pre/post processing with ONNX RT and TornadoVM

Multifaceted Memory Analysis of Java Benchmarks with NUMAProfiler and PerfUtil [pdf]

Ask HN: Do you know any new llama2.c implementations not mentioned in the repo

Llama2-shepherd a CLI tool to install multiple implementations of the llama2

Java and LLMs: are we there yet?