Reach more potential users and drive product growth and revenue.
AdvertiseTools tagged with "ROCm"
llama.cpp
Free ListingStars: 129.5KLLM inference in C/C++
LLM inference in C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware, locally and in the cloud.
vLLM
Free ListingStars: 94.2KEasy, fast, and cost-efficient LLM serving for everyone.
vLLM is a high-throughput, memory-efficient inference and serving engine for LLMs. It aims to make LLM serving easy, fast, and cost-efficient for everyone.
llmfit
Free ListingStars: 38.5KFind LLMs that run on your hardware.
llmfit detects CPU, RAM, GPU, VRAM, and accelerators, then ranks hundreds of open-source LLMs across quantizations by fit, speed, quality, and context so you can see what runs well on your machine.
SGLang
Free ListingStars: 37.2KHigh-performance LLM and multimodal model serving
SGLang is a high-performance serving framework for large language and multimodal models, designed for fast, scalable inference across diverse models and hardware.
DwarfStar
Free ListingStars: 24KLocal inference engine for DeepSeek, GLM, and Qwen
DwarfStar is a small native inference engine for running selected DeepSeek, GLM, and Qwen models on consumer hardware with Metal, CUDA, and ROCm support. It uses the project's own GGUF files and is not a general GGUF runner.
Kev
Free ListingStars: 9.6KSmall Jev-like decision models to train and run yourself.
Kev is a family of small decision models built on Qwen3.5 and Qwen3.8, based on Jev's architecture. Use pretrained weights or train your own, with yes/no, multiple-choice, and rating questions in one request.
ATLAS
Free ListingStars: 2.1KLocal coding agent for compact open models
ATLAS is a local coding agent from Inferstep, an open lab challenging assumptions on scale. It adds planning, verification, and repair around compact open models so software work can run on local hardware.

