Skip to main content
AdOpenFree logoPromote your productReach more potential users and drive product growth and revenue.Advertise

Tools tagged with "ROCm"

Favicon of llama.cpp

llama.cpp

Free ListingStars: 129.5K

LLM inference in C/C++

Language Models

LLM inference in C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware, locally and in the cloud.

Favicon of vLLM

vLLM

Free ListingStars: 94.2K

Easy, fast, and cost-efficient LLM serving for everyone.

Inference Servers & APIs

vLLM is a high-throughput, memory-efficient inference and serving engine for LLMs. It aims to make LLM serving easy, fast, and cost-efficient for everyone.

Favicon of llmfit

llmfit

Free ListingStars: 38.5K

Find LLMs that run on your hardware.

Evaluation & Benchmarks

llmfit detects CPU, RAM, GPU, VRAM, and accelerators, then ranks hundreds of open-source LLMs across quantizations by fit, speed, quality, and context so you can see what runs well on your machine.

Favicon of SGLang

SGLang

Free ListingStars: 37.2K

High-performance LLM and multimodal model serving

Multimodal Models

SGLang is a high-performance serving framework for large language and multimodal models, designed for fast, scalable inference across diverse models and hardware.

Favicon of DwarfStar

DwarfStar

Free ListingStars: 24K

Local inference engine for DeepSeek, GLM, and Qwen

Inference Servers & APIs

DwarfStar is a small native inference engine for running selected DeepSeek, GLM, and Qwen models on consumer hardware with Metal, CUDA, and ROCm support. It uses the project's own GGUF files and is not a general GGUF runner.

Favicon of Kev

Kev

Free ListingStars: 9.6K

Small Jev-like decision models to train and run yourself.

Language Models

Kev is a family of small decision models built on Qwen3.5 and Qwen3.8, based on Jev's architecture. Use pretrained weights or train your own, with yes/no, multiple-choice, and rating questions in one request.

Favicon of ATLAS

ATLAS

Free ListingStars: 2.1K

Local coding agent for compact open models

Code Assistants & Editors

ATLAS is a local coding agent from Inferstep, an open lab challenging assumptions on scale. It adds planning, verification, and repair around compact open models so software work can run on local hardware.

Ad
OpenFree logoPromote your product

Reach more potential users and drive product growth and revenue.

Advertise