Skip to main content
AdOpenFree logoPromote your productReach more potential users and drive product growth and revenue.Advertise

Inference Servers & APIs

Production batching, scheduling, compatible APIs, and serving.

Favicon of vLLM

vLLM

Free ListingStars: 94.2K

Easy, fast, and cost-efficient LLM serving for everyone.

Inference Servers & APIs

vLLM is a high-throughput, memory-efficient inference and serving engine for LLMs. It aims to make LLM serving easy, fast, and cost-efficient for everyone.

Favicon of DwarfStar

DwarfStar

Free ListingStars: 24K

Local inference engine for DeepSeek, GLM, and Qwen

Inference Servers & APIs

DwarfStar is a small native inference engine for running selected DeepSeek, GLM, and Qwen models on consumer hardware with Metal, CUDA, and ROCm support. It uses the project's own GGUF files and is not a general GGUF runner.

Favicon of DeepInfer

DeepInfer

Free ListingStars: 7.9K

High-performance inference framework for DeepSeek models

Inference Servers & APIs

DeepInfer is a high-performance, large-scale inference framework for DeepSeek models. This open-source release provides offline inference with optimized kernels, parallelism, scheduling, deterministic sampling, and structured outputs.

Ad
OpenFree logoPromote your product

Reach more potential users and drive product growth and revenue.

Advertise