Reach more potential users and drive product growth and revenue.
AdvertiseInference Servers & APIs
Production batching, scheduling, compatible APIs, and serving.
vLLM
Free ListingStars: 94.2KEasy, fast, and cost-efficient LLM serving for everyone.
vLLM is a high-throughput, memory-efficient inference and serving engine for LLMs. It aims to make LLM serving easy, fast, and cost-efficient for everyone.
DwarfStar
Free ListingStars: 24KLocal inference engine for DeepSeek, GLM, and Qwen
DwarfStar is a small native inference engine for running selected DeepSeek, GLM, and Qwen models on consumer hardware with Metal, CUDA, and ROCm support. It uses the project's own GGUF files and is not a general GGUF runner.
DeepInfer
Free ListingStars: 7.9KHigh-performance inference framework for DeepSeek models
DeepInfer is a high-performance, large-scale inference framework for DeepSeek models. This open-source release provides offline inference with optimized kernels, parallelism, scheduling, deterministic sampling, and structured outputs.

