Reach more potential users and drive product growth and revenue.
AdvertiseModels & Inference
Open models, embeddings, runtimes, and inference servers.
ollama
Free ListingStars: 181.7KStart building with open models.
Ollama lets you get up and running with open models such as Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, and Gemma. It offers a CLI, REST API, and libraries for Python and JavaScript to run and manage models locally.
llama.cpp
Free ListingStars: 129.5KLLM inference in C/C++
LLM inference in C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware, locally and in the cloud.
DeepSeek-V3
Free ListingStars: 104.5KMixture-of-Experts language model with 671B parameters
DeepSeek-V3 is a Mixture-of-Experts language model with 671B total parameters and 37B activated per token. It supports a 128K context and is available in Base and Chat variants with open weights for local deployment and API use.
vLLM
Free ListingStars: 94.2KEasy, fast, and cost-efficient LLM serving for everyone.
vLLM is a high-throughput, memory-efficient inference and serving engine for LLMs. It aims to make LLM serving easy, fast, and cost-efficient for everyone.
nanochat
Free ListingStars: 60.1KMinimal experimental harness for training LLMs
nanochat is a minimal, hackable harness for training LLMs end to end on a single GPU node, covering tokenization, pretraining, finetuning, evaluation, and inference. It is pitched as the best ChatGPT that $100 can buy.
Colibri
Free ListingStars: 46.7KTiny engine, immense model.
Colibri is an open-source hierarchical inference engine that adapts LLM inference to your machine, coordinating CPU, GPU, RAM and storage while streaming mixture-of-experts weights from disk.
Heretic
Free ListingStars: 38.2KTraining-free language model modification
Heretic is a training-free language model modification tool. It uses mathematical techniques and configurable scorers to steer model behavior, including removing censorship, suppressing refusals, reducing slop or sycophancy, and more.
SGLang
Free ListingStars: 37.2KHigh-performance LLM and multimodal model serving
SGLang is a high-performance serving framework for large language and multimodal models, designed for fast, scalable inference across diverse models and hardware.
Laya
Free ListingStars: 34KTyped decisions with calibrated probabilities in one pass
Laya is a non-autoregressive System 1 decision engine for typed choice, score, and yes/no questions over text. It returns calibrated probabilities in one forward pass across 100+ languages and routes requests to the right checkpoint.
Qwen3
Free ListingStars: 27.7KLarge language model series by the Qwen team, Alibaba Cloud
Qwen3 is the large language model series from Alibaba Cloud's Qwen team. It offers dense and Mixture-of-Experts models with thinking and non-thinking modes, multilingual, long-context, reasoning, coding, and agent capabilities.
DwarfStar
Free ListingStars: 24KLocal inference engine for DeepSeek, GLM, and Qwen
DwarfStar is a small native inference engine for running selected DeepSeek, GLM, and Qwen models on consumer hardware with Metal, CUDA, and ROCm support. It uses the project's own GGUF files and is not a general GGUF runner.
Surya
Free ListingStars: 21.6KOCR, layout analysis, reading order, and table recognition
Surya is a 689M-parameter OCR model from Datalab for document intelligence, covering OCR, layout analysis, reading order, and table recognition in 90+ languages.
Qwen3-VL
Free ListingStars: 20KMultimodal large language model series by Qwen team
Qwen3-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud, offering dense and MoE architectures, advanced visual reasoning, long context, and expanded OCR.
Edge0
Free ListingStars: 11KDevice-native foundation models for on-device AI
Edge0 provides device-native foundation models and an open-source streaming MoE inference framework, running large sparse models such as 145B on a laptop and 35B on a phone with SSD-streamed weights, offline on-device processing, and zero
kimi-k3-in-c
Free ListingStars: 10K2.78T-parameter Kimi K3 inference in portable C99
Runs Kimi K3, a 2.78-trillion-parameter model, on a single CPU in 8.24 GB of RAM by streaming the model from disk instead of holding it in memory. Portable C99 with no BLAS, framework, or GPU.
Kev
Free ListingStars: 9.6KSmall Jev-like decision models to train and run yourself.
Kev is a family of small decision models built on Qwen3.5 and Qwen3.8, based on Jev's architecture. Use pretrained weights or train your own, with yes/no, multiple-choice, and rating questions in one request.
DeepInfer
Free ListingStars: 7.9KHigh-performance inference framework for DeepSeek models
DeepInfer is a high-performance, large-scale inference framework for DeepSeek models. This open-source release provides offline inference with optimized kernels, parallelism, scheduling, deterministic sampling, and structured outputs.
Gemini-API
Free ListingStars: 3.6KAsync Python wrapper for Google Gemini web app
An asynchronous Python wrapper for the Google Gemini web app (formerly Bard), offering text, image, video, audio, chat, streaming, and deep research capabilities through a reverse-engineered client.
neuron-explorer
Free ListingStars: 1.3KSteering-first neuron explorer for Qwen3.5-4B
A steering-first explorer for Qwen3.5-4B that pushes every MLP neuron, keeps every rollout, and lays the results out over a 3D view of the model.
openTPU
Free ListingStars: 0.9KOpen-source AI accelerator: RTL, ISA, simulator, compiler
openTPU is an open-source AI accelerator developed by AI, combining RTL, ISA, simulator, compiler, and profiler in one repository. It runs Qwen3, LFM2.5, and Qwen3.5 on a Kintex-7 PCIe card.

