Reach more potential users and drive product growth and revenue.
AdvertiseTools tagged with "Local LLM"
ollama
Free ListingStars: 181.7KStart building with open models.
Ollama lets you get up and running with open models such as Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, and Gemma. It offers a CLI, REST API, and libraries for Python and JavaScript to run and manage models locally.
llama.cpp
Free ListingStars: 129.5KLLM inference in C/C++
LLM inference in C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware, locally and in the cloud.
DeepSeek-V3
Free ListingStars: 104.5KMixture-of-Experts language model with 671B parameters
DeepSeek-V3 is a Mixture-of-Experts language model with 671B total parameters and 37B activated per token. It supports a 128K context and is available in Base and Chat variants with open weights for local deployment and API use.
Unsloth
Free ListingStars: 76.8KOpen-source framework to run and train LLMs locally
Unsloth is an open-source framework for running and training LLMs. It provides a local UI to run and train LLMs and diffusion models, supporting GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
Free Claude Code
Free ListingStars: 63.6KFree tokens across 61 providers and 12 coding agents
Free Claude Code is an open-source model gateway and coding-agent launcher that unifies 61 providers, 1.3B+ monthly free tokens, and 12 coding agents across terminal, IDE, desktop, browser, and phone, with automatic fallback.
nanobot
Free ListingStars: 49.6KYour open-source agent, everywhere you work.
nanobot is an ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, terminal, and chat apps, plus tools, memory, MCP, multi-agent workflows, and automations.
Colibri
Free ListingStars: 46.7KTiny engine, immense model.
Colibri is an open-source hierarchical inference engine that adapts LLM inference to your machine, coordinating CPU, GPU, RAM and storage while streaming mixture-of-experts weights from disk.
Codewhale
Free ListingStars: 41.1KOpen-source coding agent that works with any model.
Codewhale is an open-source coding agent and terminal client that reads projects, edits files, runs commands, checks its work, and connects to hosted or local models.
OpenHuman
Free ListingStars: 40.1KOpen-source personal AI that runs on your laptop
OpenHuman is a free, open-source personal AI for Mac, Windows and Linux that keeps data local and orchestrates fleets of agents. Built in Rust, it is positioned as a fast, efficient open-source agent harness.
llmfit
Free ListingStars: 38.5KFind LLMs that run on your hardware.
llmfit detects CPU, RAM, GPU, VRAM, and accelerators, then ranks hundreds of open-source LLMs across quantizations by fit, speed, quality, and context so you can see what runs well on your machine.
Heretic
Free ListingStars: 38.2KTraining-free language model modification
Heretic is a training-free language model modification tool. It uses mathematical techniques and configurable scorers to steer model behavior, including removing censorship, suppressing refusals, reducing slop or sycophancy, and more.
Vane
Free ListingStars: 36.9KPrivacy-focused AI answering engine
Vane is a privacy-focused AI answering engine that runs entirely on your own hardware. It combines web knowledge with local LLMs (Ollama) and cloud providers (OpenAI, Claude, Groq), delivering cited answers while keeping searches private.
Strata
Free ListingStars: 31.2KRun Qwen3.8-Flash-Next on your own PC
Strata runs the 125B-parameter Qwen3.8-Flash-Next on consumer PCs, with one-click Windows and Linux installs, a local inference engine, OpenAI- and Anthropic-compatible localhost APIs, and optional image input.
Qwen3
Free ListingStars: 27.7KLarge language model series by the Qwen team, Alibaba Cloud
Qwen3 is the large language model series from Alibaba Cloud's Qwen team. It offers dense and Mixture-of-Experts models with thinking and non-thinking modes, multilingual, long-context, reasoning, coding, and agent capabilities.
DwarfStar
Free ListingStars: 24KLocal inference engine for DeepSeek, GLM, and Qwen
DwarfStar is a small native inference engine for running selected DeepSeek, GLM, and Qwen models on consumer hardware with Metal, CUDA, and ROCm support. It uses the project's own GGUF files and is not a general GGUF runner.
FreeToken
Free ListingStars: 15.1KDatacenter-scale MoE model serving on your desktop
FreeToken is an edge-native Mixture-of-Experts serving engine that runs frontier-scale open-weight models locally on consumer and personal hardware, with adaptive CPU–GPU co-execution and OpenAI/Anthropic-compatible APIs.
Edge0
Free ListingStars: 11KDevice-native foundation models for on-device AI
Edge0 provides device-native foundation models and an open-source streaming MoE inference framework, running large sparse models such as 145B on a laptop and 35B on a phone with SSD-streamed weights, offline on-device processing, and zero
kimi-k3-in-c
Free ListingStars: 10K2.78T-parameter Kimi K3 inference in portable C99
Runs Kimi K3, a 2.78-trillion-parameter model, on a single CPU in 8.24 GB of RAM by streaming the model from disk instead of holding it in memory. Portable C99 with no BLAS, framework, or GPU.
Kev
Free ListingStars: 9.6KSmall Jev-like decision models to train and run yourself.
Kev is a family of small decision models built on Qwen3.5 and Qwen3.8, based on Jev's architecture. Use pretrained weights or train your own, with yes/no, multiple-choice, and rating questions in one request.
TurboFieldfare
Free ListingStars: 7.4KGemma 4 26B-A4B inference in about 2 GB of RAM
TurboFieldfare is a Swift and Metal runtime for running Gemma 4 26B-A4B on Apple Silicon Macs with about 2 GB of RAM by streaming routed experts from SSD while keeping shared weights and KV cache resident.
Ollama JavaScript Library
Free ListingStars: 4.4KOfficial JavaScript client for Ollama
Official JavaScript client for Ollama that wraps the Ollama REST API, enabling chat, streaming, embeddings, model management, tool use, and cloud model access in Node and browser apps.
ATLAS
Free ListingStars: 2.1KLocal coding agent for compact open models
ATLAS is a local coding agent from Inferstep, an open lab challenging assumptions on scale. It adds planning, verification, and repair around compact open models so software work can run on local hardware.
Dossier
Free ListingStars: 2KYour job search, on your own server.
Dossier is a self-hosted job search app that keeps your career history in one profile, writes tailored resumes and cover letters from profile facts, and tracks each application from draft to offer. Free software under AGPL-3.0.
TensorFold
Free ListingStars: 1.5KNative local LLM inference for Metal and CUDA.
TensorFold is an open-source LLM inference engine for Metal, CUDA, and Vulkan that runs open models locally on Apple Silicon and NVIDIA GPUs with native Metal and CUDA inference.
neuron-explorer
Free ListingStars: 1.3KSteering-first neuron explorer for Qwen3.5-4B
A steering-first explorer for Qwen3.5-4B that pushes every MLP neuron, keeps every rollout, and lays the results out over a 3D view of the model.
Survival LLM
Free ListingStars: 1.2KOffline AI assistant and emergency library with sources
Survival LLM is a free, open-source AI assistant and emergency library that runs on your own computer, answers from trusted offline sources, and shows the source for every answer.
Yogurt
Free ListingStars: 1.1KPrivate AI meeting notes, free and open source
Yogurt is a free, open source AI meeting notes app that records your microphone and computer audio without joining calls as a bot, then transcribes and summarizes locally so recordings, transcripts, and notes stay on your computer.
SoduWork
Free ListingStars: 0.8KThe AI-native engine for teams and their agents
SoduWork is an open-source, AI-native enterprise collaboration platform. It connects people, AI agents, models, and business systems in request-centered workflows with acceptance criteria, AI review, human sign-off, and reusable plugins.

