Skip to main content
AdOpenFree logoPromote your productReach more potential users and drive product growth and revenue.Advertise

Tools tagged with "Local LLM"

Favicon of ollama

ollama

Free ListingStars: 181.7K

Start building with open models.

Local Model Runners

Ollama lets you get up and running with open models such as Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, and Gemma. It offers a CLI, REST API, and libraries for Python and JavaScript to run and manage models locally.

Favicon of llama.cpp

llama.cpp

Free ListingStars: 129.5K

LLM inference in C/C++

Language Models

LLM inference in C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware, locally and in the cloud.

Favicon of DeepSeek-V3

DeepSeek-V3

Free ListingStars: 104.5K

Mixture-of-Experts language model with 671B parameters

Language Models

DeepSeek-V3 is a Mixture-of-Experts language model with 671B total parameters and 37B activated per token. It supports a 128K context and is available in Base and Chat variants with open weights for local deployment and API use.

Favicon of Unsloth

Unsloth

Free ListingStars: 76.8K

Open-source framework to run and train LLMs locally

Training & Fine-Tuning

Unsloth is an open-source framework for running and training LLMs. It provides a local UI to run and train LLMs and diffusion models, supporting GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Favicon of Free Claude Code

Free Claude Code

Free ListingStars: 63.6K

Free tokens across 61 providers and 12 coding agents

Model Gateways & Routing

Free Claude Code is an open-source model gateway and coding-agent launcher that unifies 61 providers, 1.3B+ monthly free tokens, and 12 coding agents across terminal, IDE, desktop, browser, and phone, with automatic fallback.

Favicon of nanobot

nanobot

Free ListingStars: 49.6K

Your open-source agent, everywhere you work.

Agent Frameworks

nanobot is an ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, terminal, and chat apps, plus tools, memory, MCP, multi-agent workflows, and automations.

Favicon of Colibri

Colibri

Free ListingStars: 46.7K

Tiny engine, immense model.

Local Model Runners

Colibri is an open-source hierarchical inference engine that adapts LLM inference to your machine, coordinating CPU, GPU, RAM and storage while streaming mixture-of-experts weights from disk.

Favicon of Codewhale

Codewhale

Free ListingStars: 41.1K

Open-source coding agent that works with any model.

Coding Agents

Codewhale is an open-source coding agent and terminal client that reads projects, edits files, runs commands, checks its work, and connects to hosted or local models.

Favicon of OpenHuman

OpenHuman

Free ListingStars: 40.1K

Open-source personal AI that runs on your laptop

Agent Frameworks

OpenHuman is a free, open-source personal AI for Mac, Windows and Linux that keeps data local and orchestrates fleets of agents. Built in Rust, it is positioned as a fast, efficient open-source agent harness.

Favicon of llmfit

llmfit

Free ListingStars: 38.5K

Find LLMs that run on your hardware.

Evaluation & Benchmarks

llmfit detects CPU, RAM, GPU, VRAM, and accelerators, then ranks hundreds of open-source LLMs across quantizations by fit, speed, quality, and context so you can see what runs well on your machine.

Favicon of Heretic

Heretic

Free ListingStars: 38.2K

Training-free language model modification

Language Models

Heretic is a training-free language model modification tool. It uses mathematical techniques and configurable scorers to steer model behavior, including removing censorship, suppressing refusals, reducing slop or sycophancy, and more.

Favicon of Vane

Vane

Free ListingStars: 36.9K

Privacy-focused AI answering engine

Search & Answer Engines

Vane is a privacy-focused AI answering engine that runs entirely on your own hardware. It combines web knowledge with local LLMs (Ollama) and cloud providers (OpenAI, Claude, Groq), delivering cited answers while keeping searches private.

Favicon of Strata

Strata

Free ListingStars: 31.2K

Run Qwen3.8-Flash-Next on your own PC

Chat Interfaces

Strata runs the 125B-parameter Qwen3.8-Flash-Next on consumer PCs, with one-click Windows and Linux installs, a local inference engine, OpenAI- and Anthropic-compatible localhost APIs, and optional image input.

Favicon of Qwen3

Qwen3

Free ListingStars: 27.7K

Large language model series by the Qwen team, Alibaba Cloud

Language Models

Qwen3 is the large language model series from Alibaba Cloud's Qwen team. It offers dense and Mixture-of-Experts models with thinking and non-thinking modes, multilingual, long-context, reasoning, coding, and agent capabilities.

Favicon of DwarfStar

DwarfStar

Free ListingStars: 24K

Local inference engine for DeepSeek, GLM, and Qwen

Inference Servers & APIs

DwarfStar is a small native inference engine for running selected DeepSeek, GLM, and Qwen models on consumer hardware with Metal, CUDA, and ROCm support. It uses the project's own GGUF files and is not a general GGUF runner.

Favicon of FreeToken

FreeToken

Free ListingStars: 15.1K

Datacenter-scale MoE model serving on your desktop

Edge & On-Device Inference

FreeToken is an edge-native Mixture-of-Experts serving engine that runs frontier-scale open-weight models locally on consumer and personal hardware, with adaptive CPU–GPU co-execution and OpenAI/Anthropic-compatible APIs.

Favicon of Edge0

Edge0

Free ListingStars: 11K

Device-native foundation models for on-device AI

Language Models

Edge0 provides device-native foundation models and an open-source streaming MoE inference framework, running large sparse models such as 145B on a laptop and 35B on a phone with SSD-streamed weights, offline on-device processing, and zero

Favicon of kimi-k3-in-c

kimi-k3-in-c

Free ListingStars: 10K

2.78T-parameter Kimi K3 inference in portable C99

Language Models

Runs Kimi K3, a 2.78-trillion-parameter model, on a single CPU in 8.24 GB of RAM by streaming the model from disk instead of holding it in memory. Portable C99 with no BLAS, framework, or GPU.

Favicon of Kev

Kev

Free ListingStars: 9.6K

Small Jev-like decision models to train and run yourself.

Language Models

Kev is a family of small decision models built on Qwen3.5 and Qwen3.8, based on Jev's architecture. Use pretrained weights or train your own, with yes/no, multiple-choice, and rating questions in one request.

Favicon of TurboFieldfare

TurboFieldfare

Free ListingStars: 7.4K

Gemma 4 26B-A4B inference in about 2 GB of RAM

Chat Interfaces

TurboFieldfare is a Swift and Metal runtime for running Gemma 4 26B-A4B on Apple Silicon Macs with about 2 GB of RAM by streaming routed experts from SSD while keeping shared weights and KV cache resident.

Favicon of Ollama JavaScript Library

Ollama JavaScript Library

Free ListingStars: 4.4K

Official JavaScript client for Ollama

App UI & SDKs

Official JavaScript client for Ollama that wraps the Ollama REST API, enabling chat, streaming, embeddings, model management, tool use, and cloud model access in Node and browser apps.

Favicon of ATLAS

ATLAS

Free ListingStars: 2.1K

Local coding agent for compact open models

Code Assistants & Editors

ATLAS is a local coding agent from Inferstep, an open lab challenging assumptions on scale. It adds planning, verification, and repair around compact open models so software work can run on local hardware.

Favicon of Dossier

Dossier

Free ListingStars: 2K

Your job search, on your own server.

Writing & Knowledge Work

Dossier is a self-hosted job search app that keeps your career history in one profile, writes tailored resumes and cover letters from profile facts, and tracks each application from draft to offer. Free software under AGPL-3.0.

Favicon of TensorFold

TensorFold

Free ListingStars: 1.5K

Native local LLM inference for Metal and CUDA.

Edge & On-Device Inference

TensorFold is an open-source LLM inference engine for Metal, CUDA, and Vulkan that runs open models locally on Apple Silicon and NVIDIA GPUs with native Metal and CUDA inference.

Favicon of neuron-explorer

neuron-explorer

Free ListingStars: 1.3K

Steering-first neuron explorer for Qwen3.5-4B

Language Models

A steering-first explorer for Qwen3.5-4B that pushes every MLP neuron, keeps every rollout, and lays the results out over a 3D view of the model.

Favicon of Survival LLM

Survival LLM

Free ListingStars: 1.2K

Offline AI assistant and emergency library with sources

Personal & Desktop Assistants

Survival LLM is a free, open-source AI assistant and emergency library that runs on your own computer, answers from trusted offline sources, and shows the source for every answer.

Favicon of Yogurt

Yogurt

Free ListingStars: 1.1K

Private AI meeting notes, free and open source

Meeting Assistants & Notes

Yogurt is a free, open source AI meeting notes app that records your microphone and computer audio without joining calls as a bot, then transcribes and summarizes locally so recordings, transcripts, and notes stay on your computer.

Favicon of SoduWork

SoduWork

Free ListingStars: 0.8K

The AI-native engine for teams and their agents

Multi-Agent Systems

SoduWork is an open-source, AI-native enterprise collaboration platform. It connects people, AI agents, models, and business systems in request-centered workflows with acceptance criteria, AI review, human sign-off, and reusable plugins.

Ad
OpenFree logoPromote your product

Reach more potential users and drive product growth and revenue.

Advertise