Skip to main content
AdOpenFree logoPromote your productReach more potential users and drive product growth and revenue.Advertise

Tools tagged with "On-device"

Favicon of llama.cpp

llama.cpp

Free ListingStars: 129.5K

LLM inference in C/C++

Language Models

LLM inference in C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware, locally and in the cloud.

Favicon of Graphify

Graphify

Free ListingStars: 129.5K

The knowledge graph your coding assistant queries

MCP Servers & Tool Connectors

Graphify turns codebases, docs, SQL schemas, configs, and PDFs into a queryable knowledge graph that AI coding assistants query over MCP instead of grepping, with local deterministic AST parsing and no vector store.

Favicon of RuView

RuView

Free ListingStars: 100.6K

WiFi sensing for pose, vitals, and presence

Edge & On-Device Inference

RuView turns commodity WiFi signals into real-time spatial intelligence, contactless vital-sign monitoring, and presence detection using radio signals alone — no cameras, wearables, or cloud calls required.

Favicon of whisper.cpp

whisper.cpp

Free ListingStars: 53.9K

High-performance C/C++ inference for OpenAI Whisper

Transcription & Dictation

whisper.cpp is a dependency-light C/C++ port of OpenAI's Whisper automatic speech recognition model, optimized for high-performance inference across CPUs, Apple Silicon, GPUs, NPUs, and edge platforms.

Favicon of VoxCPM

VoxCPM

Free ListingStars: 39.9K

Creative and expressive multilingual text-to-speech

Speech & Voice Generation

VoxCPM is a tokenizer-free text-to-speech system for multilingual speech generation, creative voice design, controllable cloning, and 48kHz studio-quality audio.

Favicon of Handy

Handy

Free ListingStars: 34.7K

Free, open source, offline speech-to-text for your desktop

Transcription & Dictation

Handy is a free, open source, cross-platform desktop speech-to-text app that runs fully offline and pastes transcribed speech into any text field without sending audio to the cloud.

Favicon of QMD

QMD

Free ListingStars: 30.1K

On-device hybrid search for docs, notes, and knowledge bases

MCP Servers & Tool Connectors

QMD is a local-first mini CLI search engine for docs, knowledge bases, meeting notes, and other text. It combines BM25 full-text search, vector semantic search, and LLM re-ranking while running on-device via node-llama-cpp with GGUF models.

Favicon of elizaOS

elizaOS

Free ListingStars: 19.8K

Open-source TypeScript framework for autonomous AI agents

Agent Frameworks

elizaOS is an open-source agentic operating system and TypeScript framework for autonomous AI agents, with a monorepo spanning the runtime, Eliza app, CLI, cloud services, native bridges, and plugins.

Favicon of WebLLM

WebLLM

Free ListingStars: 19.3K

High-performance in-browser LLM inference engine

Edge & On-Device Inference

WebLLM is a high-performance in-browser LLM inference engine that runs models directly in browsers with WebGPU acceleration and no server support. It offers OpenAI API compatibility, streaming, JSON mode, and custom models.

Favicon of FreeToken

FreeToken

Free ListingStars: 15.1K

Datacenter-scale MoE model serving on your desktop

Edge & On-Device Inference

FreeToken is an edge-native Mixture-of-Experts serving engine that runs frontier-scale open-weight models locally on consumer and personal hardware, with adaptive CPU–GPU co-execution and OpenAI/Anthropic-compatible APIs.

Favicon of Edge0

Edge0

Free ListingStars: 11K

Device-native foundation models for on-device AI

Language Models

Edge0 provides device-native foundation models and an open-source streaming MoE inference framework, running large sparse models such as 145B on a laptop and 35B on a phone with SSD-streamed weights, offline on-device processing, and zero

Favicon of VidBee

VidBee

Free ListingStars: 10.8K

Download videos and create searchable transcripts locally.

Assistants & ProductivityTranscription & Dictation

VidBee downloads video and audio from YouTube, TikTok, Instagram, X, and 1000+ sites, or local files. It creates searchable, timestamped transcripts on your computer, then summarizes, translates, or answers questions with your AI provider.

Favicon of kimi-k3-in-c

kimi-k3-in-c

Free ListingStars: 10K

2.78T-parameter Kimi K3 inference in portable C99

Language Models

Runs Kimi K3, a 2.78-trillion-parameter model, on a single CPU in 8.24 GB of RAM by streaming the model from disk instead of holding it in memory. Portable C99 with no BLAS, framework, or GPU.

Favicon of OpenWhispr

OpenWhispr

Free ListingStars: 9.6K

Privacy-first voice-to-text dictation and meeting notes

Personal & Desktop Assistants

Open source, privacy-first voice-to-text dictation app with local Whisper/NVIDIA Parakeet or cloud models via your own API keys, available cross-platform.

Favicon of Mochi Diffusion

Mochi Diffusion

Free ListingStars: 8K

Run Stable Diffusion and FLUX.2 Klein natively on Mac

Image Generation & Workflows

Mochi Diffusion is a native macOS app for local, offline image generation using Apple's Core ML Stable Diffusion implementation and the Iris pipeline for FLUX.2 Klein models with Metal GPU acceleration.

Favicon of GenOffice

GenOffice

Free ListingStars: 7.9K

Free, open-source AI office suite for desktop

MCP Servers & Tool Connectors

GenOffice is a free, open-source AI office suite for macOS, Windows and Linux. It opens and saves .docx, .xlsx and .pptx files, edits PDF, Markdown and HTML, and includes a built-in AI agent with Genspark credits or your own API key.

Favicon of TurboFieldfare

TurboFieldfare

Free ListingStars: 7.4K

Gemma 4 26B-A4B inference in about 2 GB of RAM

Chat Interfaces

TurboFieldfare is a Swift and Metal runtime for running Gemma 4 26B-A4B on Apple Silicon Macs with about 2 GB of RAM by streaming routed experts from SSD while keeping shared weights and KV cache resident.

Favicon of Hex

Hex

Free ListingStars: 2.7K

Speak. It appears.

Transcription & Dictation

Hex is local-first voice dictation for macOS, Windows, and Linux. Hold a shortcut, speak, and Hex transcribes on-device and pastes the text into the app you are using, with optional modes and CLI tools.

Favicon of Cicada

Cicada

Free ListingStars: 1.6K

Live subtitles, interpreting and AI notes anywhere

Meeting Assistants & Notes

Cicada is a free, open-source meeting and live-stream assistant for Mac, Windows, Linux and Android. It offers real-time subtitles, speech interpreting and AI notes, listening to computer audio and helping you speak across languages.

Favicon of Mika

Mika

Free ListingStars: 1.3K

Your private AI assistant on your phone

Personal & Desktop Assistants

Mika is an on-device AI assistant for Android that carries out one-sentence requests by operating apps on a hidden background screen, browsing the web, and running local Linux sandbox scripts while you keep using your phone.

Favicon of Survival LLM

Survival LLM

Free ListingStars: 1.2K

Offline AI assistant and emergency library with sources

Personal & Desktop Assistants

Survival LLM is a free, open-source AI assistant and emergency library that runs on your own computer, answers from trusted offline sources, and shows the source for every answer.

Favicon of Yogurt

Yogurt

Free ListingStars: 1.1K

Private AI meeting notes, free and open source

Meeting Assistants & Notes

Yogurt is a free, open source AI meeting notes app that records your microphone and computer audio without joining calls as a bot, then transcribes and summarizes locally so recordings, transcripts, and notes stay on your computer.

Favicon of PaperPilot

PaperPilot

Free ListingStars: 0.7K

Local Rust PDF toolkit for AI agents and people

MCP Servers & Tool Connectors

PaperPilot is a local AI copilot for documents: a pure-Rust PDF and document toolkit with MCP, CLI, browser, desktop, and local REST surfaces. Files stay on your machine.

Ad
OpenFree logoPromote your product

Reach more potential users and drive product growth and revenue.

Advertise