Reach more potential users and drive product growth and revenue.
AdvertiseTools tagged with "On-device"
llama.cpp
Free ListingStars: 129.5KLLM inference in C/C++
LLM inference in C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware, locally and in the cloud.
Graphify
Free ListingStars: 129.5KThe knowledge graph your coding assistant queries
Graphify turns codebases, docs, SQL schemas, configs, and PDFs into a queryable knowledge graph that AI coding assistants query over MCP instead of grepping, with local deterministic AST parsing and no vector store.
RuView
Free ListingStars: 100.6KWiFi sensing for pose, vitals, and presence
RuView turns commodity WiFi signals into real-time spatial intelligence, contactless vital-sign monitoring, and presence detection using radio signals alone — no cameras, wearables, or cloud calls required.
whisper.cpp
Free ListingStars: 53.9KHigh-performance C/C++ inference for OpenAI Whisper
whisper.cpp is a dependency-light C/C++ port of OpenAI's Whisper automatic speech recognition model, optimized for high-performance inference across CPUs, Apple Silicon, GPUs, NPUs, and edge platforms.
VoxCPM
Free ListingStars: 39.9KCreative and expressive multilingual text-to-speech
VoxCPM is a tokenizer-free text-to-speech system for multilingual speech generation, creative voice design, controllable cloning, and 48kHz studio-quality audio.
Handy
Free ListingStars: 34.7KFree, open source, offline speech-to-text for your desktop
Handy is a free, open source, cross-platform desktop speech-to-text app that runs fully offline and pastes transcribed speech into any text field without sending audio to the cloud.
QMD
Free ListingStars: 30.1KOn-device hybrid search for docs, notes, and knowledge bases
QMD is a local-first mini CLI search engine for docs, knowledge bases, meeting notes, and other text. It combines BM25 full-text search, vector semantic search, and LLM re-ranking while running on-device via node-llama-cpp with GGUF models.
elizaOS
Free ListingStars: 19.8KOpen-source TypeScript framework for autonomous AI agents
elizaOS is an open-source agentic operating system and TypeScript framework for autonomous AI agents, with a monorepo spanning the runtime, Eliza app, CLI, cloud services, native bridges, and plugins.
WebLLM
Free ListingStars: 19.3KHigh-performance in-browser LLM inference engine
WebLLM is a high-performance in-browser LLM inference engine that runs models directly in browsers with WebGPU acceleration and no server support. It offers OpenAI API compatibility, streaming, JSON mode, and custom models.
FreeToken
Free ListingStars: 15.1KDatacenter-scale MoE model serving on your desktop
FreeToken is an edge-native Mixture-of-Experts serving engine that runs frontier-scale open-weight models locally on consumer and personal hardware, with adaptive CPU–GPU co-execution and OpenAI/Anthropic-compatible APIs.
Edge0
Free ListingStars: 11KDevice-native foundation models for on-device AI
Edge0 provides device-native foundation models and an open-source streaming MoE inference framework, running large sparse models such as 145B on a laptop and 35B on a phone with SSD-streamed weights, offline on-device processing, and zero

VidBee
Free ListingStars: 10.8KDownload videos and create searchable transcripts locally.
VidBee downloads video and audio from YouTube, TikTok, Instagram, X, and 1000+ sites, or local files. It creates searchable, timestamped transcripts on your computer, then summarizes, translates, or answers questions with your AI provider.
kimi-k3-in-c
Free ListingStars: 10K2.78T-parameter Kimi K3 inference in portable C99
Runs Kimi K3, a 2.78-trillion-parameter model, on a single CPU in 8.24 GB of RAM by streaming the model from disk instead of holding it in memory. Portable C99 with no BLAS, framework, or GPU.
OpenWhispr
Free ListingStars: 9.6KPrivacy-first voice-to-text dictation and meeting notes
Open source, privacy-first voice-to-text dictation app with local Whisper/NVIDIA Parakeet or cloud models via your own API keys, available cross-platform.
Mochi Diffusion
Free ListingStars: 8KRun Stable Diffusion and FLUX.2 Klein natively on Mac
Mochi Diffusion is a native macOS app for local, offline image generation using Apple's Core ML Stable Diffusion implementation and the Iris pipeline for FLUX.2 Klein models with Metal GPU acceleration.
GenOffice
Free ListingStars: 7.9KFree, open-source AI office suite for desktop
GenOffice is a free, open-source AI office suite for macOS, Windows and Linux. It opens and saves .docx, .xlsx and .pptx files, edits PDF, Markdown and HTML, and includes a built-in AI agent with Genspark credits or your own API key.
TurboFieldfare
Free ListingStars: 7.4KGemma 4 26B-A4B inference in about 2 GB of RAM
TurboFieldfare is a Swift and Metal runtime for running Gemma 4 26B-A4B on Apple Silicon Macs with about 2 GB of RAM by streaming routed experts from SSD while keeping shared weights and KV cache resident.
Hex
Free ListingStars: 2.7KSpeak. It appears.
Hex is local-first voice dictation for macOS, Windows, and Linux. Hold a shortcut, speak, and Hex transcribes on-device and pastes the text into the app you are using, with optional modes and CLI tools.
Cicada
Free ListingStars: 1.6KLive subtitles, interpreting and AI notes anywhere
Cicada is a free, open-source meeting and live-stream assistant for Mac, Windows, Linux and Android. It offers real-time subtitles, speech interpreting and AI notes, listening to computer audio and helping you speak across languages.
Mika
Free ListingStars: 1.3KYour private AI assistant on your phone
Mika is an on-device AI assistant for Android that carries out one-sentence requests by operating apps on a hidden background screen, browsing the web, and running local Linux sandbox scripts while you keep using your phone.
Survival LLM
Free ListingStars: 1.2KOffline AI assistant and emergency library with sources
Survival LLM is a free, open-source AI assistant and emergency library that runs on your own computer, answers from trusted offline sources, and shows the source for every answer.
Yogurt
Free ListingStars: 1.1KPrivate AI meeting notes, free and open source
Yogurt is a free, open source AI meeting notes app that records your microphone and computer audio without joining calls as a bot, then transcribes and summarizes locally so recordings, transcripts, and notes stay on your computer.
PaperPilot
Free ListingStars: 0.7KLocal Rust PDF toolkit for AI agents and people
PaperPilot is a local AI copilot for documents: a pure-Rust PDF and document toolkit with MCP, CLI, browser, desktop, and local REST surfaces. Files stay on your machine.

