Reach more potential users and drive product growth and revenue.
AdvertiseTools tagged with "C++"
llama.cpp
Free ListingStars: 129.5KLLM inference in C/C++
LLM inference in C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware, locally and in the cloud.
PaddleOCR
Free ListingStars: 90.2KGlobal Leading OCR Toolkit & Document AI Engine
PaddleOCR is a powerful, lightweight OCR and document parsing toolkit that turns PDFs and images into structured, LLM-ready data. It supports 100+ languages, JSON and Markdown output, and helps build RAG and Agentic applications.
whisper.cpp
Free ListingStars: 53.9KHigh-performance C/C++ inference for OpenAI Whisper
whisper.cpp is a dependency-light C/C++ port of OpenAI's Whisper automatic speech recognition model, optimized for high-performance inference across CPUs, Apple Silicon, GPUs, NPUs, and edge platforms.
Colibri
Free ListingStars: 46.7KTiny engine, immense model.
Colibri is an open-source hierarchical inference engine that adapts LLM inference to your machine, coordinating CPU, GPU, RAM and storage while streaming mixture-of-experts weights from disk.
Strata
Free ListingStars: 31.2KRun Qwen3.8-Flash-Next on your own PC
Strata runs the 125B-parameter Qwen3.8-Flash-Next on consumer PCs, with one-click Windows and Linux installs, a local inference engine, OpenAI- and Anthropic-compatible localhost APIs, and optional image input.
RocketRide
Free ListingStars: 18.8KOpen-source AI pipeline engine for LLM workflows
RocketRide is an open-source AI pipeline engine with a C++ core and Python-extensible nodes. Build, debug, observe, and deploy LLM workflows and agent orchestration from the IDE using TypeScript and Python SDKs, with Docker deployment.
FlashMLA
Free ListingStars: 13.1KOptimized attention kernels for DeepSeek inference
FlashMLA is DeepSeek's library of optimized attention kernels for inference on NVIDIA GPUs and Huawei Ascend NPUs, including sparse and dense attention kernels with FP8 or FP4 KV cache support.
Rerun
Free ListingStars: 11.6KThe data layer for physical AI. From collection to training.
Rerun is the data layer for physical AI, with an open source SDK to log, query, visualize, and stream multimodal robotics data from collection to training.
Edge0
Free ListingStars: 11KDevice-native foundation models for on-device AI
Edge0 provides device-native foundation models and an open-source streaming MoE inference framework, running large sparse models such as 145B on a laptop and 35B on a phone with SSD-streamed weights, offline on-device processing, and zero

