Skip to main content
AdOpenFree logoPromote your productReach more potential users and drive product growth and revenue.Advertise

Tools tagged with "C++"

Favicon of llama.cpp

llama.cpp

Free ListingStars: 129.5K

LLM inference in C/C++

Language Models

LLM inference in C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware, locally and in the cloud.

Favicon of PaddleOCR

PaddleOCR

Free ListingStars: 90.2K

Global Leading OCR Toolkit & Document AI Engine

Document Parsing & OCR

PaddleOCR is a powerful, lightweight OCR and document parsing toolkit that turns PDFs and images into structured, LLM-ready data. It supports 100+ languages, JSON and Markdown output, and helps build RAG and Agentic applications.

Favicon of whisper.cpp

whisper.cpp

Free ListingStars: 53.9K

High-performance C/C++ inference for OpenAI Whisper

Transcription & Dictation

whisper.cpp is a dependency-light C/C++ port of OpenAI's Whisper automatic speech recognition model, optimized for high-performance inference across CPUs, Apple Silicon, GPUs, NPUs, and edge platforms.

Favicon of Colibri

Colibri

Free ListingStars: 46.7K

Tiny engine, immense model.

Local Model Runners

Colibri is an open-source hierarchical inference engine that adapts LLM inference to your machine, coordinating CPU, GPU, RAM and storage while streaming mixture-of-experts weights from disk.

Favicon of Strata

Strata

Free ListingStars: 31.2K

Run Qwen3.8-Flash-Next on your own PC

Chat Interfaces

Strata runs the 125B-parameter Qwen3.8-Flash-Next on consumer PCs, with one-click Windows and Linux installs, a local inference engine, OpenAI- and Anthropic-compatible localhost APIs, and optional image input.

Favicon of RocketRide

RocketRide

Free ListingStars: 18.8K

Open-source AI pipeline engine for LLM workflows

Agent Frameworks

RocketRide is an open-source AI pipeline engine with a C++ core and Python-extensible nodes. Build, debug, observe, and deploy LLM workflows and agent orchestration from the IDE using TypeScript and Python SDKs, with Docker deployment.

Favicon of FlashMLA

FlashMLA

Free ListingStars: 13.1K

Optimized attention kernels for DeepSeek inference

Pipelines, Deployment & Compute

FlashMLA is DeepSeek's library of optimized attention kernels for inference on NVIDIA GPUs and Huawei Ascend NPUs, including sparse and dense attention kernels with FP8 or FP4 KV cache support.

Favicon of Rerun

Rerun

Free ListingStars: 11.6K

The data layer for physical AI. From collection to training.

Data Analysis & Business Intelligence

Rerun is the data layer for physical AI, with an open source SDK to log, query, visualize, and stream multimodal robotics data from collection to training.

Favicon of Edge0

Edge0

Free ListingStars: 11K

Device-native foundation models for on-device AI

Language Models

Edge0 provides device-native foundation models and an open-source streaming MoE inference framework, running large sparse models such as 145B on a laptop and 35B on a phone with SSD-streamed weights, offline on-device processing, and zero

Ad
OpenFree logoPromote your product

Reach more potential users and drive product growth and revenue.

Advertise