Reach more potential users and drive product growth and revenue.
AdvertiseTools tagged with "LLM"
RocketRide
Free ListingStars: 18.8KOpen-source AI pipeline engine for LLM workflows
RocketRide is an open-source AI pipeline engine with a C++ core and Python-extensible nodes. Build, debug, observe, and deploy LLM workflows and agent orchestration from the IDE using TypeScript and Python SDKs, with Docker deployment.
LMCache
Free ListingStars: 12.3KKV cache management layer for scalable LLM inference
LMCache is an open-source KV cache management layer for LLM inference that stores, compresses, searches, and reuses KV cache across GPU, CPU, local storage, and external backends to reduce repeated prefill and improve time-to-first-token.
GhidraMCP
Free ListingStars: 11.7KMCP server for Ghidra reverse engineering
GhidraMCP is a Model Context Protocol server that exposes Ghidra tools to MCP clients, enabling LLMs to autonomously decompile and analyze binaries, rename methods and data, and list methods, classes, imports, and exports.
OpenUI
Free ListingStars: 11.4KOpen Standard for Generative UI
OpenUI is the open standard for generative UI that lets AI apps and agents respond with interactive UI, charts, tables, forms, and dashboards using OpenUI Lang, a compact streaming-first language.
Edge0
Free ListingStars: 11KDevice-native foundation models for on-device AI
Edge0 provides device-native foundation models and an open-source streaming MoE inference framework, running large sparse models such as 145B on a laptop and 35B on a phone with SSD-streamed weights, offline on-device processing, and zero
InkOS
Free ListingStars: 10.9KAI agent for novels, scripts, and interactive games
InkOS is an open-source story creation AI agent for long and short fiction, scripts, interactive games, IP content, and translation. Studio, TUI, and CLI share one workspace for settings, characters, memory, review, revision, covers, and
Kev
Free ListingStars: 9.6KSmall Jev-like decision models to train and run yourself.
Kev is a family of small decision models built on Qwen3.5 and Qwen3.8, based on Jev's architecture. Use pretrained weights or train your own, with yes/no, multiple-choice, and rating questions in one request.
DeepInfer
Free ListingStars: 7.9KHigh-performance inference framework for DeepSeek models
DeepInfer is a high-performance, large-scale inference framework for DeepSeek models. This open-source release provides offline inference with optimized kernels, parallelism, scheduling, deterministic sampling, and structured outputs.
agentgateway
Free ListingStars: 5.8KHigh-performance gateway for service, LLM, and MCP traffic.
Open source HTTP and gRPC gateway that unifies traditional service traffic with AI-native protocols, routing, securing, observing, and governing LLM providers, MCP tools, and agent-to-agent communication in one data plane.
Harbor
Free ListingStars: 5.6KEvaluate and optimize sandboxed agents and models.
Harbor is a framework from the creators of Terminal-Bench for evaluating and optimizing agents and language models in container environments. It supports arbitrary agents, custom benchmarks, parallel cloud experiments, and rollouts for RL
llm-d
Free ListingStars: 4.9KKubernetes-native distributed LLM inference
llm-d is an open-source, Kubernetes-native stack for distributed LLM inference. It runs vLLM, SGLang, and more across a cluster, turning single-node engines into production-grade serving on existing hardware.
AiSOC
Free ListingStars: 4.4KOpen-source, self-hostable AI security operations center
AiSOC is an open-source, self-hostable AI SOC platform. It fuses alerts, triages incidents with LLM agents, maps MITRE ATT&CK, logs decisions in a replayable ledger, and ships CI-gated eval harness and MCP server. MIT-licensed, no API keys.
Wenyi
Free ListingStars: 2.8KBring literature into your language with whole-book context.
Wenyi is a desktop app for translating books and long-form writing, combining whole-book understanding, consistent terminology, and evidence-based review to carry stories across languages.
billion-context
Free ListingStars: 1.7KContext-compression plugin for long coding sessions
billion-context is a context-compression plugin that lets agents work with small context windows, use about 5x fewer tokens, and sustain month-long single sessions handling billions of tokens.
TensorFold
Free ListingStars: 1.5KNative local LLM inference for Metal and CUDA.
TensorFold is an open-source LLM inference engine for Metal, CUDA, and Vulkan that runs open models locally on Apple Silicon and NVIDIA GPUs with native Metal and CUDA inference.
neuron-explorer
Free ListingStars: 1.3KSteering-first neuron explorer for Qwen3.5-4B
A steering-first explorer for Qwen3.5-4B that pushes every MLP neuron, keeps every rollout, and lays the results out over a 3D view of the model.
Sand3D
Free ListingStars: 1.2K3D modeling in Python, built for LLMs.
Sand3D is an open-source 3D-as-code library and dataset of 3D objects written in an LLM-friendly language. Each object is a Python program describing its parts, shapes, holes, positions, and materials.
ZeroLeaks
Free ListingStars: 0.7KContinuous red teaming for AI agents
ZeroLeaks offers security testing for AI agents and LLM prompts. Hosted continuous red teaming attacks agents through tools, memory, credentials, and connected agents; the source-available CLI and TypeScript library test standalone prompts.
Hy-Memory
Free ListingStars: 0.3KDual-system cognitive memory for self-evolving LLM agents.
Production-grade dual-system cognitive memory engine and Python SDK for self-evolving LLM agents, with dedicated Chat, Working, and Coding memory pipelines, plus MemHub for local-first cross-application recall.

