Reach more potential users and drive product growth and revenue.
AdvertiseTools tagged with "NVIDIA"
ComfyUI
Free ListingStars: 138.2KModular node-graph AI creation engine
ComfyUI is a modular node-graph AI creation engine for generating images, video, 3D, audio, and text, with local and cloud options, an API, App Mode, and Comfy Agent for building and running workflows from natural-language descriptions.
llama.cpp
Free ListingStars: 129.5KLLM inference in C/C++
LLM inference in C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware, locally and in the cloud.
DeepSeek-V3
Free ListingStars: 104.5KMixture-of-Experts language model with 671B parameters
DeepSeek-V3 is a Mixture-of-Experts language model with 671B total parameters and 37B activated per token. It supports a 128K context and is available in Base and Chat variants with open weights for local deployment and API use.
nanochat
Free ListingStars: 60.1KMinimal experimental harness for training LLMs
nanochat is a minimal, hackable harness for training LLMs end to end on a single GPU node, covering tokenization, pretraining, finetuning, evaluation, and inference. It is pitched as the best ChatGPT that $100 can buy.
FreeLLMAPI
Free ListingStars: 48KOne OpenAI-compatible API for free LLM provider tiers
FreeLLMAPI routes free LLM provider tiers and custom OpenAI-compatible endpoints through one /v1 API, adding smart routing, automatic failover, encrypted keys, and a self-updating catalog.
SGLang
Free ListingStars: 37.2KHigh-performance LLM and multimodal model serving
SGLang is a high-performance serving framework for large language and multimodal models, designed for fast, scalable inference across diverse models and hardware.
Strata
Free ListingStars: 31.2KRun Qwen3.8-Flash-Next on your own PC
Strata runs the 125B-parameter Qwen3.8-Flash-Next on consumer PCs, with one-click Windows and Linux installs, a local inference engine, OpenAI- and Anthropic-compatible localhost APIs, and optional image input.
NVIDIA NemoClaw
Free ListingStars: 23KRun AI agents safely in NVIDIA OpenShell sandboxes
Open source reference stack from NVIDIA for running supported and qualification-only AI agents more safely inside OpenShell sandboxes, with guided onboarding, managed inference, network policy, integrations, and lifecycle operations.
SkillSpector
Free ListingStars: 21.8KScan AI agent skills for security risks before installation
SkillSpector is a security scanner for AI agent skills that helps determine whether a skill should be installed. It detects vulnerabilities, malicious patterns, prompt injection, data exfiltration, and supply-chain risks before use.
Surya
Free ListingStars: 21.6KOCR, layout analysis, reading order, and table recognition
Surya is a 689M-parameter OCR model from Datalab for document intelligence, covering OCR, layout analysis, reading order, and table recognition in 90+ languages.
OpenShell
Free ListingStars: 17.7KSafe, private runtime for autonomous AI agents.
NVIDIA OpenShell is an open-source runtime for running fleets of autonomous AI agents in sandboxed environments with kernel-level isolation and declarative YAML policies that limit filesystem, network, process, and credential access.
FreeToken
Free ListingStars: 15.1KDatacenter-scale MoE model serving on your desktop
FreeToken is an edge-native Mixture-of-Experts serving engine that runs frontier-scale open-weight models locally on consumer and personal hardware, with adaptive CPU–GPU co-execution and OpenAI/Anthropic-compatible APIs.
FlashMLA
Free ListingStars: 13.1KOptimized attention kernels for DeepSeek inference
FlashMLA is DeepSeek's library of optimized attention kernels for inference on NVIDIA GPUs and Huawei Ascend NPUs, including sparse and dense attention kernels with FP8 or FP4 KV cache support.
LMCache
Free ListingStars: 12.3KKV cache management layer for scalable LLM inference
LMCache is an open-source KV cache management layer for LLM inference that stores, compresses, searches, and reuses KV cache across GPU, CPU, local storage, and external backends to reduce repeated prefill and improve time-to-first-token.
Edge0
Free ListingStars: 11KDevice-native foundation models for on-device AI
Edge0 provides device-native foundation models and an open-source streaming MoE inference framework, running large sparse models such as 145B on a laptop and 35B on a phone with SSD-streamed weights, offline on-device processing, and zero
OpenWhispr
Free ListingStars: 9.6KPrivacy-first voice-to-text dictation and meeting notes
Open source, privacy-first voice-to-text dictation app with local Whisper/NVIDIA Parakeet or cloud models via your own API keys, available cross-platform.
DeepInfer
Free ListingStars: 7.9KHigh-performance inference framework for DeepSeek models
DeepInfer is a high-performance, large-scale inference framework for DeepSeek models. This open-source release provides offline inference with optimized kernels, parallelism, scheduling, deterministic sampling, and structured outputs.
llm-d
Free ListingStars: 4.9KKubernetes-native distributed LLM inference
llm-d is an open-source, Kubernetes-native stack for distributed LLM inference. It runs vLLM, SGLang, and more across a cluster, turning single-node engines into production-grade serving on existing hardware.
CUDA Rust
Free ListingStars: 3.9KNVIDIA's CUDA platform for Rust
CUDA Rust is NVIDIA's CUDA platform for Rust, with host-side runtime crates and device-side tools for writing GPU kernels in idiomatic Rust using SIMT and Tile models.
Auto Ontology
Free ListingStars: 3KSemantic graph reasoning layer for trusted agent analytics
Auto Ontology is a Python framework for building semantic, graph-based reasoning layers over data. It enables deterministic query generation, better context retrieval, and more explainable AI for LLM and agent workflows.
TensorFold
Free ListingStars: 1.5KNative local LLM inference for Metal and CUDA.
TensorFold is an open-source LLM inference engine for Metal, CUDA, and Vulkan that runs open models locally on Apple Silicon and NVIDIA GPUs with native Metal and CUDA inference.
CorridorKey 2.0
Free ListingStars: 1.1KOne-click chroma keying for green and blue screens
CorridorKey 2.0 is a one-click chroma keying tool for green and blue screens that runs locally in VFX and editing software, with plugins for Resolve, Nuke, After Effects, Premiere and Blender; one purchase gets every plugin, no
vork
Free ListingStars: 1KHeadless 3D and VFX engine built for agents
vork is a headless 3D and VFX engine for agents. Agents write scenes as code, render and inspect results, then revise. Written in Rust and Slang, it renders on GPUs through Vulkan and Metal.
NVIDIA Kubernetes Engine
Free ListingStars: 0.6KManaged Kubernetes for NVIDIA GPU infrastructure
NVIDIA Kubernetes Engine (NVKE) is open-source software for AI factories to run managed Kubernetes on their NVIDIA GPU infrastructure. It provisions nodes, forms clusters, and handles node pools, upgrades, replacement, and certificates.

