Skip to main content
AdOpenFree logoPromote your productReach more potential users and drive product growth and revenue.Advertise

Tools tagged with "NVIDIA"

Favicon of ComfyUI

ComfyUI

Free ListingStars: 138.2K

Modular node-graph AI creation engine

Image Generation & Workflows

ComfyUI is a modular node-graph AI creation engine for generating images, video, 3D, audio, and text, with local and cloud options, an API, App Mode, and Comfy Agent for building and running workflows from natural-language descriptions.

Favicon of llama.cpp

llama.cpp

Free ListingStars: 129.5K

LLM inference in C/C++

Language Models

LLM inference in C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware, locally and in the cloud.

Favicon of DeepSeek-V3

DeepSeek-V3

Free ListingStars: 104.5K

Mixture-of-Experts language model with 671B parameters

Language Models

DeepSeek-V3 is a Mixture-of-Experts language model with 671B total parameters and 37B activated per token. It supports a 128K context and is available in Base and Chat variants with open weights for local deployment and API use.

Favicon of nanochat

nanochat

Free ListingStars: 60.1K

Minimal experimental harness for training LLMs

Language Models

nanochat is a minimal, hackable harness for training LLMs end to end on a single GPU node, covering tokenization, pretraining, finetuning, evaluation, and inference. It is pitched as the best ChatGPT that $100 can buy.

Favicon of FreeLLMAPI

FreeLLMAPI

Free ListingStars: 48K

One OpenAI-compatible API for free LLM provider tiers

Model Gateways & Routing

FreeLLMAPI routes free LLM provider tiers and custom OpenAI-compatible endpoints through one /v1 API, adding smart routing, automatic failover, encrypted keys, and a self-updating catalog.

Favicon of SGLang

SGLang

Free ListingStars: 37.2K

High-performance LLM and multimodal model serving

Multimodal Models

SGLang is a high-performance serving framework for large language and multimodal models, designed for fast, scalable inference across diverse models and hardware.

Favicon of Strata

Strata

Free ListingStars: 31.2K

Run Qwen3.8-Flash-Next on your own PC

Chat Interfaces

Strata runs the 125B-parameter Qwen3.8-Flash-Next on consumer PCs, with one-click Windows and Linux installs, a local inference engine, OpenAI- and Anthropic-compatible localhost APIs, and optional image input.

Favicon of NVIDIA NemoClaw

NVIDIA NemoClaw

Free ListingStars: 23K

Run AI agents safely in NVIDIA OpenShell sandboxes

Agent SDKs & Runtimes

Open source reference stack from NVIDIA for running supported and qualification-only AI agents more safely inside OpenShell sandboxes, with guided onboarding, managed inference, network policy, integrations, and lifecycle operations.

Favicon of SkillSpector

SkillSpector

Free ListingStars: 21.8K

Scan AI agent skills for security risks before installation

Security Testing & Red Teaming

SkillSpector is a security scanner for AI agent skills that helps determine whether a skill should be installed. It detects vulnerabilities, malicious patterns, prompt injection, data exfiltration, and supply-chain risks before use.

Favicon of Surya

Surya

Free ListingStars: 21.6K

OCR, layout analysis, reading order, and table recognition

Multimodal Models

Surya is a 689M-parameter OCR model from Datalab for document intelligence, covering OCR, layout analysis, reading order, and table recognition in 90+ languages.

Favicon of OpenShell

OpenShell

Free ListingStars: 17.7K

Safe, private runtime for autonomous AI agents.

Agent SDKs & Runtimes

NVIDIA OpenShell is an open-source runtime for running fleets of autonomous AI agents in sandboxed environments with kernel-level isolation and declarative YAML policies that limit filesystem, network, process, and credential access.

Favicon of FreeToken

FreeToken

Free ListingStars: 15.1K

Datacenter-scale MoE model serving on your desktop

Edge & On-Device Inference

FreeToken is an edge-native Mixture-of-Experts serving engine that runs frontier-scale open-weight models locally on consumer and personal hardware, with adaptive CPU–GPU co-execution and OpenAI/Anthropic-compatible APIs.

Favicon of FlashMLA

FlashMLA

Free ListingStars: 13.1K

Optimized attention kernels for DeepSeek inference

Pipelines, Deployment & Compute

FlashMLA is DeepSeek's library of optimized attention kernels for inference on NVIDIA GPUs and Huawei Ascend NPUs, including sparse and dense attention kernels with FP8 or FP4 KV cache support.

Favicon of LMCache

LMCache

Free ListingStars: 12.3K

KV cache management layer for scalable LLM inference

Context Management

LMCache is an open-source KV cache management layer for LLM inference that stores, compresses, searches, and reuses KV cache across GPU, CPU, local storage, and external backends to reduce repeated prefill and improve time-to-first-token.

Favicon of Edge0

Edge0

Free ListingStars: 11K

Device-native foundation models for on-device AI

Language Models

Edge0 provides device-native foundation models and an open-source streaming MoE inference framework, running large sparse models such as 145B on a laptop and 35B on a phone with SSD-streamed weights, offline on-device processing, and zero

Favicon of OpenWhispr

OpenWhispr

Free ListingStars: 9.6K

Privacy-first voice-to-text dictation and meeting notes

Personal & Desktop Assistants

Open source, privacy-first voice-to-text dictation app with local Whisper/NVIDIA Parakeet or cloud models via your own API keys, available cross-platform.

Favicon of DeepInfer

DeepInfer

Free ListingStars: 7.9K

High-performance inference framework for DeepSeek models

Inference Servers & APIs

DeepInfer is a high-performance, large-scale inference framework for DeepSeek models. This open-source release provides offline inference with optimized kernels, parallelism, scheduling, deterministic sampling, and structured outputs.

Favicon of llm-d

llm-d

Free ListingStars: 4.9K

Kubernetes-native distributed LLM inference

Model Gateways & Routing

llm-d is an open-source, Kubernetes-native stack for distributed LLM inference. It runs vLLM, SGLang, and more across a cluster, turning single-node engines into production-grade serving on existing hardware.

Favicon of CUDA Rust

CUDA Rust

Free ListingStars: 3.9K

NVIDIA's CUDA platform for Rust

Pipelines, Deployment & Compute

CUDA Rust is NVIDIA's CUDA platform for Rust, with host-side runtime crates and device-side tools for writing GPU kernels in idiomatic Rust using SIMT and Tile models.

Favicon of Auto Ontology

Auto Ontology

Free ListingStars: 3K

Semantic graph reasoning layer for trusted agent analytics

Data Analysis & Business Intelligence

Auto Ontology is a Python framework for building semantic, graph-based reasoning layers over data. It enables deterministic query generation, better context retrieval, and more explainable AI for LLM and agent workflows.

Favicon of TensorFold

TensorFold

Free ListingStars: 1.5K

Native local LLM inference for Metal and CUDA.

Edge & On-Device Inference

TensorFold is an open-source LLM inference engine for Metal, CUDA, and Vulkan that runs open models locally on Apple Silicon and NVIDIA GPUs with native Metal and CUDA inference.

Favicon of CorridorKey 2.0

CorridorKey 2.0

Free ListingStars: 1.1K

One-click chroma keying for green and blue screens

Video Editing & Animation

CorridorKey 2.0 is a one-click chroma keying tool for green and blue screens that runs locally in VFX and editing software, with plugins for Resolve, Nuke, After Effects, Premiere and Blender; one purchase gets every plugin, no

OpenFree logo

vork

Free ListingStars: 1K

Headless 3D and VFX engine built for agents

Agent SDKs & Runtimes

vork is a headless 3D and VFX engine for agents. Agents write scenes as code, render and inspect results, then revise. Written in Rust and Slang, it renders on GPUs through Vulkan and Metal.

Favicon of NVIDIA Kubernetes Engine

NVIDIA Kubernetes Engine

Free ListingStars: 0.6K

Managed Kubernetes for NVIDIA GPU infrastructure

Pipelines, Deployment & Compute

NVIDIA Kubernetes Engine (NVKE) is open-source software for AI factories to run managed Kubernetes on their NVIDIA GPU infrastructure. It provisions nodes, forms clusters, and handles node pools, upgrades, replacement, and certificates.

Ad
OpenFree logoPromote your product

Reach more potential users and drive product growth and revenue.

Advertise