Skip to main content
AdOpenFree logoPromote your productReach more potential users and drive product growth and revenue.Advertise

Edge & On-Device Inference

Inference runtimes and acceleration for devices and embedded hardware.

Favicon of RuView

RuView

Free ListingStars: 100.6K

WiFi sensing for pose, vitals, and presence

Edge & On-Device Inference

RuView turns commodity WiFi signals into real-time spatial intelligence, contactless vital-sign monitoring, and presence detection using radio signals alone — no cameras, wearables, or cloud calls required.

Favicon of WebLLM

WebLLM

Free ListingStars: 19.3K

High-performance in-browser LLM inference engine

Edge & On-Device Inference

WebLLM is a high-performance in-browser LLM inference engine that runs models directly in browsers with WebGPU acceleration and no server support. It offers OpenAI API compatibility, streaming, JSON mode, and custom models.

Favicon of FreeToken

FreeToken

Free ListingStars: 15.1K

Datacenter-scale MoE model serving on your desktop

Edge & On-Device Inference

FreeToken is an edge-native Mixture-of-Experts serving engine that runs frontier-scale open-weight models locally on consumer and personal hardware, with adaptive CPU–GPU co-execution and OpenAI/Anthropic-compatible APIs.

Favicon of TensorFold

TensorFold

Free ListingStars: 1.5K

Native local LLM inference for Metal and CUDA.

Edge & On-Device Inference

TensorFold is an open-source LLM inference engine for Metal, CUDA, and Vulkan that runs open models locally on Apple Silicon and NVIDIA GPUs with native Metal and CUDA inference.

Ad
OpenFree logoPromote your product

Reach more potential users and drive product growth and revenue.

Advertise