Tools tagged with "Local LLM"

Ollama lets you get up and running with open models such as Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, and Gemma. It offers a CLI, REST API, and libraries for Python and JavaScript to run and manage models locally.

LLM inference in C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware, locally and in the cloud.

DeepSeek-V3 is a Mixture-of-Experts language model with 671B total parameters and 37B activated per token. It supports a 128K context and is available in Base and Chat variants with open weights for local deployment and API use.

Unsloth is an open-source framework for running and training LLMs. It provides a local UI to run and train LLMs and diffusion models, supporting GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

OpenHuman is a free, open-source personal AI for Mac, Windows and Linux that keeps data local and orchestrates fleets of agents. Built in Rust, it is positioned as a fast, efficient open-source agent harness.

Qwen3 is the large language model series from Alibaba Cloud's Qwen team. It offers dense and Mixture-of-Experts models with thinking and non-thinking modes, multilingual, long-context, reasoning, coding, and agent capabilities.