Skip to content

Best Local Models AI tools

Runs open-weight models on your own hardware — no API key, no per-token bill, nothing leaving the box. The 15 highest-ranked of the 19 apps tagged Local Models in the Onei AI catalogue.

Everything tagged Local Models: apps, skills and MCP servers

  1. Unsloth AI

    Open-source desktop app to run, serve and fine-tune text, image, video and audio models entirely on your own machine.

    Also: Desktop App, Inference, Open Source · Editor's pick

  2. Osaurus, Inc.

    Native macOS harness for AI agents — any model, persistent memory, sandboxed execution and cryptographic identity, fully offline and open source.

    Also: Offline, Open Source · Editor's pick

  3. Open-source inference engine that runs LLMs, vision and speech models fully on-device — no API keys, no cloud calls, from Swift to Godot.

    Also: Inference, Local-First, Open Source · Editor's pick

  4. Cactus Compute, Inc.

    8-29 MB automation models that run on phones, wearables and microcontrollers — tool calling, structured extraction and embeddings, fully offline.

    Also: Inference, Offline, Open Source

  5. Brave

    Brave's built-in browser assistant that summarizes pages and PDFs, with Brave Search grounding and bring-your-own-model support.

    Also: Chatbot, Privacy

  6. Continue

    Open-source AI coding agent for VS Code, JetBrains and the terminal; acquired by Cursor in 2026 and no longer maintained.

    Also: CLI, Open Source

  7. JetBrains

    JetBrains AI Assistant adds project-aware chat, code completion and agents like Junie, Claude Agent and Codex to JetBrains IDEs.

  8. Open-source local inference server that profiles your hardware, picks models that fit, and points your coding agent at them — free, private and offline.

    Also: CLI, Inference, Open Source

  9. Advait Paliwal

    Open-source AI research agent with a CLI and a local science workbench for deep literature review, paper retrieval and replication planning.

    Also: CLI, Open Source

  10. Privacy-first voice to text for macOS, Windows, and iOS — runs offline on-device with customisable AI modes.

    Also: Offline, Privacy

  11. Mintplex Labs

    An all-in-one private AI workspace: chat with your documents, run agents, and keep everything on your device.

    Also: Local-First, Privacy

  12. An open-source desktop AI client that talks to every major provider and your local models from one window.

    Also: Chatbot, Desktop App, Open Source

  13. A self-hosted, feature-rich chat interface that puts a polished front end on Ollama and any OpenAI-compatible API.

    Also: Chatbot, Open Source

  14. Menlo Research

    An open-source, offline-first ChatGPT alternative that runs models on your own computer.

    Also: Desktop App, Local-First, Offline

  15. A polished desktop app for discovering, running, and chatting with local language models — no terminal required.

    Also: Chatbot, Desktop App, Offline

How this list is ranked

Ranked by editorial weight (0–100), plus 5 points per bookmark up to 10, plus or minus up to 20 for the average review rating; ties go to featured apps, then the most recently updated. Discontinued apps are never ranked.

More ranked lists