Skip to content

20 oMLX alternatives

oMLX: Menu-bar LLM inference server for Apple Silicon, with continuous batching and tiered KV caching that keeps local models fast enough for real coding work. 20 apps do similar work, most sharing Local-First, Open Source and Privacy, ranked by how much they have in common with oMLX.

Back to oMLX

  1. Ariso

    Free MIT-licensed menu-bar meeting notetaker for Mac that can transcribe and summarise fully on-device, with no bot joining the call.

    Also: Local-First, macOS, Open Source, Privacy

  2. Open-source inference engine that runs LLMs, vision and speech models fully on-device — no API keys, no cloud calls, from Swift to Godot.

    Also: Inference, Local-First, Open Source

  3. Open-source local inference server that profiles your hardware, picks models that fit, and points your coding agent at them — free, private and offline.

    Also: Inference, Open Source, Privacy

  4. The Plow Collective PBC

    Mac app that exposes your browser, CLI, files and saved logins to Claude, Codex or any MCP agent — with an approval gate on every request.

    Also: Local-First, macOS, Privacy

  5. A Mac budgeting app whose AI chat runs entirely on your machine, so your ledger and your questions never leave your disk.

    Also: Local-First, macOS, Privacy

  6. coconutStudio

    A native macOS notes app that parks notes along your screen edge and keeps an AI agent inside them, encrypted on-device.

    Also: Local-First, macOS, Privacy

  7. ZENPRODUCTS Technologies Private Limited

    Local-first Mac dictation that types into any app, plus file and link transcription across 110 spoken languages on Apple Silicon.

    Also: Local-First, macOS, Privacy

  8. HKUDS

    Open-source, self-hosted personal AI agent you run yourself — browser UI, terminal or your chat apps, with memory, MCP tools and scheduled automations.

    Also: Local-First, Open Source, Self-Hosted

  9. Free, open-source Mac dictation: hold a shortcut, speak, and clean text lands in any app. Local speech models, no account.

    Also: macOS, Open Source, Privacy

  10. Menlo Research

    An open-source, offline-first ChatGPT alternative that runs models on your own computer.

    Also: Local-First, Open Source, Privacy

  11. A free, local, open-source AI app builder that runs on your own machine — a privacy-first alternative to v0, Lovable, and Bolt with no vendor lock-in and bring-your-own API keys.

    Also: Local-First, Open Source, Privacy

  12. Different AI

    Open-source desktop app and MCP for running AI agents on your own files, an open alternative to Claude Cowork.

    Also: Local-First, Open Source, Privacy

  13. Reflect App, LLC

    Open-source, MIT-licensed note-taking app with daily notes, backlinks and local Markdown files, plus optional AI using your own API key.

    Also: Local-First, Open Source, Privacy

  14. Meridiona

    An open-source work journal that records your day on-device and drafts the status update for you — nothing leaves the machine until you approve a worklog.

    Also: Local-First, Open Source, Privacy

  15. Production inference for open and custom models — fast, autoscaling, and deployable into your own cloud.

    Also: Inference, Self-Hosted

  16. Privacy-first AI gateway putting 600+ models from 90+ providers behind one OpenAI-compatible API, with no prompt or output logging.

    Also: Inference, Privacy

  17. The open-source AI hub: over a million models, hundreds of thousands of datasets, and hosted demo Spaces.

    Also: Inference, Open Source

  18. Unsloth AI

    Open-source desktop app to run, serve and fine-tune text, image, video and audio models entirely on your own machine.

    Also: Inference, Open Source

  19. Cactus Compute, Inc.

    8-29 MB automation models that run on phones, wearables and microcontrollers — tool calling, structured extraction and embeddings, fully offline.

    Also: Inference, Open Source

  20. Publish Studio

    A macOS script runner where you and your coding agent drive the same terminal processes — menu bar, CLI and a built-in MCP server over one local socket.

    Also: Local-First, macOS