infobro
Writing & Content44Image35Video30Audio & Voice30Chat & Assistants43Productivity64Coding & Development66Agents & Automation90Marketing & SEO24Sales & Support47Business & Finance92Operations21Data & Research47Education20Design18Health & Life38

Local & Open Models AI toolsFull list

Run models on your own hardware.
11 tools9 with a free plan8 with an API6 open source
Best ofShort on time? Our shortlist with picks and trade-offsTop 8 Local & Open-Source AI Tools in 2026: Ranked by Privacy, Power, and Practicality
11 tools
D
D

AI chat assistant and low-cost LLM API for consumers and developers

Paid
D
Paid
D

AI chat assistant and low-cost LLM API for consumers and developers

AI ChatbotsAPI
M
M

Open-weight AI models, chat and coding agent you can run on your own infrastructure

Free, from $14.99/mo
M
Free, from $14.99/mo
M

Open-weight AI models, chat and coding agent you can run on your own infrastructure

Local & Open ModelsFree planAPIOpen source
S
S

Open image generation models you can self-host or call through an API

Freemium
S
Freemium
S

Open image generation models you can self-host or call through an API

Image GeneratorsFree planAPI
O
O

Run open AI models locally or in the cloud on macOS, Windows and Linux

Free, from $16.67/mo
O
Free, from $16.67/mo
O

Run open AI models locally or in the cloud on macOS, Windows and Linux

Local & Open ModelsFree planAPIOpen source
L
L

Desktop agent for documents, code and automation using local or open models

Free, from $20/mo
L
Free, from $20/mo
L

Desktop agent for documents, code and automation using local or open models

Local & Open ModelsFree planAPI
R
R

Run, fine-tune and deploy open-source ML models through a cloud API

Paid
R
Paid
R

Run, fine-tune and deploy open-source ML models through a cloud API

Developer Tools & APIsAPI
G
G

Desktop app for running open-source language models locally and privately

Free, from $20/mo
G
Free, from $20/mo
G

Desktop app for running open-source language models locally and privately

Local & Open ModelsFree plan
T
T

Open-source, self-hosted AI coding assistant for developers and teams

Free, from $19/mo
T
Free, from $19/mo
T

Open-source, self-hosted AI coding assistant for developers and teams

Code AssistantsFree planOpen source
V
V

Open-source offline speech recognition toolkit for developers in 20+ languages

Free
V
Free
V

Open-source offline speech recognition toolkit for developers in 20+ languages

TranscriptionFree planAPIOpen source
M
M

Open-source meeting recorder that transcribes and summarizes on your device

Free, from $10/mo
M
Free, from $10/mo
M

Open-source meeting recorder that transcribes and summarizes on your device

Meeting NotesFree planOpen source
O
O

Open-source voice dictation and bot-free meeting notes with on-device models

Free, from $6.67/mo
O
Free, from $6.67/mo
O

Open-source voice dictation and bot-free meeting notes with on-device models

TranscriptionFree planAPIOpen source

Local & Open Models tools compared

From each vendor's own pages, re-checked every two months. Of 11 tools we checked, 4 of 6 that state a policy don't train AI on your content, and 2 hold SOC 2 or ISO 27001.

ToolWorks fully offlineOptional cloud modelsTeam admin / SSO
OOllama
LLM Studio
GGPT4All—

— means the vendor's site doesn't say.

How to choose local & open models tools

Start with the job. Ollama, LM Studio and GPT4All are general tools for running language models. Others are narrower: whisper.cpp, Vosk and WhisperX handle speech-to-text, Meetily records and summarizes meetings, Tabby assists with code, and Stable Diffusion generates images.

Check where the model runs. If your data must stay on your own hardware, look for on-device or self-hosted options such as GPT4All, Meetily or Tabby. Ollama offers both local and cloud use. DeepSeek and Replicate are listed with web and API access but no self-hosted option, so they suit a different need.

Compare pricing. WhisperX, whisper.cpp and Vosk are free. Most other tools are freemium, with paid plans listed from $6.67/mo (OpenWhispr) to $20/mo (LM Studio, GPT4All).

Decide if you need open source or an API. Ollama and whisper.cpp offer both. LM Studio has an API but isn't listed as open source, while WhisperX and Meetily are open source with no API listed.

We haven't tested these tools, so confirm the details that matter to you.

Frequently asked questions

Are there free tools for running AI models locally?

Yes. WhisperX, whisper.cpp and Vosk are listed as free, and all three are open-source speech recognition tools. For language models, Ollama, LM Studio and GPT4All are freemium, so each has a free tier alongside paid plans.

How much do local and open model tools cost?

Listed paid plans start at $6.67/mo for OpenWhispr, $10/mo for Meetily, $14.99/mo for Mistral, $16.67/mo for Ollama, $19/mo for Tabby, and $20/mo for LM Studio and GPT4All. Stable Diffusion is freemium, while DeepSeek and Replicate are paid, and none of these three has a starting price in our list.

What should I look for when choosing a tool?

Check that it does the job you need, such as chat, transcription, coding or image generation, and that it supports your platform. Then confirm whether it runs on your own hardware, and whether you need open-source code or an API. For example, Tabby is self-hosted with VS Code and JetBrains support, while Vosk is an offline toolkit aimed at developers.

What are the alternatives to running models on my own hardware?

Replicate runs, fine-tunes and deploys open-source models through a cloud API. DeepSeek offers a chat assistant and a low-cost LLM API. Ollama also offers cloud use, and Stable Diffusion models can be called through an API instead of self-hosted.