Use cases / Local & open-weight models

Best AI tools for Local & open-weight models

Run models on your own hardware. 8 tools ranked by our published formula.

Our #1 pick

Ollama

94

Simple CLI/app to download and run open-weight LLMs locally. Best for: Easiest local LLMs.

The full ranking

#1
O
Ollamaopen-source

Simple CLI/app to download and run open-weight LLMs locally.

94
/100
#2
L
LM Studiofree

Desktop app to discover, download and chat with local models.

90
/100
#3
l
llama.cppopen-source

C/C++ LLM inference engine behind much of the local AI ecosystem.

83
/100
#4
H
Hugging Facefreemium

The hub for open models, datasets and Spaces.

75
/100
#5
v
vLLMopen-source

High-throughput LLM serving engine.

72
/100
#6
J
Janopen-source

Open-source offline ChatGPT alternative desktop app.

68
/100
#7
O
Open WebUIopen-source

Self-hosted web UI for Ollama and OpenAI-compatible APIs.

62
/100
#8
G
GPT4Allopen-source

Nomic's desktop app for running local LLMs with local docs.

59
/100

No sponsored placements in this list. Scores are v1 editorial baselines; see methodology.