Llmfit

Find which LLMs your PC can run

AlexsJones
 
Open sourceCommand-line tool

Third-party software from public repositories. bestappfor.me does not host it, does not verify it and is not responsible for its use. Download only from the official source and check the license. Terms and disclaimer

Stars
37.9K
GitHub
Health
Solid
10 of 11 checks passed
License
MIT
Open source
Version
1.1.17
5 days ago
Category
AI apps
Command-line tool
Language
Rust

About

Check which open-source language models your computer can run comfortably. llmfit looks at your CPU, RAM, GPU and VRAM, then recommends models across popular quantizations and scores them for quality, speed, fit and context.

It estimates memory use and tokens per second for each model. You get an interactive terminal interface by default, a classic CLI mode, a web dashboard and a REST API. You can also benchmark a model on your machine and share the results with the project. It runs on macOS, Linux and Windows.

Highlights

  • Detects CPU, RAM, GPU and VRAM
  • Scores models on quality, speed, fit and context
  • Terminal UI, web dashboard and REST API

Who it's for

Good for anyone setting up local AI who wonders which models their hardware can handle.

This description was written by our editors with automated assistance, not by the developer, and has not been reviewed yet.

Why it is here

  • Code changed 1 days ago
  • New release 5 days ago

Official channels

Official channels only. We never host or repackage downloads.

Homebrew
macOS, Linux
1.1.17
brew install llmfit
winget
Windows
1.1.10
winget install --id AlexsJones.llmfit -e

Verified: installer URL on github.com/AlexsJones/llmfit

GitHub release
Linux, Windows, macOS
v1.1.17

You might also like

See all