AI Compare Ninja AI Compare Ninja

Compare AI tools. Use prompts and skills.
Language
EN

AI Tools for Runtimes & servers Compared

4 AI tools for Runtimes & servers, part of the Local AI category, with prices, limits and sources.

View all tools in Local AI

More topics in Local AI

Apps & interfaces 5Open models 5

Sort

Sort

Foundry Local

Runtimes & servers

Free runtime from Microsoft that lets developers build AI models into their own apps that run directly on the device.

Free accessFree plan
Paid fromnot published
  • For Windows, macOS (Apple silicon) and Linux; per the vendor no Azure subscription and no per-token costs
  • Automatically picks the device's NPU, graphics card or CPU, per the vendor

Details Visit site (opens in a new tab)

llama.cpp

Runtimes & servers

Open-source software that runs language models on your own computer, as a small app for Mac and Windows or from the command line.

Free accessFree plan
Paid fromnot published
  • Free, open source and usable offline per the vendor; app for Mac and Windows 11, command line for Linux
  • Per the project, a CPU is enough; graphics cards are used via Metal, CUDA and Vulkan, among others

Details Visit site (opens in a new tab)

Ollama

Runtimes & servers

Open-source tool for running language models locally, complemented by a paid cloud service for developers and teams.

Free accessFree plan
Paid fromCloud Pro · 20 $Access to larger Pro cloud models and 3 concurrent requests
  • Open-source tool to run language models locally such as Llama, Gemma, Mistral, and Phi
  • REST API compatible with the OpenAI API for easy integration with existing apps

Details Visit site (opens in a new tab)

whisper.cpp

Runtimes & servers

Open-source software that turns speech into text locally, using OpenAI's Whisper speech-recognition models.

Free accessFree plan
Paid fromnot published
  • Open source under MIT; for macOS, Linux, Windows and other platforms
  • Usable on a CPU alone per the project; graphics cards from NVIDIA and AMD, among others, are supported

Details Visit site (opens in a new tab)

Alphabetical order. This is not a quality ranking.

Comparison criteria

We compare free access, paid entry, plan limits, features and the listed official sources. Unsourced figures stay marked as not published.

Methodology

Only confirmed entries appear in the catalog. Prices, plans and limits come from listed official vendor pages. Missing figures stay marked as not published. Search results are ordered by Task match by default; category and task lists are alphabetical. Both can be switched to Free access first; neither is a quality ranking. The vendor page always wins.

Is this a ranking?

No. Search results are ordered by Task match by default; category and task lists are alphabetical. Both can be switched to Free access first. We do not award stars or a test winner.

What does "free access" mean for the listed tools?

Free access can mean a permanently free plan, a time-limited trial, or a one-off starting credit with no card required. The exact type is stated on each tool's own page.

How many of the listed tools offer free access?

4 of 4 listed tools offer free access - a permanent plan, a trial, or a no-card credit.

How do I see tools with free access first?

Use the “Free access first” toggle above the list to see tools with free access first.