Welcome to your LocalAI

The powerful FOSS alternative to OpenAI, Claude, and more

Documentation Model Gallery Import Model

Operations in Progress

Installed Models

3 models ready to use

meta-llama_llama-4-scout-17b-16e-instruct icon

meta-llama_llama-4-scout-17b-16e-instruct

llama-cpp
Chat
Edit
qwen3-vl-30b-a3b-instruct icon

qwen3-vl-30b-a3b-instruct

llama-cpp
Chat
Edit
qwen3-vl-30b-a3b-thinking icon

qwen3-vl-30b-a3b-thinking

llama-cpp
Chat
Edit

Installed Backends

3 backends ready to use

cpu-llama-cpp

User Installed
Alias: llama-cpp
Installed: 2026-01-14T20:07:12+01:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /var/www/localai/backends/cpu-llama-cpp/run.sh

llama-cpp

User Installed
Alias: llama-cpp
Installed: 2026-01-14T20:07:12+01:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /var/www/localai/backends/cpu-llama-cpp/run.sh

localai@llama-cpp

User Installed Meta
Installed: 2026-01-14T20:07:12+01:00
Meta backend for: cpu-llama-cpp
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /var/www/localai/backends/cpu-llama-cpp/run.sh