Skip to content

LocalAI

medium

OpenAI-compatible local inference server for LLMs, images, audio, and multimodal models.

4 GB RAM Docker Active MIT
Source Docs Website

Replaces

ChatGPT

Pros

  • OpenAI-compatible API for many local model types
  • Can run without a GPU for smaller models
  • Covers text, image, voice, and multimodal use cases

Cons

  • Model setup is more technical than Ollama
  • Performance varies heavily by backend and hardware
  • Not a polished end-user chat app by itself

Tags

aiinferenceopenai-compatiblelocal-modelsapi

Pairs well with

Open WebUI

Self-hosted AI workspace for local models, OpenAI-compatible APIs, RAG, tools, and multi-user chat.

easy
1GB Active

Need a server? Hosting recommendations

Related

Similar Apps

AnythingLLM

Self-hosted AI workspace for document chat, agents, connectors, and local-first knowledge bases.

easy
2GB Active

Dify

Self-hosted platform for building AI agents, RAG apps, workflows, and LLM-powered products.

medium
4GB Active

Flowise

Visual builder for AI agents, chains, and LLM workflows.

medium
2GB Active