Bodhi App - Run LLMs Locally
Project profile: Bodhi App combines local models, cloud APIs, MCP tool integration, a built-in chat UI, and compatibility with OpenAI, HuggingFace, and llama.cpp. Installation on desktop or Docker is documented.
www.getbodhi.app
Bodhi App — Unified AI Gateway for Local Models and Cloud APIs
Run LLMs locally with Bodhi App- a drop-in OpenAI API replacement that saves costs while ensuring complete privacy. Perfect for non-technical users with its intuitive Chat UI. Features one-click mo...
Key Topics
Project Review
FAQ 3Intro
Bodhi App is described as a unified AI gateway that brings together local models, cloud APIs, and MCP tool integration. Documentation and site snippets indicate compatibility with the OpenAI API and components from the HuggingFace ecosystem and llama.cpp. The project ships a built-in chat interface and references enterprise access control and local model deployment options, positioning it as a bridge between on‑premise inference and cloud‑based services.
Key Features
- Unified gateway for local model inference and cloud API proxying (described in official materials).
- Built‑in full‑featured chat UI available at /ui/chat/ for conversation management and tool workflows.
- Integration points with MCP tools enabling tool calling and agent-style workflows in chat.
- Compatibility notes include the OpenAI API, the HuggingFace ecosystem, and components from llama.cpp.
- Installation options mentioned for desktop and Docker, including a guided setup wizard.
- Enterprise access control is referenced; privacy tags appear in source metadata.
The available evidence does not include pricing, detailed security or data retention practices, supported model sizes, performance benchmarks, or exhaustive lists of supported tools and integrations.
Who this is for
This profile is aimed at teams and technical users who need a single interface to combine local inference and cloud APIs, want a built‑in chat UI for conversational workflows, or plan to integrate external tools into agent-style chats. The documented desktop and Docker installation paths with a guided setup suggest it is suitable for users who can manage local deployments or containerized installations. Organizations requiring explicit pricing, security guarantees, or detailed performance specifications should note those items are not present in the provided evidence.
Frequently Asked Questions
What is Bodhi App?
Bodhi App is described as a unified AI gateway that combines local model inference, cloud API proxying, and MCP tool integration. The site notes compatibility with OpenAI API, the HuggingFace ecosystem, and components from llama.cpp, and it includes a built-in chat UI.
How can I install and run it?
Documentation references installation options for desktop and Docker and mentions a guided setup wizard to help with initial configuration.
Are pricing, security, and performance details available?
The provided evidence does not include pricing or commercial terms, nor does it provide detailed security practices, data retention policies, supported model sizes, or performance benchmarks.
Editorial Notice
This is an independent third-party profile of Bodhi App - Run LLMs Locally and is not officially affiliated with the project.
This review is based on publicly available website information and may contain errors or outdated details. Please verify critical details on the official website.
Outbound links may include a referral parameter for attribution.
Similar projects
Alternatives and adjacent projects worth comparing.
One script tag makes any website discoverable and usable by AI agents.
www.openhermit.com
