Rubra

Rubra is a free, open-source utility crafted to streamline the local creation of AI assistants powered by extensive language models (LLMs). Targeting developers, Rubra brings the ease and smart capabilities akin to those experienced when using OpenAI's ChatGPT. It enables the crafting of AI-driven applications privately and economically by enabling local development without the need for API call tokens. Rubra comes equipped with ready-to-use open-source LLMs, simplifying the creation of sophisticated AI agents capable of local interaction and data processing across various channels. It features an intuitive chat interface that allows developers to engage with their models and assistants seamlessly. Unlike traditional model inference engines, Rubra incorporates an Assistants API that is compatible with OpenAI, plus a performance-optimized LLM. Privacy is a core design principle, with all operations carried out on the user's own device to ensure chat records and data remain strictly local. Additionally, Rubra's capabilities extend beyond its native LLM; it is compatible with models from OpenAI and Anthropic as well. The platform fosters an active community where users are invited to contribute through discussions, issue reporting, and code submissions on its Github repository.