I built Otis, an AI agent that unifies hosted and local inference without the local model setup pain

Hi Everyone,

I’ve been building my own agent for a few months called Otis. After using existing tools, I found that most were either lacking in functionality or had too much going on and decided to build my own.

Otis sets up llama.cpp for you and recommends the best model for your hardware. It also integrates with existing setups for those who have tweaked and found their perfect setup (strata, ninfer etc.) and works with hosted open-weight models.

Some of my favorite Otis features are viewable artifacts, side-by-side sessions, memories, and the ability to use Otis on my laptop while the inference runs on my more powerful machine.

Also interested to hear what's the best use cases you’ve found for local models are. Personally, I found using qwen 3.8 for learning new topics quite helpful.

Website: https://triangllabs.ai/otis

Github: https://github.com/TrianglLabs/otis

Excited for everyone to try it and welcome all feedback, including what main features are missing from Otis for you. If it's useful, a star helps others find it.