ion

All web apps in the Catalogue

SmarterRouter

by peva3 · io.github.peva3.smarterrouter

Not TrustedWeb appUnrated★ 153 stars

SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama…

SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.

Screenshots

  • Screenshot 1 of SmarterRouter

About

Intelligent, multi-backend AI router that sits between your application and various LLM providers. It profiles your models, aggregates benchmark data, and intelligently routes each query to the best available model for the task—all locally, all free. Key Benefits: - Zero manual model selection - AI automatically picks the right model for each prompt - All local, zero cost - No cloud API fees, works with your existing models - Production-ready - Monitoring, metrics, and error handling built-in - Drop-in replacement - Works with any OpenAI-compatible client Get up and running with Docker in three commands: That's it! SmarterRouter will: - ✅ Discover all your Ollama models automatically - ✅ Profile each model for performance on your hardware (first run takes 30-60 min) - ✅ Start routing queries to the best model - ✅ New in v2.1.9: Optimized performance with async GPU I/O, batched queries, and prompt caching SmarterRouter is the open-source project peva3/SmarterRouter (https://github.com/peva3/SmarterRouter) by peva3, released under MIT. Ion packages it unmodified from commit 3e705e324494, adding only a manifest, an icon and a start script.

Source

Written by peva3, published to Oikou by Ben Grande.

  • ★ 153 stars on GitHub
  • Licence: MIT
  • Upstream version 2.2.5
  • Built from commit 3e705e324494

View the repository on GitHub

Age rating

Not rated. Nobody has said who this app is suitable for, so Personal Clouds and the Oikou app treat it as 18+.

What version 2.2.5 may do

Internet

It asks to reach nothing on the internet.

Personal Cloud tools

  • Run a Redis server of its own on your Personal Cloud (for its task queue and cache) ion.redis

Notifications

It does not send push notifications.

Storage

Up to 1 GB on your Personal Cloud.

Add to Personal Cloud

Sign in to add this web app to a Personal Cloud of yours. It runs there, on your own computer, and you open it from there; nothing is installed on your phone.

Sign in to add

Versions

2.2.5 Latest Shown above

Published · a ready-built bundle

Imported from peva3/SmarterRouter at 3e705e324494 (2.2.5).

Report this app