ion

All web apps in the Catalogue

VLMForge

by To3akaRin · io.github.to3akarin.vlmforge

Not TrustedWeb appUnrated★ 109 stars

Evaluate visual models on your own images, JSON Schema, and production…

Evaluate visual models on your own images, JSON Schema, and production constraints with LangGraph, Pareto analysis, and a no-key Replay demo.

Screenshots

  • Pareto decision panel
    Pareto decision panel
  • Failure gallery
    Failure gallery
  • LangGraph execution view
    LangGraph execution view
  • blind review
    blind review
  • experiment protocol
    experiment protocol
  • run decision
    run decision

About

VLMForge is a local-first decision workbench for teams building structured extraction with cloud vision models. It evaluates each provider route, structured-output strategy, parameter set, latency, and cost against the same frozen prompt, schema, preprocessing, and private image contract—not just an abstract model name. It then rejects candidates that violate hard constraints, exposes the quality/cost/P95 Pareto frontier, and explains why a candidate was recommended or eliminated. Schema and critical-rule failures can never be hidden by an LLM judge or an attractive aggregate score. Public benchmarks are useful for discovering models. They do not tell you whether a pinned provider route can extract your private catalog attributes, honor your cross-field rules, meet your P95 target, and stay within your per-item budget. VLMForge is the open-source project To3akaRin/VLMForge (https://github.com/To3akaRin/VLMForge) by To3akaRin, released under MIT. Ion packages it unmodified from commit 9e48d3e69ecf, adding only a manifest, an icon and a start script.

Source

Written by To3akaRin, published to Oikou by Ben Grande.

  • ★ 109 stars on GitHub
  • Licence: MIT
  • Upstream version v0.1.0
  • Built from commit 9e48d3e69ecf

View the repository on GitHub

Age rating

Not rated. Nobody has said who this app is suitable for, so Personal Clouds and the Oikou app treat it as 18+.

What version 0.1.0 may do

Internet

It asks to reach nothing on the internet.

Personal Cloud tools

  • Keep a database of its own on your Personal Cloud ion.db
  • Run a Redis server of its own on your Personal Cloud (for its task queue and cache) ion.redis
  • Keep its files in S3-compatible storage of its own on your Personal Cloud ion.s3

Notifications

It does not send push notifications.

Storage

Up to 2 GB on your Personal Cloud.

Keys it asks you for

You give each one on your Personal Cloud when you install it, or give it one of your Personal Cloud’s shared secrets of the same name. Oikou never sees them.

  • Asks you for: openrouter-api-key — Your OpenRouter API key, from openrouter.ai/keys. Optional: the no-key Replay demo works without it. (optional)

Add to Personal Cloud

Sign in to add this web app to a Personal Cloud of yours. It runs there, on your own computer, and you open it from there; nothing is installed on your phone.

Sign in to add

Versions

0.1.0 Latest Shown above

Published · a ready-built bundle

Imported from To3akaRin/VLMForge at 9e48d3e69ecf (v0.1.0).

Report this app