SelfHostLLM - GPU Memory Calculator

A web-based calculator for estimating GPU memory requirements and maximum concurrent requests for self-hosted LLM inference. This tool helps you calculate how many concurrent requests your GPU setup can handle when running large language models (LLMs) locally. It takes into account: - GPU VRAM capacity - Model size and parameters - Context window length - Quantization methods - KV cache overhead SelfHostLLM - GPU Memory Calculator is the open-source project erans/selfhostllm (https://github.com/erans/selfhostllm) by erans, released under MIT. Ion packages it unmodified from commit f9ef51a61231, adding only a manifest, an icon and a storage compatibility script.

Written by erans, published to Oikou by Ben Grande.

• ★ 52 stars on GitHub
• Licence: MIT
• Built from commit f9ef51a61231

View the repository on GitHub

Not rated. Nobody has said who this app is suitable for, so Personal Clouds and the Oikou app treat it as 18+.

Internet

It asks to reach these hosts, and no others:

• fonts.googleapis.com
• fonts.gstatic.com

Personal Cloud tools

None. It uses nothing from your Personal Cloud beyond its own storage.

Notifications

It does not send push notifications.

Storage

Up to 16 MB on your Personal Cloud.

Sign in to add this web app to a Personal Cloud of yours. It runs there, on your own computer, and you open it from there; nothing is installed on your phone.

Sign in to add