Pooled
by Nehanth · io.github.nehanth.swarmllm
Not TrustedWeb appUnrated★ 548 stars
Peer-to-peer LLM inference in the browser: pool your devices to run big open…
Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.
Screenshots
before after host room before after menu host chat host lend host loading host online
About
https://github.com/user-attachments/assets/5142d877-e4d5-4f6b-9b5e-0ef48dcb73f6 Pooled runs one open model across the devices in a room. Your laptop, a friend's desktop and a phone each hold some of the model's layers, and together they run a model none of them could run alone. You can chat with it, or switch to Code mode and let it build and fix a small app right in the tab. There is nothing to install and no account, and no server does any of the thinking. Friends open one link. Each device (laptop, desktop, phone) holds some of the model's layers and runs them on its own GPU with our own WGSL kernels. For every token, a small hidden state (10 KB on the 27B, 4 KB on the MoE) passes from tab to tab over direct WebRTC connections, and the host turns the result into the next word. Pooled is the open-source project Nehanth/pooled (https://github.com/Nehanth/pooled) by Nehanth, released under MIT. Ion packages it unmodified from commit ed613d6d6e94, adding only a manifest, an icon and a storage compatibility script.
Source
Written by Nehanth, published to Oikou by Ben Grande.
- ★ 548 stars on GitHub
- Licence: MIT
- Upstream version v1.0.0
- Built from commit ed613d6d6e94
Age rating
Not rated. Nobody has said who this app is suitable for, so Personal Clouds and the Oikou app treat it as 18+.
What version 1.0.1 may do
Internet
It asks to reach these hosts, and no others:
- huggingface.co
- cdn.jsdelivr.net
- api.github.com
- cdnjs.cloudflare.com
- fonts.googleapis.com
- fonts.gstatic.com
- rtc.live.cloudflare.com
- weights.swarmllm.ai
Personal Cloud tools
- Keep a database of its own on your Personal Cloud ion.db
- Keep files in its own storage on your Personal Cloud ion.files
Notifications
It does not send push notifications.
Storage
Up to 1 GB on your Personal Cloud.
Add to Personal Cloud
Sign in to add this web app to a Personal Cloud of yours. It runs there, on your own computer, and you open it from there; nothing is installed on your phone.