PROJECTS / RELAY
VIRTUAL GPU ACCELERATOR · ALPHA
Relay.
Relay pools VRAM across teammates' machines into one OpenAI-compatible endpoint. The host owns the models; nodes lend VRAM as replicas or pipeline-shard stages. No silent CPU fallback. A model that fits one pooled GPU answers in well under a second and holds chat speed; splitting a model across machines works for what won't fit anywhere alone, at a real cost in speed.
$ relay status
HOSTINGself-hosted
LICENSEApache-2.0
ENDPOINT/v1 · OpenAI shape
STATUSALPHA · UNACCREDITED
TELEMETRYnone