PROJECTS / RELAY

VIRTUAL GPU ACCELERATOR · ALPHA

Relay.

Relay pools VRAM across teammates' machines into one OpenAI-compatible endpoint. The host owns the models; nodes lend VRAM as replicas or pipeline-shard stages. No silent CPU fallback. A model that fits one pooled GPU answers in well under a second and holds chat speed; splitting a model across machines works for what won't fit anywhere alone, at a real cost in speed.

$ relay status
HOSTINGself-hosted
LICENSEApache-2.0
ENDPOINT/v1 · OpenAI shape
STATUSALPHA · UNACCREDITED
TELEMETRYnone

Install.

The source and releases open soon. Until then there is nothing to install.

FULL QUICKSTART