Pool local Macs for MLX workloads.

Distributed MLX inference and training across heterogeneous Apple Silicon for workloads that should stay inside your building.

R&D. The transport substrate is published as Go modules: mlx-go-iroh ships peer discovery, gossip, and content-addressed blobs (v0.3.0, with opt-in global discovery). Quorum-gated DiLoCo sync and peer-to-peer weight sharing run over it as live, untagged datapaths. In a small measured run, two machines fine-tuned, exchanged, and combined LoRA adapters with a merge rule designed to tolerate bad contributions; both wrote byte-identical files across three rounds (the write-up). Coordinated training across the mesh is still being built.

What it does

Research. mlx-go-iroh is published and tagged; weight sharing and a quorum-gated DiLoCo sync loop run on top of it. The next validation gates are a complete multi-node training run, cross-device latency measurement, and heterogeneous-compute consistency.

mlx-go runs the local computation; mlx-mesh coordinates the machines and moves model state between them. The intended use is a model that does not fit on one Mac, or a training workload that must remain inside an operator's custody domain. cove can isolate individual workloads when they need a disposable Mac.