A framework for machine learning that runs outside the data center. On phones, sensors, hospital networks, on-prem fleets, and peer-to-peer overlays.
Write your workload as a Module. The framework partitions it across nodes, binds your compute and transport, and ships the bytes.
topology
[ Module ] │ recorded once ▼ [ IR ] ← ONNX GraphProto │ compiler partitions per peer ▼ [ per-node programs ] │ ┌────────┬────┴────┬─────────┐ ▼ ▼ ▼ ▼ [ Node ]←→[ Node ]←→[ Node ]←→[ Node ] peer mesh, │ │ │ │ bytes through ▼ ▼ ▼ ▼ one envelope [adapter pool: libp2p / HTTP / in-process / ...]
runtime data flow: one Module, partitioned IR, per-node programs bound to adapters.
BUILDING IN PUBLIC. The library is on crates.io. The substrate design lives in the whitepaper. Source is on github. Research is on the research page.
If you work on federated learning, gossip protocols, peer-to-peer systems, or related fields, reach out: [email protected].
latest release
First public release: framework + sans-IO Engine + Wire + role traits + CpuBackend reference.
What is coming. Two tracks: extensions to the framework itself, and protocols built on its primitives.
framework extensions
- ONNX Runtime backend
- ONNX import and interop utilities
- CPU SIMD opt-in
- benchmark harness
- in-memory actor-based simulator
- wire-version negotiation
- pure
NodeandCompilerbindings - Python DSL surface
- JavaScript and TypeScript DSL surface
- libp2p adapter (
bb-libp2p) - HTTP adapter (
bb-http) - observability story
- snapshot and restore
- memory-budget tooling
no_stdbuild profile- deployment examples (Linux VM fleets, ROS 2, Android, Jetson, ESP32)
supported protocols
- Protean integration
- Kademlia overlay
- Raft
- gossip learning
- compression and low-communication aggregation strategies (e.g., product quantization
Codec, decoupled local SGD) - privacy primitives (e.g., DP-SGD
Strategy, secure aggregationCodec)
This list will keep growing as the framework core stabilizes and attention shifts to protocol implementations.
read more
- whitepaper: the substrate design in one document
- research: papers on the protocols and primitives behind the substrate
- blog: theory, implementation deep-dives, releases