What AI says about Hivemind

Hivemind is a PyTorch library for decentralized deep learning across the Internet, enabling training of large models on hundreds of computers from different universities, companies, and volunteers. It features distributed training without a master node, fault-tolerant backpropagation, and decentralized parameter averaging.