filmov
tv
Smartnodes x Tensorlink: Decentralized Compute for PyTorch
Показать описание
In this video, I introduce Tensorlink, a platform designed to simplify distributed neural network training in PyTorch. Tensorlink is part of the Smartnodes ecosystem, a peer-to-peer framework secured by smart contracts.
We benchmarked the training of a BERT model locally on an M1 MacBook Pro against Tensorlink's hybridized training, which offloaded computations to a 1070 Ti GPU. This resulted in a significant reduction in forward and backward propagation times, achieving over a 60% speedup.
Stay tuned for more demos and updates on our alpha launch!
00:00 Smartnodes Intro
03:12 Tensorlink Intro
06:07 Training Example
#pytorch #LLM #MachineLearning #Blockchain
We benchmarked the training of a BERT model locally on an M1 MacBook Pro against Tensorlink's hybridized training, which offloaded computations to a 1070 Ti GPU. This resulted in a significant reduction in forward and backward propagation times, achieving over a 60% speedup.
Stay tuned for more demos and updates on our alpha launch!
00:00 Smartnodes Intro
03:12 Tensorlink Intro
06:07 Training Example
#pytorch #LLM #MachineLearning #Blockchain