A friendly introduction to distributed training (ML Tech Talks)

[@TensorFlow]

Learn more:
Mesh TensorFlow → goo.gle/3sFPrHw
Distributed Training with Keras tutorial → goo.gle/3FE6QEa
GCP Reduction Server Blog → goo.gle/3EEznYB
Multi Worker Mirrored Strategy tutorial → goo.gle/3JkQT7Y
Parameter Server Strategy tutorial → goo.gle/2Zz3UrW
Distributed training on GCP Demo → goo.gle/3pABNDE

[@lighttheoryllc4337]

Assalamualaikum
She is a Mushrik wearing Graven images on necklace and worshipping man made false idols.
She is Breaking the 1st Commandment in Deuteronomy Chapter 5 verses 7-9

[@giovannimurru]

Wow Ring All-Reduce is just... beautiful. 😍

[@user-wr4yl7tx3w]

this is really well explained. more on this series please. thanks

[@SiChRa]

Correction: At 14:37, there is no C4 in GPU-1. It should be C2.

[@kkmm4179]

awesome video， crystal clear with the content design and easy to understand

[@chaaboudd2272]

Well done. I hop to see more videos.

[@lukasvandewiel860]

Thank you very much for the insightful presentation.

[@extrememike]

Good an easy to understand explanations!

[@VanWarren]

At time code 15:23 in the Ring Reduce algorithm the subscripts for the c vector are incorrect.

[@giovannimurru]

there is a bomb hidden in the algorithm LOL

[@amanvishnoi2721]

Awsm and easy to understand.

[@hasithkashyapa7645]

Straightforward and awesome

[@Ajaytshaju]

What if i dont have gpus as you said in the video, i have 32 systems with i5 CPU..can i run this mirrored strategy on multiple CPUs?

[@user-wr4yl7tx3w]

Great content. Look forward to more.

[@TensorFlow]

Thank you! Want to watch more? Check out this playlist, ML Tech Talks → goo.gle/ml-tech-talks

[@ahmadnoroozi8101]

GPU must be same, what happens if i use different GPU???

[@tricialobo9233]

nicely done!

[@sudhanshuhate5633]

Nicely explained!

[@hannibalbra1216]

Hello is there any docs about federated learning with differentiel privacy, thank you

[@NoDoubt747]

wow, great job!

[@shivangitomar5557]

Amazing!!

[@advanceprogramming225]

Thank you

[@abdourahmanebalde9153]

Thank

[@TheHandbook2802]

thanks

[@liuauto]

That tf.distribute.experimental worries me.. not sure when the api will be deprecated.

[@bhuvandwarasila]

Thanks