Interview Question in Deep Leaning: Why NOT initialize all the weights in a NN to the same value?

This is a popular interview question that tests your understanding of back-propagation and SGD in deep learning.
#ArtificialIntelligence,#MachineLearning,#DeepLearning,#DataScience,#NLP,#AI,#ML

[singhalarchit]

weights w11 and w32 update will depend on xi1 and xi3 respectively, so the weights will be updated differently. (gradient of L wrt w11 depends on xi1). Am I right?

[nikhildmehta]

When can we expect a Data Engineering and cloud course from you? That would be a first in terms of quality, comprehensive content at an affordable price..

[shivamjalotra]

Can you start something In which you ask these "Why?" questions every week ? And let us answer them .