Weight Initialization - The First Principle

Journey from basics to advanced.

Weight Initialization is the most underrated concept in the deep learning terminology. I have seen many newbie deep learning practitioners and even some experienced ones ignoring this important concept. Unlike some already available tutorials or blogs, we will not talk about why you should not initialize your weights with all... [Read More]
Tags: weight, initialization, deep learning, xavier, kaiming, eigenvalue, eigenvector