Deep Learning normalization methods
Introduction to and comparison of Batch Norm, Weight Norm, Layer Norm, Instance Norm, and Group Norm. Continue reading Deep Learning normalization methods
Tag: normalization
Paired Two-sample T-test (Dependent T-test)
What is a Paired 2-sample T-test? Let’s analyze this definition from scratch. Continue reading Paired Two-sample T-test (Dependent T-test)
Batch Normalization and why it works
Batch Normalization (BatchNorm) is a very frequently used technique in Deep Learning, however, the reason why it works is often interpreted ambiguously. Continue reading Batch Normalization and why it works
When to do feature centering, scaling and normalization?
Many people have a tendency to always do feature centering, scaling or normalizing right before applying predictive models to the data… Continue reading When to do feature centering, scaling and normalization?