Up

Regularization

Batch Normalization

• Batch Normalization #1 - 라온피플 blog
• Batch Normalization #2 - 라온피플 blog
• Batch Normalization - SanghyukChun blog
• Batch Normalization 설명 및 구현 - Beomsu Kim blog
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift - 2015 paper

Dropout

• A Simple Way to Prevent Neural Networks from Overfitting - 2014 paper
• The dropout learning algorithm paper
• Dropout #1 - 라온피플 blog #1
• Dropout #2 - 라온피플 blog #2
• Dropout #2 - 라온피플 blog #3

DropConnect

• Regularization of Neural Networks using DropConnect paper
• DropConnect - 라온피플 blog

Stochastic Pooling

• Stochastic Pooling for Regularization of Deep Convolutional Neural Networks - 2013 paper
• Stochastic Pooling - 라온피플 blog #1

Maxout Networks

• Maxout Networks - 2013 paper
• From Maxout to Channel-Out: Encoding Information on Sparse Pathways paper
• Maxout Networks - 라온피플 blog #1