EfficientNet

Definition

EfficientNet is a deep Convolutional Neural Network architecture. It suggests a method to scaling CNN to achieve better performance while maintaining efficiency.

Architecture

As the baseline model of EfficientNet, ResNet and MobileNet are considered.

Compound Scaling

EfficientNet introduces a compound scaling method that uniformly scales network width, depth, and resolution using a compound coefficient $\varphi$.

1. Perform a grid search about the depth $d={\alpha }^{\varphi }$, the width $w={\beta }^{\varphi }$, and the resolution $r={\gamma }^{\varphi }$ for a fixed $\varphi =1$.
2. Control the model size by changing $\varphi$, for the fixed $\alpha$, $\beta$, and $\gamma$.