US Patent 10185891 Systems and methods for compact convolutional neural networks

A compact convolutional neural network may include a preliminary layer group, one or more intermediate layer groups, a final layer group, and/or other layers/layer groups. The preliminary layer group may include an input layer, a first preliminary normalization layer, a preliminary padding layer, a preliminary convolution layer, a preliminary activation layer, a second preliminary normalization layer, and a preliminary downsampling layer. One or more intermediate layer groups may include an intermediate squeeze layer, a first intermediate normalization layer, an intermediate padding layer, a first intermediate expand layer, a second intermediate expand layer, an intermediate concatenation layer, a second intermediate normalization layer, an intermediate activation layer, and an intermediate combination layer. The final layer group may include a final dropout layer, a final convolution layer, a final activation layer, a first final normalization layer, a final downsampling layer, a final flatten layer, and a second final normalization layer.