author: kelseyball
score: 9 / 10

Core idea: Rectifier DNNs > Sigmoidal DNNs in Speech Recognition

Main Contributions

Motivation for Rectifier Functions

Drawbacks of sigmoidal activation functions:

Experiment setup

Results

Analyzing coding properties

TL;DR