The hyperbolic tangent is an alternative function in the exponential family, which has some similar properties to the logistic ... logistic hidden unit non-linearity and the dropout trick (Hinton et ...