Deep learning

ML quick finds

Sigmoid function:
sigmoid(x) = 1/(1+e^-x)
A sigmoid function is a mathematical function having a characteristic "S"-shaped curve or sigmoid curve. 

Softmax: 
The softmax function is often used in the final layer of a neural network-based classifier. Such networks are commonly trained 
under a log loss (or cross-entropy) regime, giving a non-linear variant of multinomial logistic regression.

W -> Vector representing weight (that represented on the line btw input(x) and first activation layer(z))
b -> bias (each activation layer(z) has a bias term)

TBD:
-------
- Activation function (to be chosen)