Last data update: 2014.03.03
Learn Gradient Descent in 13 lines
learn_gd13(X, y, alpha, hidden_dim)
X
input data
y
output data
alpha
alpha to be used
hidden_dim
dimension of the hidden layer
http://qua.st/handcoding-gradient-descent/ http://iamtrask.github.io/2015/07/27/python-network-part2/
learn_gd
# create new data alpha = 0.5 hidden_dim = 4 X = matrix(c(0,0,1,0,1,1,1,0,1,1,1,1), nrow=4, byrow=TRUE) y = matrix(c(0,1,1,0),nrow=4) # run 13 lines function learn_gd13(X, y, alpha, hidden_dim)