Automatic Differentiation & Functional Operators in R
I’ve been studying up on deep learning recently (I know, trendy), and I learned something along the way that I think is just incredible.1 First, a little background: deep learning models are artificial neural networks, represented as potentially thousands of nodes with millions of weighted connections between them. Input numbers are fed in to some nodes on one side, and out pops output numbers from some nodes on the other side, after winding through the nodes and weighted connections. The goal is to adjust the connection weights such that the outputs are what we want for any given input.