Intro to Recurrent Neural Networks (RNNs)

  • Before RNNs: Perceptron and ConvNets
  • RNNs, and Why?
  • Some Math
    • Forward pass
    • Backpropagation refresher
    • The RNN backward pass
  • Some pros and cons
  • On the difficulty of training RNNs
  • Applications