RL Chapter 9 Part4 (Construction of features within the linear approximation, neural networks)

This lecture discusses various approaches to construct features to be used in linear approximations of the value function; Taylor and Fourier expansions, coarse coding (such as tile coding), radial basis functions, and others. Finally, artificial neural networks are mentioned as another approach for function approximation.