Spark Data Frames and Data Sets - Getting Started - Creating Data Sets from Data Frames

We can create Data Set from Data Frame using as function by applying case class. But you need to make sure the data types are in sync

* Create Data Frame from JSON
* Use as and convert Data Frame to Data Set.
* Make sure the data types between Data Frame and case class
are compatible.
* Also as part of map we can only use Data Types such as Int, Long
etc. Data Types such as BigInt are not serializable.

Connect with me or follow me at