A Tale of Three Apache Spark APIs: RDDs, DataFrames, and Datasets - Jules Damji

Session hashtag: #EUdev12"

About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.

Connect with us:

[aliwaheed]

Amazing talk, I left off Spark to move in to ML when there was only RDD, I came back and see DataFrame in Spark and I am totally confused, your video helped a lot, Thank you

[tdkboxster]

What an amazing talk! Crisp and Clear! truly impressed.

[techoral]

Now i know about RDDs, DataFrames and Datasets. Thanks for explaining it more precisely. Appreciated.

[rahultiwari]

Thanks for in-depth explaining RDD DF And DS...

[ctriz]

this is a brilliant and fluid explanation

[puja]

Amazing presentation. Very intuitive..Thanks Boss!

[AllForLove]

Amazing talk! very well explained indeed.

[shemantkr]

it was very insightful, such talks really helps developer why/how one should use structure API

[TheTambourinist]

Thanks for the video. Very understandable!

[anibaldk]

Only 300 likes for such an informative, crystal clear talk??

[sayandbhattacharya]

I had a nice learning time thanks for the talk!

[nareshgb]

I am wondering how the "type safe" feature combines with the "unstructured data" that is the nature of data in the systems that spark would be used in.

[varundosapati]

I was trying out the example you mentioned @10:46 and as i am getting compile time error, I had to rewrite the final statement as below.


parsedRdd.filter( content => content._2 == "en").map(filteredContent => => printf(s"$reducedContent._1: $reducedContent._2"))


I would really appreciate if you can review above statement

[meravchkroun]

Thanks!
Can you attach the links here?

[Chris_zacas]

This was amazing! Pretty well explained!
Thanks!