Intro to Apache Spark for Java and Scala Developers - Ted Malaska (Cloudera)

In this video from OSCON 2016, Ted Malaska provides an introduction to Apache Spark for Java and Scala developers.

[chinapaulo]

This is the best introduction to Spark that I've seen so far.

[richardjames]

This video recorded before Java 8 became widely used; in Java 8 there is much less difference between the Java and Scala version. Granted the Java is still more verbose (due to the need for typing and the lack of native tuple support) but it's not far off. Here's my rough translation:

List wordCounts = sc.textFile("path")
.flatMap(it -> Arrays.asList(it.split(" ")).iterator())
.mapToPair(word -> new Tuple2<String, Integer>(word, 1))
.reduceByKey((a, b) -> a + b)
.take(100);

[vikramfugro]

crisp & clear with actual examples! no unnecessary theory. Thanks!

[FxAndrej]

A true talent for explaining things! If you ever feel like teaching - please do!

[Jonasmelonas]

Mate, you are NOT BORING, stop saying it :D Awesome introduction, wish there was more.

[kadamparikh]

Covers much more information and in the simplest manner possible than by graduate level text books.. Thanks for this :)

[shahbazhussain]

Best introduction I got so far. I like spark now i think.

[MrJzloganjr]

Great talk on Spark. Ted gives an excellent overview of Spark composites.

[linkernick]

Clear explanation, thanks. I think indeed the Scala looks more clear and readable for Spark jobs, than Java.

[elysel]

This guy is amazing at explaining difficult concepts

[smritidey]

Very clearly explained all the concepts, looking more such lectures

[kumara]

Being austin somehow missed it. will keep an eye out for next thing like this. awesome video.

[VasileSurdu]

that's a very good presentation... why the hell would those organizers 'cut' his speech ?? couldn't they just let him send his speech ? he was ending it anyways...what were they loosing?

[basant-gurung]

Best explanation on Spark I have seen so far. Where can I find the remaining part?

[Karmihir]

Watching it after 3years of post video but still very informative😊👍

[leixia]

This looks like the class1 of a series of lectures. Does anyone know can we watch the rest of them?

[MrSuriyam]

thank you very much. an excellent presentation. appreciate your time. sincerely

[ashiralam]

ReduceByKey and foreach are also actions

[shivabasayyahiremath]

Good insights about spark basics, Thank you

[greyfox]

So, is it better when you aspire to work for Big data corporations, to actually learn Scala? It seems way finer than java :X I know some Java, but holy shit! I would hate to code in Java for RDD-sets