Apache Spark - Loading data from relational databases

Connect with me or follow me at

[chetananand]

Which ide you have used in this video?

[revathis]

Hi sir,
How to do incremental load ?

[SpiritOfIndiaaa]

Thanks a lot for sharing this nice experience.
I have few dobuts.
1) My tables in oracle has millions of records, can we push all those records of a table/calulated rows at a time into cassandra?
should it allow it or should we do incremental, if incremental how we keep track of the pushed and yet push records ?
2)
1) Where/how do we run deploy this code in production ?
2) Out existing application is in Java/spring, so how to integrate this ? or should I make a new project ?

[SpiritOfIndiaaa]

I am using DataframeReader load method to read from oracle, but it is coming a one partition, how to ensure the data read are partitioned ????

[nikhilkhedkar]

Hi sir, I want to know that how can we read parallel data from relational database using spark sql?

[dsinghr]

in which video have you shown POM file and sbt dependencies ?

[gautamdeusa]

Isn't using spark.sql or sqoop easier option that this code?

[SpiritOfIndiaaa]

I am using oracle11g, but i dont find its ojdbc7.jar in the maven how to include it ?

[vishalchhabra]

It's really a very good video has been uploaded by you..
One quick query please..
Can we use it for complex query which usually fetches 5 to 6 million records from database..
And can we use in remote databases as well ?
Please confirm..
Many Thanks in Advance..

Warm Regards

Vishal

[sai]

Hi Rakesh / Durga... I have started following itversity and I couldn't find the source code for the videoes being explained.

Can you share the codes explained in the videos and also any good project codes to execute and also learn from the codes

[krishnam]

Hi your videos are very informative can you please upload to connect local oracle database with data bricks edition Thanks in Advance

[johnsonphilip]

Hi
How can I get the source code you used in the demo?

[allinone-ez]

Where can I find the above code, explained in the above video...

[itversity]

For any technical discussions or doubts, please use our forum - discuss.itversity.com
For practicing on state of the art big data cluster, please sign up on - labs.itversity.com
Lab is under free preview until 12/31/2016 and after that subscription
charges are 14.99$ per 31 days, 34.99$ per 93 days and 54.99$ per 185 days

[kattenikhil]

you guys are doing great job !!! thanks a lot. can you please upload the source code of all the videos in your git hub . thanks in advance

[hussainasghar]

I need source code of these tutorials.