Mapreduce wordcount program in hadoop(Compile & Run)

preview_player
Показать описание
HELLO FRIENDS TODAY WE ARE GOING TO LEARN HOW TO COMPILE AND RUN MAPREDUCE WORDCOUNT PROGRAM (IN JAVA) IN HADOOP USING COMMAND LINE :-

WHAT IS WORDCOUNT PROGRAM?

WORDCOUNT IS A SIMPLE APPLICATION THAT DETERMINES HOW MANY TIMES DIFFERENT WORDS APPEAR IN A GIVEN INPUT SET.

GOALS FOR THIS SESSION:
1. UNDERSTAND THE MAPREDUCE PROGRAM FLOW.
2. UNDERSTAND HOW TO WRITE PROGRAMS FOR HADOOP MAPREDUCE.
3. UPLOAD THE INPUT DATA TEXT FILE IN HDFS.
4. CREATE YOUR OWN JAR.
5. RUN A JAR ON HADOOP ARCHITECTURE.
6. VIEW AND DOWNLOAD OUTPUT FILE.
7. VIEW OUTPUT ON COMMAND LINE.

Install Hadoop in ubuntu (Single node cluster)

Рекомендации по теме
Комментарии
Автор

my first MR job in hadoop...thank u from bottom of my heart

bishnuagrawal
Автор

Good Explanation of the .java file.
hope to see more interesting and informative video on mapreduce.

LijoJohnseekmoreexpectless
Автор

Very useful and understandable method. thank you for the video..

mustaphaskittou
Автор

It would've been better if you spoke and explained why we were creating that folder etc... but your video is very helpful, thanks :)

ismahenelarbi
Автор

An excellent tutorial, really, it helped a lot :-)

I have a question:
Can the same process be done with any mapReduce Java program, with its appropriate data set ?

Regards

walidksiaa
Автор

Great explanation!!! helped a lot.. thank you.. I have a question. I have problem where my name node is not running even after formatting? tried almost all the possible solution!! what could be the problem ?

rashmiri
Автор

where can I get The Word count program That use un The program.. thanks

fernandocuichan
Автор

Hi, I have question to you. I have sentence for example: "I like
spaggetti and tomato soup" and I would like split it by two words: "I
like" "like spaggetti" "spaggetti and" "and tomato" "tomato soup". Could
you describe me how to do this? of course in my file i will have more
sentences -not only one.

blackswan
Автор

Hi, Thanks for the tutorial, its great.
I tried to follow it, and got to the end, the problem is that the output seems to go through only the mapper
i.e. the output is something like this:
hello 1
world 1
world 1
...
The code i'm running is exactly the same as the one in the tutorial, any idea what might cause this? thanks.

rfire
Автор

Hey! please help me i m having this error :"mkdir: `/user': Input/output error" while typing the command : "bin/hdfs dfs -mkdir /user"

fatimezzahrarbib
Автор

Hi! Your video is excelent! But I got a problem... I got hadoop 2.7.2 and until I use bin/hadoop jar WordCount /user/inputdata/ outputwc it just doesn't do the map reduce it stays with the terminal blinking... Do you have any idea which is the problem?

federicomontealegre
Автор

I followed the exact instructions but when it came to compiling the program I received a lot of errors saying 'cannot find symbol' Mapper, etc. Please help

visharthigee
Автор

Hi, there. I followed your great tutorial without a glitch until running the .jar file, and it threw me an error like this:

Exception in thread "main" WordCountpro
at
at
at
at Method)
at
at
at

Could you please help me figure it out what was going on here? Thanks in advance.

iamjameswong
Автор

Can i ask other questions:

What is the difference when implementing mapReduce in a multi-node cluster?

Is the multi node cluster used when the data set is too large?

walidksiaa
Автор

hola amigos una pregunta donde puedo conseguir el programa word cound que se encuentra en el video

fernandocuichan
Автор

I don't have "usr/local/hadoop" directory. Please help me.

venkatanikhilch
Автор

Hi, where do I need to put the wordcountf map?

flowertje
Автор

please if you can gave acces to java code it will be helpful

sadiqluck
welcome to shbcf.ru