MapReduce Word Count Example using Hadoop and Java

In MapReduce word count example, we find out the frequency of each word. Here, the role of Mapper is to map the keys to the existing values and the role of Reducer is to aggregate the keys of common values. So, everything is represented in the form of Key-value pair.

GitHub Link :

Hadoop Installation Link :

IntelliJ Installation Link :

Install Java JDK :

Stay Connected :

Join Community :

Follow me on :

Timestamps :
00:00 - Word Count Example
00:10 - Check the Hadoop Version and start all daemons
01:20 - Create Maven Project using IntelliJ
03:10 - Create Mapper, Reducer and Runner class
04:45 - Create jar file using maven install
05:40 - Create input file and put into hadoop file system (HDFS)
08:00 - Run the jar file using hadoop jar command
10:30 - Check the output

#hadoop #mapreduce #CodeWithArjun #Programming #datascience

[lightmyra]

You are a lifesaver! I tried so many tutorials I can't even count them, especially for installing Hadoop on Mac M1! Yours has worked in under 15 min! Thank you so much!

[barunchaudhury]

Thanks a lot my last output command was not working. After watching your video now its working ❤

[KarthiDreamr]

My girlfriend suggested you and I love you 💖🌈

[logcoo]

thank you, your explication is clearly i like it 😎👏

[vaiebhavpatil]

the yarn application state is stuck at accepted for more than an hour now. it just shows running job in the Intellji terminal

[shanemay-gunlogson]

Maven clean did not produce a snapshot for me. This tutorial did not work for me.

[sivadhanush]

How to check count for a particular word

[Bollywood.]

how to find local host port num in hadoop

[kushagravarshney]

I'm Getting the error... Exception in thread "main" java.io.IOException: Job failed!
When i deleted the main.java as shown why?

[mtwdvmb]

yarn hello world example using hadoop and java how to creat it?

[moosarazeek]

is that configuring maven project will take too much time? for me after adding dependency and reloading maven it keep on showing configuring maven and will this work on hadoop 3.3.6, i updated the version in the code too

[newsforyou]

Hi thank you for your toturial, I get a error of Exception in thread "main" 0: No such file or directory, did you know what could be the error

[srivatsakamballa]

hey its not working on mine, I don’t know why ? can u please help me out

[salmadewitaufiqoh]

Hi, i have followed the steps, but it took so long to run the last command (the hadoop jar target...). I use Ubuntu with OracleVM. Do you know why this happen and how to solve it? thank you

[shot_freeze]

Hello Arjun, Is there any possibilities to install Hive & Spark on Mac OS like you installed hadoop on Mac OS terminal ? Please advise so it can deeply clarified !

[godfreyogbeide]

Please i just want to make a request, if it is possible to create a stock inventory and Web shop with images added, thank boss
using springboot and react you are the best

for some reason the secondary namenode isn't working, that wont affect the functionality right?

[ichvjhe]

any idea why I am getting "bash: hadoop: command not found"?

[blues_fan]

doesn't even attempt to explain the code. Just copied and pasted !

[SOLOMON-ALEXANDER]

9:41 it gets stuck in that "2024-08-19 11:21:50, 463 INFO mapreduce.Job: Running job: job_1724044540500_0002".... why ? can you tell how to fix this