filmov
tv
How to use Hadoop Python Streaming?
Показать описание
Mapper python file:
-------------------------------
Reducer python file:
-------------------------------
Commands:
-------------------
su - hduser
hadoop fs -mkdir /input
sudo nano /home/sanket/input
hadoop fs -put /home/sanket/input /input
create folder wordcount
sudo chmod -R 777 /home/sanket/wordcount
cd /home/sanket/wordcount
mapred streaming \
-input /input/input \
-output /output \
-------------------------------
Reducer python file:
-------------------------------
Commands:
-------------------
su - hduser
hadoop fs -mkdir /input
sudo nano /home/sanket/input
hadoop fs -put /home/sanket/input /input
create folder wordcount
sudo chmod -R 777 /home/sanket/wordcount
cd /home/sanket/wordcount
mapred streaming \
-input /input/input \
-output /output \