Hadoop Map Reduce Programming 101 - 03 Hadoop Distributed File System

1) Distributed storage using block size and replication factor. 693 MB file is divided into 5 blocks of 128 MB and a block of 53 MB (total 6 blocks)
2) Replication factor will be used to create multiple copies of each block to support fault tolerance
3) Use hadoop fs -put command to copy files or hue file browser
4) ifconfig -a is the command to get ip address of your cloudera vm and you need to run it on Cloudera VM
5) ip_address:50070 can be used to launch namenode UI
6) Namenode stores metadata of files in HDFS (file names, block ids and block locations etc)

[Xmen]

One of the best videos I encountered because I learnt something new! Thanks a lot sir :)

[jungao]

Very good tutorial, thank you for sharing

[merry]

hi, i am having error with cloudera manager services.
Is it necessary to start hdfs service from cloudera manager to upload files???
my services in cloudera manager giving bed health issue( red circle).
can i upload the .csv files same as you uploaded the .txt files??
how i can create data nodes. initially it is only 1 data node???

[dhruv]

Can you please share the link to download the deck text files ? Thanks

[ankurjain]

Hi .. i am trying to access to HDFS from windows machine but i am unable to access.
I am trying to access by Crome.
VM is start and running fine.

[sainathreddy]

while copying deckofcards.txt to vm machine from my mac terminal it is showing connection lost error..what is the reason?

[OhMyMistyMountain]

Hello Sir i am not able to browse file system using namenode and getting following error, please help.
Failed to retreive data from Service Unavailable

[vignesannatarajan]

I am using windows 10. I don't have command terminal. What software should i install to copy files from my local machine to Virtual machine ? Thanks!

[sainathreddy]

ssh: connect to host 172.16.165.13 port 22: Operation timed out
lost connection

[sooprano]

ssh: connect to host 10.0.2.15 port 22: Connection timed out

lost connection :(
i use Virtual box,

[chiefs]

Worst hand-writing ever-did you write that in sanskrit?