Essential Hadoop HDFS Commands Well Explained | Kundan Kumar | #hadoop #hdfs #commands

preview_player
Показать описание
In this video, we delve into the fundamental commands of Hadoop's HDFS (Hadoop Distributed File System) to help you manage and interact with your data efficiently. Whether you're a beginner or looking to sharpen your skills, this tutorial will guide you through the most important HDFS commands you'll need to know.

What You'll Learn:
1. Introduction to HDFS Commands: Understand the basics of HDFS and its role in the Hadoop ecosystem.

2. Listing Files and Directories: Learn how to use the hdfs dfs -ls , hdfs dfs -lsr, hdfs dfs -ls -R command to list files and directories and directory tree.

3. File Operations: Explore commands like hdfs dfs -put, hdfs dfs -get, and hdfs dfs -copyFromLocal to manage file transfers.

4. Directory Operations: Discover how to create and delete directories using hdfs dfs -mkdir and hdfs dfs -rm -r.

5. File System Checks: Understand how to check the health of your HDFS using hdfs fsck and other related commands.

Thank you for watching, and let's embark on this journey to mastering Hadoop together!
Рекомендации по теме
Комментарии
Автор

this is a a well explained tutorial i have ever seen thank you for sharing knowledge sir

chris-cdli
Автор

Great tutorial indeed!This was so helpful.clear and concise. Thanks alot for sharing

pamellamutoniingabire
Автор

This is a fabulous tutorial indeed. please keep on giving us informative tutorials.

ishimwejoshua
Автор

I found this difference:
-put: Can copy from local file systems or from other compatible file systems (like S3) to HDFS.
-copyFromLocal: Specifically designed to copy from the local file system to HDFS
also,
-put: By default, it will overwrite the destination if the file already exists.
-copyFromLocal: Will throw an error if the file already exists at the destination

However, "-put" supports more options and flags for advanced use cases

PhilemonIransubije
Автор

The sign before the direction to put or copy to is changing from forward backslash to backward backslash . 😅

EmmaBemmly
Автор

Sir, after uploading a file, it is creating 1 replication for it. i changed the hdfs-site to 2, but no change. any help?

PhilemonIransubije
Автор

Hi sir can you please tell commands for count the number of words using(wc-w)
count number of letters(wc-m)

meghanajyothinagaram