Fetching Twitter Data into HDFS (Hadoop) using Apache Flume .....Step By Step Guide on Windows 10

This is my Apache Flume Configuration/Installation and Fetching Twitter Data into Hadoop HDFS Guide.

If u like my content Do Like , Comment & Subscribe ( Don't Forget to Share)
:)

Apache Flume Link:

** IMPORTANT NOTICE **

Due to Updated Policies of Twitter u can no longer fetch data through hadoop on Twitter Student Developer Account !!

****************************************************************************************************

[qwewed]

I set up all the configuration and my flume is working but not fetching data from twitter

[aminullahyousufi]

i do not see any twiter data in your hdfs ?

[zidaneahmed]

Salut Adil Jamil
je ne parviens pas a installer Hadoop

[qwewed]

" (Resolve-path $vconfFile).path " error in file "flume-ng.ps1"


Object not found error




How to clear it ?

[CSVISALINIR]

Bro is this problem statement can we try in phone bro

[RajeshVenkatesan-ji]

Hello Adil,

I hope you are good. Actually, I am in need of an assistance regarding Apache flume. I thought you’d be the right person to talk to about this.

To give you the context, I am newly learning Bigdata and Flume, while installing flume I am unable to configure fully as I get the below error message in command prompt.

I appreciate any help you can give. Thanks for your consideration.

version

-NoProfile -InputFormat none -ExecutionPolicy unrestricted -File version

WARN: Config directory not set. Defaulting to
Sourcing environment configuration script
Including Hadoop libraries found in (C:\hadoop) for DFS access
WARN: HBASE_HOME not found
WARN: HIVE_HOME not found

Running FLUME version :
class:
arguments:

Start-Process : This command cannot be run due to the error: The system cannot find the file specified.
At char:10
+ $x = Start-Process $javaPath -ArgumentList "$fullJavaCommand" -Wa ...
+
+ CategoryInfo : InvalidOperation: (:) [Start-Process], InvalidOperationException
+ FullyQualifiedErrorId : InvalidOperationException, Microsoft.PowerShell.Commands.StartProcessCommand

Kind regards,
Rajesh Venkatesan