Data Ingestion using Python | From local File to Database Table | ETL | Oracle Database Connection

In this video we are doing data ingestion from file to database table.
File present in local system and using python we are ingesting file data into Oracle SQL table.
Here data ingestion divided into 4 steps.
1. Loading data into data frame - 2:18
2. Establishing Database connection - 3:45
3. Creating Table - 6:35
4. Inserting data from Data frame to Database table. - 8:06

Data ingestion also known as ETL process where we Extract, Transform and Load data.

In data ingestion we transporting data from different sources to database so that we can use or analyse that data for further decision making.

// Subscribe MyLearningBook

// For other videos please find below links

# Mathematical Aptitude Lessons

#All about NTA UGC NET June2020

# 5 tricks to solve Time and Distance questions in competitive exam - Part 1

# Super 10 tricks to solve Time and Distance questions in competitive exam - Part 2.

// MyLearningBook

MyLearningBook is an educational platform and here are some benefits to subscribe MyLearningBook.
1. MyLearningBook provides career guidance time to time, which help you to take right decision at right time.
2. MyLearningBook provides study materials for Mathematical aptitudes, UGC NET paper - 1 and Paper - 2 Computer Science Application.
3. MyLearningBook provides old competitive exam papers solutions which help to understand the concept and boost your preparation.

// LALIMA
I'm Lalima and I am passionate about teaching since my college time. Starting an educational YouTube channel is much more than what it seem. It takes time, hard work and lot of learning along the way. Here with the help of MyLearningBook I am just trying to share my knowledge for those who really need it. Hope MyLearningBook is able to provide you right guidance at right time.
:) cheers

[My-Learning-Book]

Loading data set into Data frame - 2:18
Establishing Database connection - 3:45
Create table - 6:35
Inserting data into database table - 8:06
Please do comment section for any question, doubt or want to share any optimize way to do same task. Also suggest other topics and scenarios.

[prabirkumarsahoo]

This one is the perfect playlist which I searched for long time...

[deepanshugoel]

very informative. please make more videos

[pavankumar-nimy]

Simple and clear explanation 👌. I was exactly looking for oracle as dest DB and found this. Thank you and keep doing more such videos. You have our support. Please provide link for next video which is ETL with transformation

[RJ-dzie]

Hello ma'am... thank you for the wonderful content and you have great teaching style. Please also provide the data sets in the description box so that it will easy to practice along with you.

[ashishvats]

Hello, i want to do the same for Source(oracle netsuite) to alloy Db(target) but unable to do it. could you please help me ?

[sopanpitekar]

how can we store particular row in respectively table .
for example country colume is there and we have to store counrty wise recored in country table

[namalperera]

How can I append new xcel/df to this SQL?

[pankajyadav-szmr]

How to compare a table and a csv data ?

[kottakaburlu]

#Exam Board Excellent. Thank you for the video.

I am inserting json file data into oracle table but getting error ORA-01036 ora-01036 illegal variable name/number.

json file data as below

{
"deptno": "1",
"dname": "IT",
"loc": "INDIA"
}

with open('dept.json', 'r') as f:
json_data = json.load(f)

insert_query = "INSERT INTO " + target_table+ " (deptno, dname, loc) VALUES (%s, %s, %s)"


insert_tuple = (json_data['deptno'], json_data['dname'], json_data['loc'])

cursor.execute(insert_query, insert_tuple)

can you please help me