Data Warehouse - 2 - Creating CSV file using Pandas DataFrame for Full Load

preview_player
Показать описание
How to create create csv file for Full Load using Python Pandas DataFrame using iloc method?
Рекомендации по теме
Комментарии
Автор

Thanks Mandar, this is extremely helpful for a new data engineer like myself. Please do keep going!

wz
Автор

Hello! In this playlist you have „2 unavailable videos are hidden”. I am watching your videos with high interest because I'm studying / practicing my data engineering skills. Are those video relevant/important to this process?

zexatt
Автор

Thank Mandar, thank you for your help again. Could you help me for below 2 questions? 1. in the scenario, there are millions of record in the OLTP database, is using the CSV file still be a reasonable method to hold the OLTP data temperately, in order not to hold the cursor for a long time ; 2. what are the potential disadvantages, if we load the OLTP data directly to the staging tables in the data warehouse, I mean what are the risks of holding cursor for a long time, comparing to extracting the data into CSV 3. could you help to advise the time difference between inserting the data in to CSV and staging tables, how many times would that be

thank you for your help and sharing again : )

JasonZhang-sejo
welcome to shbcf.ru