ETL with Python

Hackforge tech talk with Doug Sartori demonstrating ETL with Python and petl.

[haghjoomohsen]

Hi Doug, many appreciations! You are a real teacher that makes things smooth to understand.

[mjpender]

Hi Doug. Really learning a lot from your ETL tutorial. I had a data mismatch problem for the date and drove myself crazy until I realized that you have a capital Y for the %Y-%m-%d .

[arejoshi]

Really good example and explanation, I learned a lot. Thanks for sharing this class.

[amritasrivastva]

You are a great example of a good teacher! Learned so much from video. Thank you!

[ogechimaryann]

This is clear and concise. I love your teaching👍👍

[mercydabbs]

Thank you! I am just learning python but I can follow your very detailed explanation! Thanks!

[sajadsafarveisi]

The talk really increased my knowledge. Thank you.

[marc-antoinej-l]

Very good presentation. Easy to understand.

[nimrodr]

That was extremely helpful and interesting! thanks for that!
the left join part was interesting :)
More videos and examples please

[Mahmoud-yskt]

It was great thank you
We are waiting for more

[redfeathersa]

Brilliant Video.!! Thank you ❤️ but what is that module you were referring to before 41:00 that accepts formulae and you can do a lot with ? Pandas ? Numpy, ? Openpyxl ? Mongo or mundle I think it'd called (on medium recently ). I need to look it up on. Wait a sec I'll be back .

No it can't be ... Mitosheet ??? Bamboolib?? I don't think so (but those are cool - have yet to try them. Need to reimport/merge my jupiter labs from the old machine & it's environment variables) . But Would be interested to know what you were referring to?

Or did you just mean python itself ? (Which it does have? [Formulae ability ofcourse!]) .

Definitely though tell me if you were referring to something else . All the best & thanks for your video - it was absolutely amazing . !!

[eliotsygha]

Thank a lot for the presentation, it has been very useful for building my data warehouse while BI course.

[MisterKorihor]

I'm not sure it's necessary to have all the try-except blocks. If an exception is thrown, and there is no try block surrounding it, then Python automatically aborts the script.

[sanishthomas]

Nice ..but looks very complex code.. great work

[dizetoot]

Hello, you mentioned near the beginning of the talk that you did a similar demo using SSIS on the exchange rate data and had shared the link in the chat. Could you share it here as well please?

[WillB]

This was awesome. Thank you so much for putting this together. May I ask a question?... I'm new to python. On line 35 when printing out the BOCResponse variable, you did print(BOCResponse.text)... what is the '.text' line or what does that refer to? Is that part of the Requests module or a function of the Requests Module?

[muhammadshoaibkhan]

Can share some more api like this bank of Canada API, from where we can get the data?

[nathangarst]

This is so cool! This video is a bit beyond me though as a new Python learner, but I see the utility. I'm trying to move up in my analyst career. How do I learn this stuff? Should I go back to school for a BS in CS, or just learn by doing projects like this on my own?

[arjunjadhav]

I need to load ready API data into mongodb please make one video on that

[mohammedsafiahmed]

Hi Doug, nice tutorial.
However, I dont see anything that couldnt be achieved using pandas and requests primarily. Also, instead of doing the outer join and then filtering the rows that you dont want, couldnt we have just done a left join by keeping the expenses table as the left one? Would've made the code simpler.