Master Using SQL with Python: Lesson 4 - Using SQLite for Data Analysis

SQLite is a powerful client database built into the Python installation. This video explains what SQLite is and shows you how you can use it to enhance your data analysis work. You will even learn how to save data from other databases to SQLite.

Join my Patreon Community and Watch this Video without Ads!

Twitter: @BryanCafferky

Notebook and Data

Download and Unzip the file.

[jimcallahan]

Bryan, you should write this up as a book . I just checked on Amazon for a book that covers this content and there isn't one. The problem seems to be that Python authors (even excellent Python authors such as McKinney or Vanderplas) don't really get SQL databases. For SQL people, this combination SQL/Python/Pandas is fantastic because it provides three things:
1. SQL provides a concise, standardized way to subset or aggregate rows and columns of data
2. Python provides a way to conditionally execute a series of SQL statements
3. Python/Pandas does everything that SQL doesn't such as the ability to pretty print tables or make charts and/or output to specific file types such as PDF or Microsoft Excel files.

[ELDhouse]

Your presentation is paced very well and I am looking forward to learning what you have to teach about pyspark and databricks. thank you!

[Anonymous-myud]

Thanks man I was just looking for something like this.

[romanhar]

Thank you very much for this very valuable and easy to understand presentation.
I am starting with all this stuff, and your video is really bringing all together (python, sqlite3 and panda. 🙂👍

[izeofsan]

Around 16:54 If someone had this error when running custDF = FileNotFoundError, make sure to use uppercase the same as the file and folder, and maybe / instead of \, custDF = . That worked for me on Ubuntu 22.04 LTS

[bluesdog]

Great stuff Brian, thank you! Do I need to learn Jupyter Notebooks? I tried it once and didn't like it much. Could you put a link in the description for the files please, might be fun to play with, Thanks! ;)

[pietraderdetective]

hi Bryan, i have been watching your videos a lot..great content you got here!

Can you make a video about doing the equivalent of UPSERT using Pandas?

[DequanHarrison]

I’m wondering if it’s possible to use SQLite as a permanent database? My job won’t give me access to their database so I wanted to see if I can use this as a workaround to store my data for data analysis projects.

[okparaesther]

Is it right to export my dataset that that i have cleaned on python to mySQL to extract insights?
Or is more professional to use SQLite?

[Jamesedwardkoch]

Thank you very much, I really enjoy your videos. Have you made a Udemy course yet?

[ericxls]

Would be great is you do exactly the same using Dask. Get over all the issues I have (5% of the time) after using all these techniques….

[ManojKumar-xvgl]

Hi.. I'm new to python programming... Can we build all types of business mobile apps using kivyMD 😊

[Leonardo_A]

Is it possible to use SQLite as a Webserver? In other words, is it possible that the “SQLite.DB” is on the WebServer and a PC-Programm on a PC-client edit directly the SQLite.DB? If the answer is YES, then please send the synthax of the connection-String : e.g. SQLite.conn= …”Servername” …”Https”. Is this possible?

[Jamesedwardkoch]

Asking for a friend, Is it easy to access Oracle DB