DuckDB Tutorial - DuckDB course for beginners

DuckDB Tutorial - DuckDB course for beginners
Discover the power of DuckDB and why it will be so important to you!

Connect with me on LinkedIn 👇

TABLE OF CONTENT

0:00 Introduction
0:32 Who am I
0:53 Why DuckDB?
1:52 What is DuckDB?
4:34 What are the limits of DuckDB
5:35 Practice time
5:41 The setup
7:22 Install DuckDB and Imports
8:11 Create a DuckDB connection
9:10 Print the top 10 rows with Pandas
10:37 Print the top 10 rows with DuckDB
11:15 Retrieving data from a request
12:13 Use read_csv to load CSVs
13:03 Using DESCRIBE
13:15 Registering a Dataframe as a Table
14:15 Counting rows with DuckDB
14:18 Data cleansing
14:52 Querying Pandas Dataframes with DuckDB
15:55 Filtering on columns
16:46 What's a view?
17:06 Creating a table with types that skips invalid rows
18:40 The First-Form clause
19:07 Excluding columns with DuckDB
19:40 The Column Expression
21:52 Create a View
22:34 GROUP BY ALL
22:48 Querying the View
23:05 Revenue by City
23:24 Writing Parquet files with DuckDB
24:05 Querying Parquet files with DuckDB
24:35 DuckDB with S3
25:08 DuckDB Extensions
25:15 Conclusion

[MHelmers]

Would love a full Udemy Course on DuckDB & dbt from you!

[gatono]

That's game changing, very nice video, Marc, Thank you.

[HitAndMissLab]

Brilliant tutorial, appreciate your work.

[tech-n-data]

This is a great intro video, thank you.

[robertbutscher]

great tutorial, thanks for inspiration and your interstings lessons

[interestingamerican]

like your style! Subscribed and hit the bell....

[fv]

do you have a video on your vscode config setup?

[georgelza]

i'm sorta stuck... your VSCode is running like a Jupiter notebook... how so... what did i miss... your screen shows a run cell run above debug above... where does that come from

[mathieujasinski]

I did smashed the like "booton", thanks brother, very helpful content!

[jerrynwaeze]

Hi This is the best video on duckdb atm. How do you get resources on it? I heard you can connect to a postgres db using a Postgres scanner. How does that work?

[pba]

Here is important information. Jupyter notebook extension needs to be added to VSCode. How about using the StackOverflow principle and avoid the worthless thank you comments.

[dataslinger]

Thanks as always for the great content Marc! Just as a sanity check for myself, OLAP Databases don't necessarily need to be columnar based correct? Recent big data databases use columnar based storage, but any database that processes analytical workloads is considered an OLAP database even if it is row based correct?

[leonvictorrichard]

Would love an dbt+ duckdb course from u on Udemy. Big fan of yours 🎉

[olga]

Thanks, great lesson! Could you help to fix an error, it occurs when I try to run the sales table that we`ve created. The error is "Conversion Error: Could not convert DATE (0019-04-19) to nanoseconds" Don`t understand why it`s trying to get nanoseconds with the date format. Thanks!

[LeSaboteur]

like always... way to few likes for such a great video!🎉

[rosco_]

Oh man, oooofff! I tried following your video here and your blog with the stock analysis data. I've run into too many errors unfortunately. That's the thing about these dependencies - there's too many moving parts where errors are persistent. I can sort through them, but it would take up too much time. We all got work to do :-).

For data analysis work, my go to still at this point is using an AWS S3 bucket to load the raw data, use an AWS Glue to create a database and an AWS Glue Crawler to upload the data while creating a table within that database. I can also use AWS Glue Studio to convert the data from .cvs format to .parquet format. From there, I can use AWS Athena to query the data.

[aruniyer]

I am getting this error
Conversion Error: Could not convert DATE (0019-04-19) to nanoseconds and run conn.execute("from sales").df()
when i create a sales table. Not sure if you have seen it?

[durgeshkshirsagar]

4:28 it is written redhshit :D Please don't mind. Thanks for the video.

[durgeshkshirsagar]

Except that baziz, everything is perfectly fine.😀

[shogun-]

The files are not available anymore :(