Combine CSV and JSON Data Effortlessly with PSDuckDB in PowerShell | Doug Finke Tutorial

Hello friends! Doug Finke here, your PowerShell guru.

In this video, I'll dive into PSDuckDB, a powerful and efficient database solution that's easy on your system. I'll show you how to seamlessly join data from CSV and JSON files using PSDuckDB in PowerShell, simplifying your data processing tasks.

In this tutorial, you'll learn:

- How to install and set up PSDuckDB
- The basics of joining data from CSV files
- Combining JSON data effortlessly
- Joining CSV and JSON files in a single query
- PSDuckDB makes data manipulation a breeze, whether you're dealing with CSVs, JSONs, or both!

Useful Links:

PSDuckDB Module: Install-Module PSDuckDB

If you found this video helpful, please give it a thumbs up, leave a comment, and subscribe for more PowerShell and PSDuckDB tutorials. Thanks for watching!

Chapters:
0:00 - Introduction
0:03 - Overview of PSDuckDB
0:47 - Installing PSDuckDB
1:06 - Joining CSV Files
3:02 - Joining JSON Files
4:25 - Combining CSV and JSON Files
5:00 - Conclusion and Further Resources

#PowerShell #PSDuckDB #DataIntegration #CSV #JSON #DuckDB

[dj]

Wow. This is a really nice module. Good-bye futzing, hello PSDuckDB.
Thanks Doug!

[dilatedconciousness]

Hey Doug, this works well and FAST! I wonder if you can pass in PowerShell objects directly without exporting them to a csv or json file first? The export step isn’t terrible, but I’m pulling stuff from APIs and wanted to throw them straight in after some in-memory normalisation. Also, I see DuckDB has an SQLite extension. I wonder if this can be leveraged to throw data processed by DuckDB into a SQLite database for browsing with other tools. I like the simplicity of the open source DB Browser for SQLite for poking at data, so it would be great to dump results into something I could continue to work with in a nice GUI