PowerShell Meets DuckDB Integrate, Query, and Analyze Data Seamlessly

I demo AI Agents at the end of this video, check that last timestamp.

Get the module `Install-Module PSDuckDB`

Like and subscribe and start the repo.

Welcome to this comprehensive guide on PSDuckDB, a powerful tool for integrating DuckDB with PowerShell. In this video, we'll cover everything you need to know to get started with PSDuckDB, from installation to advanced usage. We'll explore the GitHub repository, examine DuckDB at a glance, and dive into various ways to utilize PSDuckDB in your projects. Whether you're looking to use the command line interface, ADO.NET style, or integrate with other tools like Excel, this video has you covered. Stay tuned as we walk through practical examples, including selecting from URLs, describing tables, and more, culminating in the exciting intersection of AI agents with DuckDB in PowerShell.

Table of Contents

00:00 Introduction
04:38 Install PSDuckDB
05:12 PSDuckDB GitHub Repo
07:18 DuckDB At A Glance
10:24 DuckDB.NET
12:28 Three ways to use PSDuckDB
14:51 PSDuckDB CLI
15:46 PSDuckDB -Command
17:15 PSDuckDB ADO.NET Style
20:17 DuckDB Documentation
21:42 PSDuckDB - Persistent data
22:48 Select from a Url
23:30 Describe a Table
25:22 Group Data with Counts
27:41 PSDuckDB in a script - Full SQL statemen
29:49 Select * a directory of CSV files
31:01 Select * a directory of JSON files
32:05 UNION CSV and JSON files
33:41 UNION CSV and JSON - In a SQL Statement
35:23 Blend DuckDB, PowerShell and Excel
37:56 JOIN CSV files on common columns
40:43 Ingest from a GitHub REST API
44:25 Extract, Transform and Load Get-WinEvent
53:09 AI Agents meet DuckDB in PowerShell
57:28 Invoke-InteractiveCLI and your Agent
1:03:09 The Agent code gens PowerShell

[htechsme]

So great! I've been jamming on data munging with DuckDB by writing a small F# console app to march through the transforms and have set ParquetSharp aside (for the time being). I really appreciate the PostgreSQL-ish syntax - and in my case - being able to set aside the F# CSVProvider which can be pretty prickly. This is really slick and quick. 👍