Microsoft Fabric: How to Ingest API Data Dynamically in Microsoft Fabric

Do you need to ingest API Data? We hope so! If not, wow.... Have you gone down a YouTube rabbit hole! Well for those of you here for the API look no further! Bradley Ball, aka @SQLBalls , has got you covered! We will show you how to ingest data, dynamically store it in your OneLake, and then how to ingest it into Microsoft Fabric Data Warehouse!

Chapters

00:00 Preview of Getting Data from an API
01:53 Demo Get the API Base & Relative URL
02:32 Demo Get Longitude & Lattitude Data
02:54 Demo Create Data Pipeline to get API Data
04:08 Demo Create Dynamic Parameter Driven Relative URL
05:28 Demo Create Dynamic OneLake Storage Location based on Date
06:30 Demo Create Dynamic File Name
07:30 Demo Run the first half of the Pipeline
07:48 Demo Validate Data with Azure Storage Explorer
08:06 Demo Ingest JSON data to Microsoft Fabric Data Warehouse
09:13 Demo Run Staging Ingestion Pipeline
09:50 Demo Run the Dynamic Pipeline Again
10:34 Demo Validate End to End Run with Azure Storage Explorer & SSMS

Get started with Storage Explorer

Microsoft Fabric data pipeline public REST API (Preview)

Wrigley Field on Bing Maps

Magic Kingdom on Bing Maps

[singamsgr]

Nice and informative demo. I would like to know the other way, i mean reading files/tables from lakehouse with rest API into other applications.

[syednayyar]

Great Amazing, Can you please help getting the data into the Lakehouse or Datawarehouse in Fabric using android APP code ( java native ) i am frustratingly annoyed because no help / guidance found around on how to ingest / upload the Json file from a native Java app that creates a Json file, will be great if you can please share some ideas if this is even possible ( on the offical documentation only python methods are listed ) no java or kotlin way to ingest Json / upload Json to OneLake

Your help will be amazing please.

[rishivarma]

while defining the parameters what is the value that you have provided for APIKey. I am not able to generate the data because of the missing field.