Appending Historical Data to New Data with Dataflows (Maxim Zelensky)

Maxim's Blog:

Enroll in my introductory or advanced Power BI courses:

Elite Power BI Consulting:

Data Insights Tools:

Connect with me on Twitter!

[Rodrigo-lqiy]

Hello, excelent workaround! Thanks!
Question: I'm using desktop Power BI and an sql database as data source instead of API. When I hit refresh, it will sync up with Power BI Service dataset? Not with the real source? I ask because if I know I have new data on db, but I want to see it on Power BI, should I have to refresh manually Power BI service and then Power BI Desktop? Or is there a way to do it directly from Desktop? Thanks!

[mehdihammadi]

Very interesting, Thank you for sharing

[manrique]

This is great! Is there a way to create the dataflow (particularly for the historical data) without using an On-Premises Gateway?

[MacPaulos]

Pretty slick!!! Im looking to make this a little dynamic. Refresh to be last 30 days and historical to be anything beyond the last 30. Great ideas, please keep them coming

[ajaaskelainen]

This is super cool and it opens ideas for other functionalities! Thank you!

[jocelynlim]

Hi this is so cool! is there any other way we can do it? your method is only applicable for Power Bi Paid version.

[angeloliver]

Hi everyone,
I followed all the steps that appear in the video, but I have some problems with gateway:
When I create the query and the first DataFlow, I configure it with my company's gateway, and in the preview, the query show me the correct data, but now its the problem: When I try to update the dataflow, it fails, and when I enter in the query i check that the gateway parameter is: None.
It seems that the configuration dont save the gateway and I dont know why.
Some advices?
Thanks in advance

[MathurSudhanshu]

Hi i have a question... The data source im connecting refreshes with latest data daily... I want to setup a process with which i can append daily new data to my history data table? Right im downloading data in excel and merging it with older files using SharePoint folder connector.
Anyone familiar with a better approach

[DanielWeikert]

How can we now adjust the timeframe without going into the query/dataflow itself?

[sarva]

I need your help for refreshing history table dynamically for last 1 year data & current table will always have current months data . and then History table will be refresh 1st of every month and current table will refresh every day.

[julioaguilar]

Sorry but the staging table won't keep the new incoming data