All you need to know about incremental refresh for PRO | Power BI desktop update february 2020

All you need to know about incremental refresh for PRO | Power BI desktop update february 2020
In today's video I will show you everything you need to know about incremental refresh in Power BI. Check the Keynotes for quick navigation.

Links mentioned in the video:

Keynotes:
00:55 What is incremental refresh in Power BI?
01:30 Configure incremental refresh in Power BI
01:50 Create and troubleshoot RangeStart and RangeEnd parameters for incremental refresh
03:00 Apply and troubleshoot incremental refresh parameters to your query
05:30 How does incremental refresh work technically?
06:30 Incremental refresh limitation: Need query folding
10:12 Incremental refresh limitation 2: Cant download pbix file
10:50 Greyed out/disabled incremental refresh
11:12 Set up incremental refresh parameters
12:10 Set up advanced incremental refresh parameters

SUBSCRIBE to learn more about Power and Excel BI!

Our PLAYLISTS:

☼☼☼☼☼☼☼☼☼☼

POWER BI COURSES:

Want to learn Power BI? How about you take one of our courses? Here you can find the available courses:

☼☼☼☼☼☼☼☼☼☼

ABOUT CURBAL:

************

************

QUESTIONS? COMMENTS? SUGGESTIONS? You’ll find me here:
Twitter ► @curbalen, @ruthpozuelo

#CURBAL #SUBSCRIBE

[Baldur]

There is one issue with Incremental Refresh - I hope it will be solved soon. Whenever I want to upload the dataset to cloud (PBI Service), I am replacing it with just dataset without incremental refresh done, I need to wait another 30-40 minutes for full refresh. In large scale deplyment it's not acceptable, we need to do our updates on weekends. Actually easy fix would be to replace dataset after IR has been done (a choice option) and the replacing existing dataset. Otherwise if something goes wrong with IR then we are stuck with last two months instead of last 3 years.

Another thing is... I've waited so long for Hierarchy Slicer to see that it not supports Parent-Child Hierarchies :(, it is also breaking when having a lot of values in Cloud. I know it's preview feature, but not having support for Parent-Child Hierarchies is just pointless. Now it's just simple merging different slicers into one.

[rayng]

Oh my word!!! The Microsoft Engineers at Redmond and India were not able to explain how to implement this feature to me. They insist I have to create a Data Gateway as an initial step before Incremental Refresh can take effect. Thanks for this clean and clear explanation!!!

[Mahmoud-mfhn]

Im in love with your spontaneity :)
Great explanations ;)

[srs]

"How it does that? Microsoft knows"


:-)


Thank you for posting.

[HowToExcelBlog]

Every month there's a new best feature. They are blowing away the competition!

[gestionproductiva]

Tienes razon Ruth..una gran mejora y muy necesaria. gracias

[javiercabeza]

Hello Ruth, regarding the incremental update, there is some difference between using a pro account vs a premium one

[MYPE-Consulting]

thank you Curbal for all your videos ! Augustin

[dashingmozy]

Hi Ruth, thanks for the video, it is AWESOME!

Re-posting a question I asked on another of your videos. Please let me know your opinion.

Master table has values till yesterday (sales and region). I want to append Master table with today's values. I want to perform this automatically for every day. Since I am using SAP BW, Incremental refresh doesnt work (Query folding not available).

I have tried to extract latest date from master table in a query (in my example, it is yesterday). Used the latest date query to fetch today's data (as start date). However while appending both tables, it throws cyclic error (rightfully so).

I would really appreciate your guidance.
Thanks!

[blankpages]

This is super. Just a query though - could we do the IR over BI Desktop as well and then publish, or does the IR happen over the service only?

[vivianar]

Thanks Ruth for your great content.
I wonder if I need to apply custom filter to the "Date" table on my model. Another question, which dates are required to create the RangeStart and RangeEnd parameter? I sett up a RangeEnd for a date last year and all visuals were cut to that date.
Thanks for your help!!

[bennekop]

Hi there,

many thanks for the great explanation. I do have a question concerning query folding at the source. As suggested by Microsoft, Dataflows and Datassets are designed to work in tandem. Do you have any further information about whether 'folding at the source' is applicable when configuring incremental refresh on a Dataset that is connected by Data Import to a Dataflow on the server? When considering query folding at the source, where would the source be in this example, would it be the Dataflow or rather the source the Dataflow connects to?

[samuelmanseau]

I agree with you probably the best release of the year but as we say in France "not dry yet" ! still some details to fix (Date/Time format not always available in DataSet for sizing reason). And thanks for your helpful videos ! Especially the Dax serie.

[decentmendreams]

Hi Ruth, The literature on IR is very poor. This is an old video but I thought worth mentioning. IR works on flat files granted that the files are saved periodically. I have data that shows a hotel room pickup that is saved daily to a folder . I set an IR on last six months daily pickups so that it will only referesh overnight's data only as there is no reason to load old data. I wish I knew this.

[denniskipkoech]

Finally this feature is released for a wider audience. I however cannot seem to get the dataflow incremental refresh to work with an error saying it requires premium capacity. Can this work on dataflow entities using the pro license?

[danielsiffredi]

thanks for doing this, you saved me a ton of time and taught me tons of things I needed to quickly grasp to implement this feature. As always, thank you so much Ruth! Gracias por todo desde Oregon :)

[squaretube]

Thank you for this video, I like the way you explain the process. you don't follow a script so its spontaneous, it is easy for any one to get the message without complications. :)

[jatingera]

After using all the above steps, an incremental refresh is fine when clicked manually but when I did set it schedule refresh then it's taking too much time... why ?

[JonathanCHANAL]

Thank you very much! I love this feature but I love even more the hierarchy slicer <3

[rvgfox]

Clarísimo como siempre Ruth. One question: After the first load in the service, if you delete older records in the source, remain it in the service?