Even a schedule trigger can be set to run every 5 minutes. We can set a variable to capture the utc time the moment the pipeline gets triggered and then utilise that time in the query.
Let's say u are interested 2 records at 4:16 pm Your window current period is 4:17 window start And to 4:22 window end Then 4:16 which is load datetime not falling between your 4:17 and 4:22 How the select query will return records
That was a amazing demo, Thank you mam for taking out some time to create beautiful/useful content like this. cant tell you how much it helps for someone who wants to learn.
Simplicity in your video speaks a lot about your expertise on this subject. Thanks :) I like this tumbling window option in terms of dependencies too. The tumbling windows can be rerun for specific window when something went wrong in the past run makes it more reliable.
Very helpful and nicely taught, would have been great if the video quality was not compromised. Now I feel confident with Tumbling window concept, kudos to you, thanks heaps :). You hammered it by using real time scenarios.
Hi , I have a requirement to process files on daily basis I am using tumbling window. Can I pass tumbling window trigger time as a pipeline parameter to dataflow parameter in last modified date under dataflow source settings. If yes,please let me know how.
Hi Mam, Thank you for your tutorials. I was wondering why you are using modifiedDate>=windowStartTime. Shouldn't you use the modifiedDate_TS>=WindowsEndTime_LastTriggerRun ? What I mean is that if you schedule the trigger once in a week schedule, you may skip the newly inserted rows that are added in between triggers' run time. Thank you for your response
Hi Madem, Can you please let us know what are the possible errors will get in real time and do some videos on it. That would be helpful for us. Thanks!
Nice explanation mam. Thanks 🎉🎉
Thank you 🙏
Superb..always be your fan..such a unique way of teaching..you are teaching as if you are personally paying attention to every student.
Thanks!😊
Even a schedule trigger can be set to run every 5 minutes. We can set a variable to capture the utc time the moment the pipeline gets triggered and then utilise that time in the query.
Let's say u are interested 2 records at 4:16 pm
Your window current period is 4:17 window start And to 4:22 window end
Then 4:16 which is load datetime not falling between your 4:17 and 4:22
How the select query will return records
Hi Madam
Can u plz clarify?
That was a amazing demo, Thank you mam for taking out some time to create beautiful/useful content like this. cant tell you how much it helps for someone who wants to learn.
Feedback is a wonderful practice and it makes life more meaningful and motivates to post more and more. Thanks for letting me know ur thoughts.
Simplicity in your video speaks a lot about your expertise on this subject. Thanks :) I like this tumbling window option in terms of dependencies too. The tumbling windows can be rerun for specific window when something went wrong in the past run makes it more reliable.
That's a great compliment. Thanks
Very helpful and nicely taught, would have been great if the video quality was not compromised.
Now I feel confident with Tumbling window concept, kudos to you, thanks heaps :).
You hammered it by using real time scenarios.
Hi , I have a requirement to process files on daily basis I am using tumbling window. Can I pass tumbling window trigger time as a pipeline parameter to dataflow parameter in last modified date under dataflow source settings. If yes,please let me know how.
Mam one question, tumbling window pick the window start time when it started... or it picks the window start time from the previous finished job.
Current window start time pankaj
Hi Mam, Thank you for your tutorials. I was wondering why you are using modifiedDate>=windowStartTime. Shouldn't you use the modifiedDate_TS>=WindowsEndTime_LastTriggerRun ? What I mean is that if you schedule the trigger once in a week schedule, you may skip the newly inserted rows that are added in between triggers' run time. Thank you for your response
Yes you are right. 😊
Hi Madem,
Can you please let us know what are the possible errors will get in real time and do some videos on it. That would be helpful for us. Thanks!
Can you post what would be the WindowstartTime and WindowEndtime value.
Thanks for this video. Pls show how can we implement dependant triggers.
Clear and concise
Excellent
Thank you so much 😀