Thanks for the video it explains about the on premise data source. But the same is not working when we set up the credentials for azure sql data source.could you please explain the same in your next video as I couldn't find any documentation from Microsoft regarding the cloud data source credentials setup. Thanks
Hi Adam and Patrick! This is such an amazing thing you did there. We usually struggle when we somebody takes over the dataset and forgets to replace the Missing credentials with their own so we only find out when the refreshes are delayed. A question would be, what happens if After this configuration, someone re-uploads the dataset with changes?? Will this configuration need to be Done Again??? It would be nice if the service retained the Service Principal setup you did there. Thanks for the AMAZING tip😍
Wow!! talk about following some industry standards to mange access to refresh data. This is great, setting this up and managing would be another task all together but its definitely a process to inculcate.
I did all that 3 months ago and believe me it wasn't easy.. although few tickets to microsoft helped figure out... especially the managed service identity.. lets see if you can take over a dataset which is inturn connected to dataflow and refresh it via service principal.. shall we?
Hi ! Did you figure out how to use a managed Identity to refresh a dataset - I am using a managed identity using ADF to trigger a refresh to data in kusto but getting same error as in the video. we dont use gateways ( afaik ) . any idea what needs to be done to get rid of this error ?
I am getting command not recognised error in the same power shell as you are showing. Can you please help me to resolve the issue. i am using Web as data source and when I am using dataset.Takeover API I am unable to refresh my data source from the refreshes API. I am getting ErrorCode: DMTS_UsersNotFoundError while running your command and I am tired finding the solution but didn't getting it.
Hi Adam, I understand the Service Principal owning the Dataset and configuring it to use the Data Source via the Gateway. However, what if the Dataset is connecting to Cloud resource. For example, what if it is using a Dataflow. I was unsure if your Geography example covered my answer. While it appears to pull from a URL it is not clear if OAuth2 or API Key authentication is required (question would the privacy setting change when switching from user to service principal?). Could you please clarify how the authentication for the cloud data?
The data source, configured in the gateway, will have a set of hard coded credentials. For the Geography piece, that was anonymous. So that is dependent on what the connector supports. It's not really related to the service principal starting the refresh, or using data sources configured on the gateway.
I know it is late, but to answer the question: we tested this and apparently even for cloud data sources there is a gateway cluster being involved. This one is hidden from the end users, but from power shell you can get its guid. Thus, the same process in the end… 😉
@@tareksalha Can you please detail a bit more as i was able to get to the step where service principal take ownership but beyond that all steps give an error when the hidden gateway is used in the commands for adding service principal to the gateway and updating the datasource credentials
Hello thanks for all your videos. I have a report stopped refreshing a moth ago the workspace. How can a solve or the reasons a workspace was refreshed a month ago since there we do not have updated data?
Quick question - How will this work in case of dataset refresh failure alert ? Can we configure sending mail to peoples in case refresh fails for any reason ?
totally mind blowing topic 😂 to gain more flexiblity we usually use specific report designer user which is the owner of most of the reports and the corresponding datasets - maybe not the most efficient way but it works fine for us. But, I definitely have to think about the advantages of your way how you are doing it ~~ I am totally amazed by your channel !! thx Adam and Patrick
Hello, i'm actually facing an issue using a Service Principal with /refreshSchedule API call (-Method PATCH). Do you know if it is possible ? It sends me a bad request
Hey Adam and Patrick ! Can you make Video how to Unlock Filter Pane for Report Consumers in Publish to Public Mode. I am not able to find any solution regarding this topic.
Video really helps! Thank you I have a question with my case, I use dynamics 365 online I don't have the option to add a user against the gateway because it's online , it's really not required... How can I do the last step where takeover against service account configuration Could you please help me
@@shivaabhi1900 Is the below reply relevant? I'm wondering the same thing for a data lake source "@tareksalha 11 months ago I know it is late, but to answer the question: we tested this and apparently even for cloud data sources there is a gateway cluster being involved. This one is hidden from the end users, but from power shell you can get its guid. Thus, the same process in the end… 😉"
My only conclusion here is how primitive the administration of the workspaces really is. Even something as simple as looking at the details of the settings someone else did is impossible.
Nice but little fast. Can we have some step by step instruction notes please in description or comments
This should be much simpler :/
These are the types of videos that motivate me to have my end users go watch your other videos. More like this would be great.
I find this to be overkill? Why not create a service account in Azure (non-personal e-mail account) and use that?
Thanks for the video it explains about the on premise data source. But the same is not working when we set up the credentials for azure sql data source.could you please explain the same in your next video as I couldn't find any documentation from Microsoft regarding the cloud data source credentials setup. Thanks
Hi Adam and Patrick! This is such an amazing thing you did there. We usually struggle when we somebody takes over the dataset and forgets to replace the Missing credentials with their own so we only find out when the refreshes are delayed.
A question would be, what happens if After this configuration, someone re-uploads the dataset with changes?? Will this configuration need to be Done Again??? It would be nice if the service retained the Service Principal setup you did there.
Thanks for the AMAZING tip😍
Interested in the answer to this if you ever found out.
Very complex video ... please provide any article on this.
Hi Adam, would the service principal works for SSAS data source on the on-prem data gateway?
Wow!! talk about following some industry standards to mange access to refresh data. This is great, setting this up and managing would be another task all together but its definitely a process to inculcate.
I did all that 3 months ago and believe me it wasn't easy.. although few tickets to microsoft helped figure out... especially the managed service identity.. lets see if you can take over a dataset which is inturn connected to dataflow and refresh it via service principal.. shall we?
Hi ! Did you figure out how to use a managed Identity to refresh a dataset - I am using a managed identity using ADF to trigger a refresh to data in kusto but getting same error as in the video. we dont use gateways ( afaik ) . any idea what needs to be done to get rid of this error ?
I am getting command not recognised error in the same power shell as you are showing.
Can you please help me to resolve the issue. i am using Web as data source and when I am using dataset.Takeover API I am unable to refresh my data source from the refreshes API.
I am getting ErrorCode: DMTS_UsersNotFoundError while running your command and I am tired finding the solution but didn't getting it.
Hi Adam, I understand the Service Principal owning the Dataset and configuring it to use the Data Source via the Gateway. However, what if the Dataset is connecting to Cloud resource. For example, what if it is using a Dataflow. I was unsure if your Geography example covered my answer. While it appears to pull from a URL it is not clear if OAuth2 or API Key authentication is required (question would the privacy setting change when switching from user to service principal?). Could you please clarify how the authentication for the cloud data?
The data source, configured in the gateway, will have a set of hard coded credentials. For the Geography piece, that was anonymous. So that is dependent on what the connector supports. It's not really related to the service principal starting the refresh, or using data sources configured on the gateway.
I know it is late, but to answer the question: we tested this and apparently even for cloud data sources there is a gateway cluster being involved. This one is hidden from the end users, but from power shell you can get its guid. Thus, the same process in the end… 😉
@@tareksalha Hello! Would you mind saying it more? How can we find out the hidden gateway for cloud data source?
@@tareksalha Can you please detail a bit more as i was able to get to the step where service principal take ownership but beyond that all steps give an error when the hidden gateway is used in the commands for adding service principal to the gateway and updating the datasource credentials
Hello thanks for all your videos. I have a report stopped refreshing a moth ago the workspace. How can a solve or the reasons a workspace was refreshed a month ago since there we do not have updated data?
Hi, I have question regarding refreshing the report by using the PowerBI API, is that possible ?
Quick question - How will this work in case of dataset refresh failure alert ? Can we configure sending mail to peoples in case refresh fails for any reason ?
totally mind blowing topic 😂 to gain more flexiblity we usually use specific report designer user which is the owner of most of the reports and the corresponding datasets - maybe not the most efficient way but it works fine for us. But, I definitely have to think about the advantages of your way how you are doing it ~~ I am totally amazed by your channel !! thx Adam and Patrick
Hello, i'm actually facing an issue using a Service Principal with /refreshSchedule API call (-Method PATCH). Do you know if it is possible ? It sends me a bad request
I’ve been try to do this for the last two weeks! Thanks guys!
Hi Adam and Team,
Question is where to give permission, What max permission should give and where? i.e. RBAC or Azure Ad level permission?
Thanks for another great video. Definitely have use cases in mind already and looking forward to testing this out with scheduled refresh enabled.
Hi,
Would this still be limited by 8 daily refreshes for Pro and 48 daily for Premium?
Hey Adam and Patrick ! Can you make Video how to Unlock Filter Pane for Report Consumers in Publish to Public Mode. I am not able to find any solution regarding this topic.
Q: Does this mean I can have my PC off and sheduled refresh would still run?
Hi Adam and Patrick thanks for this video would the gateway also apply if my Datasource is from an azure database?
It should be simpler to do, too much complicated for a simple concept.
Video really helps! Thank you
I have a question with my case, I use dynamics 365 online
I don't have the option to add a user against the gateway because it's online , it's really not required...
How can I do the last step where takeover against service account configuration
Could you please help me
Anyone help me on this
@@shivaabhi1900 Is the below reply relevant? I'm wondering the same thing for a data lake source
"@tareksalha
11 months ago
I know it is late, but to answer the question: we tested this and apparently even for cloud data sources there is a gateway cluster being involved. This one is hidden from the end users, but from power shell you can get its guid. Thus, the same process in the end… 😉"
@@Michael-bof Thanks for your reply. Can you please share any document or anything to resolve this.
With the service principal id ownership, dataset refreshing is failing with data source credentials missing Error.
We can also refresh one single table using this method
Great tips, thanks Adam!
My only conclusion here is how primitive the administration of the workspaces really is. Even something as simple as looking at the details of the settings someone else did is impossible.
It doesn’t look like you can use Service principal with Premium Per user. Hopefully it’s coming soon
I'm not aware of any plans to enable that with Premium Per User.
Microsoft teaches you hard way 😬, before bringing a simpler solution 🙄
Appreciated, thank you for this video 💪👍👏
You are doing good lessons! Please add Russian subtitles to your videos.
You are a Crack!!! Nivel video!!!