Deployment Pipelines give you more CONTROL (Power BI Premium)
ฝัง
- เผยแพร่เมื่อ 3 มิ.ย. 2020
- With Deployment Pipelines, you can control your application life cycle stages. Keep content in sync at the different stages of your development. Power BI Premium is required.
Documentation:
docs.microsoft.com/power-bi/c...
docs.microsoft.com/power-bi/c...
docs.microsoft.com/power-bi/c...
📢 Become a member: guyinacu.be/membership
*******************
Want to take your Power BI skills to the next level? We have training courses available to help you with your journey.
🎓 Guy in a Cube courses: guyinacu.be/courses
*******************
LET'S CONNECT!
*******************
-- / guyinacube
-- / awsaxton
-- / patrickdba
-- / guyinacube
-- / guyinacube
-- guyinacube.com
**Gear**
🛠 Check out my Tools page - guyinacube.com/tools/
#PowerBI #DeploymentPipelines #GuyInACube - วิทยาศาสตร์และเทคโนโลยี
Pipelines look really slick! This reduces the headache of manually creating dev and prod workspaces and trying to keep track of everything manually! Great work PBI team!
This video is a textbook example of the proper way to make a Power BI video! Bravo!
What a wonderfully well constructed video! Become your instant fan 😊👍 MS is a bit late as Life Cycle Management should have been there from the beginning but a welcome addition.
Amazing, thanks for the quick over! Please keep us posted on the updates :)
Tx for detailed info Adam. The first video on this new feature.
Amazing feature! We’ve been waiting for this for a while..
Great vid! Thanks! Do the additional workspaces needed for the pipeline cost extra or are they included in the price of the existing workspace?
Question on the limitations around excel files: if I have a composite model scenario (using an excel file as an extra data source), will the PBIX report I create utilizing a composite model not properly flow from dev to production?
For dataset refreshes, when we publish from Test --> Production, if we have refreshed the dataset in Test does it publish the refreshed dataset? This would be big as we could re-publish on dev/test, wait for refresh completion, then push it into production, rather than doing a full refresh each time and have users have out-of-date info if Desktop .pbix is out-of-sync.
Does it work with Streaming Datasets, like the type you would use to update real-time dashboards? These are APIs at my organization.
Very thorough! One of my favorite workspace management features in a long long time. I need to adjust what I cover when I do a video on this now, haha.
Is there any possibility to deploy selective contents from a single workspace in TEST stage to multiple workspaces in target stage?
Thanks for the update. Love your work!
I will ultimately have a Paginated Report in my Production App. Any thoughts on where I publish that from/to? Should I publish that straight off to the Production Workspace/App?
I like it! If you assign production workspace first there is no way to work backwards.
somehow the deployment settings of the newly created prod workspace show that I have no datasets? despite having deployed them already?
Does it support monitoring versions history, so i would be able to restore any old version?
This was awesome, thank you so much
Do we have any approval mechanism through email ? for the same . Or a way to notify the managers to review and approve the report ?
Hi Adam,
What if I don't wanna create new by-product workspaces, instead I would like to use my existing dev, test and Prod workspaces?
Someone knows how to automatically change a live report data source when you deploy? in my case it keeps the previous workspace configuration
Is there any way to have a many to one relationship on those pipelines? Eg have one test workspace but multiple production workspaces. In my example I have EU and US workspaces which contain exact copies of the same pbix files, just with different connection strings.
Is RLS get applied between the workspace?
Hi, if we implement the incremental refresh in production workspace and do the development work in dev workspace (without incremental setup) and everytime push the changes from dev to prod, will it impact the incremental setup or we'll have to apply incremental setup again?
Is there a way to deploy only certain items? Right now it seems like gets moved. For example, my Dev workspace has a lot of OTHER things that I may not want to see in a Test or Prod environment. Can I move only the reports and datasets I want to see in Test and Prod?
Do you know if they are planning to add support for Dataset rules for datasets residing outside of the workspace you have assigned? We have a single workspace for our Datasets that all of our report workspaces are pulling from, and it does not allow me to set dataset rules.
Really cool Adam. I am working with a Powerbi consultant as contracter while I do most of the work myself. Leave the hard stuff for him ;-) We always have to be aware of who is developing where. In particular since there a acces limitation for the consultant on our network. I think this will kill all those issues and help us controle our dev - test -deploy proces. Great video.
Adam, how would you do version management?
What happen when I need to add other Origen Data with other conexión and upload and replace the power BI project to workspace? And How can I return back the other version?
Great video. Thanks.
This looks great.
If I restrict membership of the Prod workspace member role, I can limit who can promote something into Production, but they can still push stuff around Dev and Test if they're members of those workspaces member roles? Sounds too simple :D
This is awesome !! Cool.. Impressive..
Can we use existing Dev and UAT workspaces for deployment pipelines?
Great Video and I like the pipelines feature a lot. But what about removing dashboards, reports and datasets. Is this still a manual process by removing the items in test and prod manually as well?
Love your videos guys! Keep em rolling.......... :-)
How about the credentials are different from Dev , UAT n Prod then how can we change those please explain
This looks great!! was wondering if it is possible to change embedded canvas app url based on environment?
When you deploy from Dev to Test, let's say, are the datasets deployed in Test automatically refreshed whenever a new deployment happens?
Can we rename the Test and Prod Premium workspaces ? .. as it creates default ones
Adam, is it not possible to change the connection information if you are using a Power BI dataset in a different workspace? After deploying 4 reports to test that all have separate datasets in a different workspace, the "lightning bolt" dialog box will be empty?
If I have a 17 GB dataset, would it copy the entire dataset to production, or just the metadata of it?
Lightning bold :) 4:58 I can feel that sense of humor:) good job !
Do I need 3 workspaces with premium?
Lovely. Just missing one piece: source control for the pbix file in DEV. I've seen methods using OneDrive and SharePoint -- what do you recommend? I need a process that will allow me to add comments on each version change.
SharePoint is what I do, howevr 3 year later (since I am a bit late to answer lol) you can check the nw Power BI project Feature, can save the repor as a Pbip file, this will divide your report to 2 folders one of them has a Json like format file you can keep for version change
Impressive feature !!
Does the Schedule and RLS will be intact ? Also this means, the "Update App" in the workspace will go off shortly ?
Very nice and great info Adam thanks a lot
How will it work for Paginated reports ?
What if we have already existing Dev, Test and PROD workspace - now we need to setup the Deployment pipeline on those existing workspace - how we can do that. Thanks in Advance
Aint using Deployement pipelines going to take extra space as the same dataset is transfered to each workspace ?
Hi everyone. Thanks for the awesome content Adam, but even if I updated the configuration rules and added data source rules to provide access to QA or Production databases (SQL Server databases on-premise), reports in QA or Production workspaces still access the development database. Namely, data source rules I added do not take affect. Does anyone have a tip for this problem? Regards.
Is postgre sql don’t support deployment pipeline in power bi?
This is cool feature. How does this work with Power ON visual planner?
👍 very helpful
could you confirm, so i build a dashboard and then this deployment pipelines is just changing the data being fed to the dashboard?
Do both workspaces need to be Premium Workspaces?
Thanks You GUYS In CUBE .. It is indeed a great and Informative Video.. I am still curious to know about the data flows and excel files
Is it possible to create more than 2 test environments in deployment pipe lines
I just finished watching one of the dev camp videos and always play those @.75 speed... I jumped into this one at slow speed, and you sound pretty funny in slo-mo! 😂
Thank you for this. I am struggling with how to integrate my dataflows into the process of development and testing. I don't have access to any databases, just dataflows. What do you recommend? Does this warrant a video?
I'm getting this error. What could be the issue ?
"The workspace can be assigned, however, when the workspace is deployed to another stage, items won't be deployed to the next stage.
The workspace contains the following items:
Unsupported report ,Unsupported dataset"
More than 3 environments, can I deploy reports using single pipeline ??
Great vid, as always! :) what SWs do you (and of course Patrick) use to record videos? I guess you have some video editing, screenrecorder, etc... Thanks
Check out guyinacube.com/tools/ and guyinacu.be/streamsetup. Been using the streaming setup more lately to record. Makes it pretty easy. Using Adobe products for editing and post-production.
Awesome!! Full SDLC..
QQ -- Will it work for the report which is using data flow from other workspace?
Yes reports and datasets are covered by this. Regardless of the data sources. Dataflows themselves are not covered by this directly.
Hej!
You forgot to mention that you NEED to have permission to create workspace to be able to use the pipelines. Even after a pipeline are created and have all three WS created you can’t deploy without this permissions.
Feels like a mistake by MS and we hope it will be changed soon!
how can deploy pipeline into already created work spaces? example : i have 3 premium work spaces already created Sales Dev sales QA Sales Prod
Just Wanted to know if any feature exist like if we have more than 100 report to publish from test to prod then can we select all 100 report together in one go or we must do individual select and deploy
Both, you can select each
Is it possible to upgrade an existing workspaces backed up by the premium capacity to utilise the pipeline features?
Yes, but what I really want to know is can you use existing for all 3?
Great overview. But leave the bananas for Patrick 😅
Good video, Adam. Thanks!
Appreciate that James! 👊
Need one help... I have deployed the report using the deployment pipeline.. Have two stages test and production..
I have some changes to be done in power bi pbix.. I have done it and republished it in test ws.. And then deployed to prod.. But post deployment it is showing that dataset don't match
I have a dataset with dynamics CRM and Synapse together. Synapse instances are different for all 3 environments. Is there a way I can push the SQL authentication creds through the pipeline. Currently I sync in the dataset to higher environment and then publish it. Is there a way to automate it
Awesome t-shirt, looks sick!!!
Suppose our team implements a deployment pipeline, but later down the line we change our mind and want to revert back to managing separate workspaces. Is it possible to take the workspaces &/or reports out of the pipelines?
What can be developed, tested..etc ?
Yes, I used Pipelines, We are exploring pushing reports with a different type of data sources.
WOW, love it!
Awesome! 👊
I appreciate the video and the high production quality of it. My only feedback is that I would have loved to see the full diffing functionality. Or is there nothing more to it?
I have a development background and I need help to understand this.
Why did MSFT create such a feature? This is completely normal CI/CD pipeline stuff. They already have 2 such products. There was no need for this. It is such a basic thing and of course they managed to do it differently from all the rest of the SDLC.
Again, high quality production, and I can see why there would be enthusiasm for such a basic and needed feature.
What about using different data source credentials between workspaces, as in the scenario where a developer does not have access to full production data; can this be handled by pipeline rules / parameters or something else?
this is all in PBI service so credentials should be passed via stored credentials configured in the gateway, not individual files. I would imagine this should work if properly configured
whoa! MSFT invested in a new cool lego logo and microphone :)
What screen recording software do you use?
1) Do Apps deploy from Dev to Test to Prod? 2) What can my Pro users do with a PPU workspace?
Great! Can we deploy Test to multiple Prod workspaces. For my case, we need to maintain one dev report, but multiple Production env (one for each client). The only difference is the underlying database name.
Hello I'm using Azure Analisys Services as the datasource of my dashboards (Live Connection) and I have these databases (TabularDev, TabularQA and TabularProd) when I add the rules to change the database for the specific environments in the pipeline it doesn't work, Can someone please tell me what am i doing wrong?
This looks great. But I have a question, I want to deploy a PBIT that when pipelined to a workspace, I want it to automatically link up to a specific database/datasource, save it as a PBIX file and when opened by a user, it opens as that PBIX file with all custom settings working as expected.
Any ideas? Any sites I can look at to make this happen?
Hi "Guys in a Cube". Thank you for this amazing channel. I have a question about the pipeline. I have two series of changes. Both these series are in the test now. But one of them has been tested and ready to deploy to Prod. How can I use pipeline to deploy just one of the changes to Prod and keep the other one in the test?
This is great. We were looking into how to do this programmatically and this is much better. Does this work with incremental refresh?
It does not support incremental refresh datasets, which makes me very sad. :-(
@@micahdail I had a feeling. Incremental is amazing but still not enterprise ready. We have problems with it constantly.
Yet :) baby steps. It is a nice feature for sure. I know the team is working on a lot of enhancements.
@@GuyInACube Great to hear!
Is it possible to use deployment rules for altering which Power BI dataset a report connects to as it moves through the stages? I thought those connections were supposed to move automatically but they don't. I had a report connected to the shared dataset in the dev workspace, deployed to production, then when I looked at lineage view the production report was trying to connect to the dataset in the dev workspace and it was causing all sorts of permissions issues.
Excellent video, but a question -- what happens if you need to revert? That is, you need to take the version in Prod and move it back to Dev for an emergency patch? When we attempt to do that we get the Prod setting for the Direct Query dataset, and we want it to point to the Dev database since we're in Dev. We tried copying back, but the dataset kept the Prod settings. With a different source data table it crashed the report and we were unable to fix the version for a re-release.
How do you take a Prod version and bring it back (granted, only needed in a pinch) to Dev and get the Dev settings back onto its Dataset?
Nice video. What if we have more than 3 environments- dev, qa, uat and prod?
Then you need to new-look at your process as seems overly complicated. If it is that technical you should have the skills to manage via 3rd party or self built tools either way something not right
All good
Hi Adam, awesome job and videos, I'm a fan!
I'm trying to do the same thing with paginated reports using PowerBI Report builder. The problem is that there is no dataset when dealing with paginated reports! I can't change the sources! So, is there a way to use pipelines in a paginated report usecase?
set up the data source in the query as a parameter. then set a rule in each workspace which parameter to use
Does it work for Paginated Reports?
No it does not.
it will be good if we just select a report from the workspace to work on instead of copying everything to start with. I have over 20 reports that are in production. i would like to use the pipeline for a new report to be done
Hi Adam - please update this video or its description to mention that these features displayed by you are no longer available / have been updated by the Microsoft team.
Man , that's beautiful, we can focus on PBI only !!!
When the pipeline clones the tiles in the dashboards, does it break the link in the tile? If this is using the same API as in this documentation, then I would assume you would have to go back in a recreate the links and all the tiles???? docs.microsoft.com/en-us/rest/api/power-bi/dashboards/clonetileingroup
I'm sad that deployment pipelines are a premium feature. Most of my employer's customers are too small to consider Power BI Premium as an option as it is too expensive for them.
Coincidentally, I set up a whole deployment pipeline in azure devops just 3 weeks ago. For small teams devops is completely free and no premium capacity is necessary. You may use that instead 🙂
tareksalha thanks for this! I’ll look into Devops to create a pipeline.
@@tareksalha Any good videos to showcase this?
@@tareksalha can you show us how you did it? Thank you in advance
@@mruniversemrwhite333 hi guys, sorry, missed the other question. this is a good start: community.powerbi.com/t5/Community-Blog/PowerBI-CICD-using-Azure-DevOps/ba-p/769244
Hi Folks, I have PBI Pro environment and I have created my own workspace, while assigning my workspace to Deployment pipeline, I’m facing error as “We couldn’t find any workspaces for you to assign” Is anyone faced similar error? Or anything from Tenant settings need to enable to get rid of this error?
The workspace needs to be assigned to a Premium capacity. This is discussed in the video and in the documentation
Not clear how to start with a production workspace and have it create a test and dev in reverse. Says it possible, is it?
I know it says its possible. I didn't try that approach though. Will give it a whirl and verify. It's the only time you can go backwards.
@@GuyInACube found it. Ellipsis on the stage has an option to publish to previous stage. Works great!
thanks for video. Now i have already Production and Acceptance classic work spaces , if i would like to create pipeline what would be the way? My Assumption is
1.Upgrade Production classic work space to new work space.
2 Use Assign new production work space and create pipeline with Test and Production stages.
3.Now manually deploy Acceptance reports to Test stage
Is this is how i should follow? could you please help me
thanks in advance