Hi, thank you very much for clear instruction. I applied the way in the video to my 120K rows data, but it has get only 500 rows, I could not solve the problem? Do you have any idea for solution? Thanks again.
This solution is not designed for larger dataset due to power automate limitation. You need to seek a different option. Can't you connect to the source directly?
@@KeaPointTechTips Yes I realised, I changed the query to get all data but I cannot copy the output of dataset, browser is frozen, then check there were limitation.... Raw data is in excel
Yes, thanks for the video. Quick question though, if no data is present in power bi to be extracted how to handle that in the flow (in parse json, create item etc..) I would be glad to hear the inputs
Amazing job, you have saved me many hours of R&D and frustration. Can you pls guide on how to copy only those records that do not exist on the SharePoint List? Let's say we have a unique identifier in the dataset for each item to make the comparison.
Get target SharePoint list data in the same Power BI report, then create a compassion report and filter out existing record, you will get a final report of only records that don't exist in the SharePoint, use this flow to create them in SharePoint list.
Thank you so very much for this video! I was able to follow your video without any issues. My next task is to schedule these reports to update every 3 weeks (which I can do no problem), and send any changes from the PowerBI reporting, into the already existing SP List (not creating any new items for existing items on the SP list, but allow for modification to the existing columns). Do you have a video that show that as well? If now, would you mind sharing one on how to accomplish this task?
Hi, I don't have a video on this but you can implement this logic in the power automate flow to check if the record already exists in SharePoint (based on a unique ID) and then update the record in the SharePoint list. Otherwise, create a new entry in the SharePoint list.
@@KeaPointTechTips Hi, this is a Great video thanks. I also would like to be able to update the values in the SharePoint list, but cannot work out how to set up the logic check. Do you have any resources that show how to do this?
When selecting items to be created in the sharepoint list, is it possible to do this with only one selected row instead of all items in the table? For example if I have a power bi report that utilizes an excel spreadsheet for a table visual, but I only want to extract one row of the table to be created as a new item in the sharepoint list that is filtered through a slicer(for example, a single work order item filtered to be assigned in August 2024 to be scheduled). Additionally, I would want the flow to verify that the item being created is not a duplicate of an item already in the sharepoint list. Do you have any recommendations or advice on how this would be implemented? What would need to be changed to the power automate flow and the DAX?
You can connect to the existing SharePoint list in the Power BI, and you can determine what row you will add to the sp list by filtering and checking if it already exists in the SP List from within in Power BI report.
@@KeaPointTechTips I'm developing an integration strategy using Power BI, Power Automate, and SharePoint to manage a large dataset effectively. My project involves an Excel spreadsheet with over 16,000 rows, which I visualize in Power BI through a table visual. I'm looking into selectively adding items-individually or in batches-from this visualized table to a SharePoint list. This includes adding specific work order items based on criteria like creation dates, task names, and requestors. For example, I'd like to click on a row in a Power BI visual, highlight it, and add only that row to the SharePoint list rather than the entire dataset. The table visual in Power BI would also utilize slicers to refine the data further. The selected data in the SharePoint list would then be used in a PowerApps application for scheduling work. My objective is to use SharePoint as a dynamic placeholder to manage data volumes that exceed PowerApps's 2000-line capability. A major challenge is configuring a Power Automate flow that can query the Power BI data when an item is selected, ensuring it is added to SharePoint without creating duplicates. Could you offer any resources/insights or demonstrate how to set up a system like this?
Hi sir, great video.i have one doubt.i have table visual in power bi with around 5300 rows and flow is able to add all those in SP list. but assumr if there is change in some row in powerbi table ,i want to get that row only and update the changes in sharepoint list or when new row is added ,how to add new row in SP list rather than getting all the data again.can you please explain how to achieve this
1000 stars to this guide, congrats! One doubt, i created a recurrence process, every time i run it, will it add only the new lines to sharepoint list or exclude all and create it again?
Lets say - that when setting this flow up - that my SQL Table query does not yet have column values at the time. Can I construct this flow using Mock Data Table - and after it is set up - simply find and replace the Mock Up Table name with the Production Table name? Really good video. Thanks again.
Very good video. But I am getting an error in the Parse JSON part of the flow stating:" It seems the error occurred in the Parse_JSON operation due to expecting an Object but receiving an Array. To fix this, you should review the structure of the data being passed to the Parse_JSON operation. Check if the data being parsed matches the expected object format based on the schema provided in the flow."
@@KeaPointTechTips Also, how do I automate only recently added Power BI data into the SharePoint List? I have created a scheduled refresh as the trigger to automate the Power BI data into the SharePoint List at a specific time, but when the automation happens its automating the full list of Power BI data over again, including the recently added Power BI data. However, I am only trying to automate the recently added Power BI data.
Also, how do I automate only recently added Power BI data into the SharePoint List? I have created a scheduled refresh as the trigger to automate the Power BI data into the SharePoint List at a specific time, but when the automation happens its automating the full list of Power BI data over again, including the recently added Power BI data. However, I am only trying to automate the recently added Power BI data.
Create a separate report tab in Power BI to filter and only show the data you are looking to process. Then use the power automate flow to save data in SP list
You are a STAR! Thank you so much for the guide, saved me all kinds of grief with power automate
Thank you !
Simple and solid explanation. thank you!
Glad you enjoyed it!
Hi, Thank you for the video.
I dont see "First Table rows" variable in Parse Json step. I only see option to download in "Outputs"
Are you connected to a power bi Dataset correctly? Can you run that step and investigate the output in flow?
I get the same thing. I copied the query from DAX like you showed in the video.
Same for me as well
Me too
is there a solution for this Problem?
Hi, thank you very much for clear instruction. I applied the way in the video to my 120K rows data, but it has get only 500 rows, I could not solve the problem? Do you have any idea for solution? Thanks again.
This solution is not designed for larger dataset due to power automate limitation. You need to seek a different option. Can't you connect to the source directly?
@@KeaPointTechTips Yes I realised, I changed the query to get all data but I cannot copy the output of dataset, browser is frozen, then check there were limitation.... Raw data is in excel
Yes, thanks for the video. Quick question though, if no data is present in power bi to be extracted how to handle that in the flow (in parse json, create item etc..) I would be glad to hear the inputs
You can check in the flow if power bi response contains any data.
THANK YOU !!!!!!!!!
You're very welcome! I'm glad you enjoyed the video!
Amazing job, you have saved me many hours of R&D and frustration. Can you pls guide on how to copy only those records that do not exist on the SharePoint List? Let's say we have a unique identifier in the dataset for each item to make the comparison.
Get target SharePoint list data in the same Power BI report, then create a compassion report and filter out existing record, you will get a final report of only records that don't exist in the SharePoint, use this flow to create them in SharePoint list.
Thank you so very much for this video! I was able to follow your video without any issues. My next task is to schedule these reports to update every 3 weeks (which I can do no problem), and send any changes from the PowerBI reporting, into the already existing SP List (not creating any new items for existing items on the SP list, but allow for modification to the existing columns). Do you have a video that show that as well? If now, would you mind sharing one on how to accomplish this task?
Hi,
I don't have a video on this but you can implement this logic in the power automate flow to check if the record already exists in SharePoint (based on a unique ID) and then update the record in the SharePoint list. Otherwise, create a new entry in the SharePoint list.
Were you able to update the SharePoint list without creating a new item?
@@KeaPointTechTips Hi, this is a Great video thanks. I also would like to be able to update the values in the SharePoint list, but cannot work out how to set up the logic check. Do you have any resources that show how to do this?
When selecting items to be created in the sharepoint list, is it possible to do this with only one selected row instead of all items in the table? For example if I have a power bi report that utilizes an excel spreadsheet for a table visual, but I only want to extract one row of the table to be created as a new item in the sharepoint list that is filtered through a slicer(for example, a single work order item filtered to be assigned in August 2024 to be scheduled). Additionally, I would want the flow to verify that the item being created is not a duplicate of an item already in the sharepoint list. Do you have any recommendations or advice on how this would be implemented? What would need to be changed to the power automate flow and the DAX?
You can connect to the existing SharePoint list in the Power BI, and you can determine what row you will add to the sp list by filtering and checking if it already exists in the SP List from within in Power BI report.
@@KeaPointTechTips I'm developing an integration strategy using Power BI, Power Automate, and SharePoint to manage a large dataset effectively. My project involves an Excel spreadsheet with over 16,000 rows, which I visualize in Power BI through a table visual. I'm looking into selectively adding items-individually or in batches-from this visualized table to a SharePoint list. This includes adding specific work order items based on criteria like creation dates, task names, and requestors. For example, I'd like to click on a row in a Power BI visual, highlight it, and add only that row to the SharePoint list rather than the entire dataset. The table visual in Power BI would also utilize slicers to refine the data further.
The selected data in the SharePoint list would then be used in a PowerApps application for scheduling work. My objective is to use SharePoint as a dynamic placeholder to manage data volumes that exceed PowerApps's 2000-line capability. A major challenge is configuring a Power Automate flow that can query the Power BI data when an item is selected, ensuring it is added to SharePoint without creating duplicates. Could you offer any resources/insights or demonstrate how to set up a system like this?
Hi sir, great video.i have one doubt.i have table visual in power bi with around 5300 rows and flow is able to add all those in SP list. but assumr if there is change in some row in powerbi table ,i want to get that row only and update the changes in sharepoint list or when new row is added ,how to add new row in SP list rather than getting all the data again.can you please explain how to achieve this
Please check other comments, I think I have suggested a solution already.
Hi sir
I have got json error expected string instead of array how to solve this
And will this works if data is more than 10k rows????
This won't work if you want to bulk create 10k records in single go because of the Power automate limits.
@@KeaPointTechTips ok sir powerautomate limits thats ok
How to resolve expected string instead of array issue in parse json flow step ?
@@KeaPointTechTips your input is really helpful for me at this time
Actuall some of the columns has blanks
So its causing error
1000 stars to this guide, congrats! One doubt, i created a recurrence process, every time i run it, will it add only the new lines to sharepoint list or exclude all and create it again?
You need to add logic in flow to achieve this.
Lets say - that when setting this flow up - that my SQL Table query does not yet have column values at the time. Can I construct this flow using Mock Data Table - and after it is set up - simply find and replace the Mock Up Table name with the Production Table name? Really good video. Thanks again.
You can always build test connection with dummy table and later change them to production table.
Very good video. But I am getting an error in the Parse JSON part of the flow stating:" It seems the error occurred in the Parse_JSON operation due to expecting an Object but receiving an Array. To fix this, you should review the structure of the data being passed to the Parse_JSON operation. Check if the data being parsed matches the expected object format based on the schema provided in the flow."
You json Schema is not correct. Please re-create schema from the sample output And try again
Thank you, I got through with figuring it out.
I am glad to know it is working for you.
@@KeaPointTechTips Also, how do I automate only recently added Power BI data into the SharePoint List? I have created a scheduled refresh as the trigger to automate the Power BI data into the SharePoint List at a specific time, but when the automation happens its automating the full list of Power BI data over again, including the recently added Power BI data. However, I am only trying to automate the recently added Power BI data.
Also, how do I automate only recently added Power BI data into the SharePoint List? I have created a scheduled refresh as the trigger to automate the Power BI data into the SharePoint List at a specific time, but when the automation happens its automating the full list of Power BI data over again, including the recently added Power BI data. However, I am only trying to automate the recently added Power BI data.
Create a separate report tab in Power BI to filter and only show the data you are looking to process. Then use the power automate flow to save data in SP list
@@KeaPointTechTips is this something you can explain further or demonstrate? There are many people facing this issue and looking for solution. Please