Why you should look at Azure Synapse Analytics!

แชร์
ฝัง
  • เผยแพร่เมื่อ 25 ต.ค. 2024

ความคิดเห็น • 101

  • @Jonesc0705
    @Jonesc0705 2 ปีที่แล้ว +91

    I’d like to see a “data solution in 10 minutes” built in Synapse. Would be really powerful if that included SQL and Python to demonstrate the flexibility.

    • @daddogsdata
      @daddogsdata 2 ปีที่แล้ว

      Great idea! Please!!

    • @guimatheus92
      @guimatheus92 2 ปีที่แล้ว

      Yes, please!

    • @hendrik-stack22
      @hendrik-stack22 2 ปีที่แล้ว

      On the one hand this format could cover topics like Azure Synapse in conjunction with Power BI and on the other hand Synapse with SQL/Python/PySpark etc.
      I would be really interested in this.
      Also, do you recommend other youtube channels for Azure Synapse? I think it could be hard to keep up-to-date with the latest updates in Power BI AND Azure Synapse.

    • @heshamh96
      @heshamh96 2 ปีที่แล้ว +1

      If u ever found it ... Please tag me

    • @akthar3
      @akthar3 2 ปีที่แล้ว +3

      I dont think azure synapse is a magic wand (correct me). All I understand is that it is an ETL and orchestration tool and more . You still need to do that development work!

  • @Real28
    @Real28 2 ปีที่แล้ว +1

    I JUST got access to our Azure instance Friday and was starting to look for resources to watch. Then this video comes up.
    You guys are the best and your timing is _impeccable_ .

  • @pawelpotasinski9092
    @pawelpotasinski9092 2 ปีที่แล้ว +3

    Love it! Really happy to see you guys recording this series. Looks like it's going to be one of these "must see on Azure Synapse" materials we will share with the community!

  • @SamuelMohammedOmer
    @SamuelMohammedOmer 2 ปีที่แล้ว +4

    We are moving to ASA recently and couldn't be happier. I hope you guys will have more vids on it in the future.

    • @GuyInACube
      @GuyInACube  2 ปีที่แล้ว +3

      Great to hear! The plan is to drop videos on Tuesdays going forward.

  • @alfredsfutterkiste7534
    @alfredsfutterkiste7534 2 ปีที่แล้ว +1

    So happy you guys are branching out to Synapse! Very much looking forward to more videos with the GiaC production quality on this topic!

  • @karthi-h2y
    @karthi-h2y 2 ปีที่แล้ว

    Glad that you are going to do a detailed series on Azure Synapse. I just joined Microsoft and i have a opportunity to work on Azure Synapse and your detailed explanation will surely help me

  • @antoniocolombo7204
    @antoniocolombo7204 2 ปีที่แล้ว +7

    In brief, as per my understanding:
    - Power BI provides strong ETL with Power Query and even data modeling. Moreover Power BI golden rule is to use a star schema.
    - ASA for sure provides the all the tools for datawarehose while lacks visulization features as far as I know. For DW, PBI star schema (e.g. 1:n dim to fact relashionship) is not striclty a must
    Moreover, because of the tons connector and modeling capabilities available in PBI, it can be used to pull and shape data from existing data marts and provide "enterprise" solutions just within PBI
    So what is/are the trigger(s) point(s) that suggest to move from pure PBI solution to ASA+PBI?
    I know, depends... ;-))))))))))

    • @hazmatsuiter
      @hazmatsuiter 2 ปีที่แล้ว

      Doing ETL in Power BI is great if you only need to load to Power BI, if you need to get that data anywhere else it is pretty poor (Dataflows can be created to load to Dataverse tables but that also has its own limitations; Dataverse also has an Azure Synapse Link feature)

    • @antongerasimov2298
      @antongerasimov2298 2 ปีที่แล้ว

      Etl in power bi is very simple. If you want to be more powerful you should look at synapse

  • @ahmadsawal2956
    @ahmadsawal2956 2 ปีที่แล้ว +1

    Yes Please, we need detailed videos about Synapse with databriks, power bi etc. all the Azure data services please

    • @GuyInACube
      @GuyInACube  2 ปีที่แล้ว +1

      Just starting the journey. Looking to get the data journey to make sense and looking at the solution instead of the individual silos.

  • @jitendrabisht6295
    @jitendrabisht6295 2 ปีที่แล้ว +2

    I was waiting for this video.👍 Great work

    • @GuyInACube
      @GuyInACube  2 ปีที่แล้ว

      Woot! Appreciate that! 👊

  • @nclsduran
    @nclsduran 2 ปีที่แล้ว

    I would LOVE you explain spark! The way you explain the topics are great!!

  • @jayopachecoea
    @jayopachecoea 8 หลายเดือนก่อน

    Ayer vi un vídeo de ustedes, y hoy los busqué para que me expliquen Azure Synapse Analytics, y seguiré así porque explican bien. ¡Suscrito!

  • @prawnyowl8909
    @prawnyowl8909 2 ปีที่แล้ว +5

    Is there a good YT channel for learning Synapse, like Guy in a Cube? Where do I start?

    • @GuyInACube
      @GuyInACube  2 ปีที่แล้ว +2

      The plan is Guy in a Cube :) just getting started and will continue this journey. 👊

    • @pawelpotasinski9092
      @pawelpotasinski9092 2 ปีที่แล้ว

      Besides Guy in a Cube (love you guys!) you can check these resources to learn Azure Synapse:
      - Azure Synapse Analytics TH-cam channel (see the Essentials playlist there): aka.ms/SynapseTH-cam
      - The Get Started in 60 Minutes video: aka.ms/SynapseGetStarted
      - Azure Synapse Analytics Toolkit (a set of documents for quick start with different aspects of Azure Synapse): aka.ms/SynapseToolkit
      - TH-cam channel of Data Toboggan community events (focused on Azure Synapse): th-cam.com/users/DataToboggan
      - Synapse Practitioner site (lots of free online learning paths): aka.ms/SynapsePractitioner
      - Learning paths on Microsoft Learn site: aka.ms/SynapseLearningPaths
      And, of course, stay tuned for more awesome Azure Synapse videos from Guy in a Cube ;-)

  • @KahanDataSolutions
    @KahanDataSolutions 2 ปีที่แล้ว

    Really helpful overview. For some reason I always assumed Synapse was just Azure's cloud database offering - didn't realize it was all of these other concepts too. Thank you!

  • @joeseroski1095
    @joeseroski1095 2 ปีที่แล้ว

    Love this. This is the content I'm looking for as I take the next step in my Power BI learning and my data journey.

  • @sbksai7142
    @sbksai7142 2 ปีที่แล้ว +1

    1) Major drawbacks of Spark Pool in Synapse vs Data Bricks and vice versa? Which is better? When we are doing POC initially to evaluate Spark pool in Synapse, we have observed lot of drawbacks when compared to Data bricks. I would love hear from you with all the recent updates, can Spark pool perform much beyond than Data bricks? If yes on what basis?
    2) Why not Azure Purview in Synpase? We can do governance directly there itself instead of a separate service? Any reason for making it separate?
    3) One major drawback I observed is, sql pool can't support three part naming and we need to create separate schemas in the same sql pool to differentiate instead of creating different sql pool which is a costly operation. But it all together doesn't correlate with the traditional EDW modeling we do like we keep separate staging, logging, edw databases etc.
    4) Why can't we delete duplicates direcly querying CTE pointing to Original table if the sharding pattern is other than Hash? We have alternatives to perform this task. But want to know the reason for why can't we directly delete using CTE?
    5) Any concept of queue while submitting Spark jobs in Spark Pool? How much time will it take to spin up the cluster and run the jobs that are in queue? Comparison with data bricks make us learn better.
    Please help us in letting know the above queries. Will post further questions once they arise.

  • @KaterynaYakubovska
    @KaterynaYakubovska 2 ปีที่แล้ว

    Great video! Want to know more about Synapse!!

  • @Shadeth135
    @Shadeth135 2 ปีที่แล้ว

    Subbed in the hopes of synapse analytics content! Keen to see it in action, the whole process from ingestion to transformation to power bi. Would love some demos, touching on the main functionalities.

  • @joshash5944
    @joshash5944 2 ปีที่แล้ว +4

    The dedicated sql pool in synapse can get very expensive. If your data volumes aren't in the terabyte range then you probably don't need a distributed architecture like synapse. I doubt the tooling or development experience in synapse would be a reason for any organisation to use it... azure sql + data factory gives you the same things
    The distributed nature of synapse is the whole reason it exists. This isn't a technology designed for 10GB databases :)

    • @jbonomo
      @jbonomo 2 ปีที่แล้ว +2

      Glad to see someone say this. So much hype around Synapse but it is not cost effective for small businesses without TBs of data

    • @pawelpotasinski9092
      @pawelpotasinski9092 2 ปีที่แล้ว

      @@jbonomo have you tried serverless SQL pool in Azure Synapse? I think the combination of this engine and Power BI can meet the requirements for small business analytical use cases when data is not that large and should not drain the budget. Synapse is not a single engine (right now there are 4 of them - besides dedicated SQL pools also: serverless SQL pools, Spark and Data Explorer - all addressing different use cases and having different pricing models).

  • @chrisretsin7068
    @chrisretsin7068 2 ปีที่แล้ว +1

    Great videos, as always. I have a couple of question regarding lake house. 1/ Our IT department is moving the analytical data to the Azure cloud. Upon this move they want to add a non-azure product for data virtualization. Does this make sense? What are the azure possibilities here? 2/ what about erroneous data in the data lake, how the identify the erroneous data, correct it and restart the process without the erroneous data 3/ what about showing data in reports containing enough data in order to avoid possibility to identify the source

  • @ameersuhelkhan4398
    @ameersuhelkhan4398 2 ปีที่แล้ว

    Loved the new intro and UI🔥🔥 #Bananas!

  • @CRDPARTH
    @CRDPARTH 2 ปีที่แล้ว

    You guys are amazing !! Crisp information.

  • @egorshiyanov1206
    @egorshiyanov1206 2 ปีที่แล้ว

    Guys, you are amazing! Or Insane Amazing I should say! Great intro and presentation of ASA! Keep up the good work 👍
    Love your channel!

  • @cooky123
    @cooky123 2 ปีที่แล้ว

    I'd like to know more about when to use Synapse Analytics vs DataBricks

  • @samanthapikus2134
    @samanthapikus2134 ปีที่แล้ว

    Hellooooo... Love your videos... Always so filled with the right kind of Energy. You mentioned data orchestration and learning the clicks... What does that mean?...How do I start going from Power BI analyst to using Synapse and become more of a data engineer?

  • @marlucaplus
    @marlucaplus 2 ปีที่แล้ว +2

    Amazing video guys!
    It would be nice to know the difference between the power bi in synapse and the regular one. what can I do in synapse and what I can't. and of course why would I use the one in synapse...

  • @dan7582
    @dan7582 ปีที่แล้ว +1

    Does you guys have some sort of commercial relationship with Microsoft and Azure? If yes you probably should make a disclaimer at the beginning of the video.

  • @ricmmf
    @ricmmf 2 ปีที่แล้ว

    I come from the tradicional DW / BI and i'd love a session that would show the "state of the art", this is, ok, i have a DW on synapse, i need to pick these log times from machines to do some analysis, and some Excel files to do another job, and so kind of seeing, by example, all (or most) parts of synapse working and connecting together...

  • @brianpclab
    @brianpclab 2 ปีที่แล้ว

    I did a POC attempting to connect a Power BI Dataflow to a partitioned ADLS Gen 2. Dataflow connector would not work, Then created a database and CETAS table in serverless SQL. Using Azure SQL connector works but the issue was that if you have partitions like puiYear=2022/puMonth=05/puDay=03 when you append the Gen 2 storage with another days worth of data it will never be seen in Power BI nor in SSMS. Finally if you use views instead of CETAS tables, when you append additional days to your partition all you have to do is refresh the DataFrame and DataSet and everything is properly refreshed. The appended data also shows up right away if you use SSMS to query the view. Problem is that this is NOT documented anywhere that I can find. Would really appreciate it if you could give us best practices for using partitioned Gen 2 storage with Power BI. I am looking for confirmation that this is the recommended method and that we will not have issues down the road,

  • @houstonho4552
    @houstonho4552 2 ปีที่แล้ว

    I am having 2 projects on Synapse. The first one is extracting data from Dynamics AX 2012 on-premises SQL into synapse, trasnform the data into star-schema in Synapse, which being used on Power BI (BI report maintained by IT developers).
    The second one is extracting data from both Dynamics 365 Customer Engagement and Finance Operations thru the Azure Synapse Link (Data Lake connector), trasnform the data into star-schema in Synapse, then populate into Azure Analysis Service and into Power BI (maintained by >100 business users and self service thru ASA).
    I believe each component has a bit overlapping featurs however they have different target audience, different technology at the back, and different level of user friendiness. In fact, i can't find an official doc to differentiate them. It would be great if you could share you point of view. Thanks.

  • @TrevorMatthews
    @TrevorMatthews 2 ปีที่แล้ว

    It'd be nice if there was a more affordable tier to explore Synapse. I was just looking on the Azure pricing calculator and looks like the cheapest monthly fee is a couple thousand dollars which makes it pretty tough to get much hands on exposure.

  • @CalvinPuah
    @CalvinPuah 2 ปีที่แล้ว

    now that you've mentioned it.... Power BI with Azure Synapse, managed through DevOps and CI/CD would be a good start :P If possible

  • @ncbshiva
    @ncbshiva 2 ปีที่แล้ว +4

    I want to know the difference between dedicate pool and serverless in Azure Synapse Analytics.

    • @GuyInACube
      @GuyInACube  2 ปีที่แล้ว +5

      Stay tuned 👊

  • @bunty2577
    @bunty2577 2 ปีที่แล้ว

    I like to see a use case of predictive analytics that gives me insights on how to get started on this tool and bring the product to finish line... from raw data to end result in power bi

  • @egbertdejong6377
    @egbertdejong6377 2 ปีที่แล้ว

    Looking forward to this series. Hope using Databricks vs Synapse is also covered in a way.

  • @prasadparab5638
    @prasadparab5638 ปีที่แล้ว

    Thanks for the valuable insights... can we have high level sample end to end solution done using Azure synapse with its integration with Power BI
    Thanks

  • @priyankaadhainge8360
    @priyankaadhainge8360 2 ปีที่แล้ว

    In Azure Synapse Analytics, can we write back to the database using power apps from power bi dashboard.

  • @antongerasimov2298
    @antongerasimov2298 2 ปีที่แล้ว +2

    let's start to do videos about Synapse!

  • @Baldur1005
    @Baldur1005 2 ปีที่แล้ว

    I guess the problem (and oportunity) with Azure BI platform is that cost is often variable which discourage learning and experimentation from power users - something similar to Power BI Premium would be great which would lead to greater tool adoption

  • @Wtreadway0129
    @Wtreadway0129 2 ปีที่แล้ว +1

    I’d love to know about partitions on the large data tables.

  • @davidwilliams8527
    @davidwilliams8527 2 ปีที่แล้ว

    When working with Azure Synapse Analytics, is it still best practice to work in different environments for DEV -> TEST -> PROD? Do DBA's still have a role in helping to promote code between those different environments?
    Also, if I use Azure Synapse, is there a need to use Azure Data Factory or Azure Data Lake independently, or is that all bundles into Synapse and does Synapse "replace" the independent use of those other products?

  • @powerbiprodesigner7949
    @powerbiprodesigner7949 2 ปีที่แล้ว

    Hi. On the SAAS platform like the Azure SQL MI / synapse, the debug mode is not available. this is making it very difficult to debug stored procedures which sometimes can get very complicated. We have been told by the MS Support team that the components required for debug are not available in the SAAS platform. I had to set up a VM, install SQL Developer Edition and do my work. Once the SP was ok, I deployed it to Azure SQL MI. Does the ASA overcome this limitation ?

  • @Griffindor21
    @Griffindor21 ปีที่แล้ว

    So does it actually do what it says, analytics? Is it the same as SAS Viya where you can do exploratory and predictive analytics?

  • @vkp1310
    @vkp1310 2 ปีที่แล้ว

    Hi Guys, I manage a IT Data systems and currently we use the traditional methods of ETL/ELT(ADF) and then use Azure SQL to process and store the data. How easy it is for me to move from this to AZURE synapse? Is it worth the transformation or this needs to be setup from the scratch. Thank you. VKP

  • @fr1sket363
    @fr1sket363 2 ปีที่แล้ว

    Thanks for the video, Adam your mic sounds like it's clipping a little 😅.

  • @riddlex
    @riddlex 2 ปีที่แล้ว

    I'm a Data Analyst with knowledge in SQL, Python and Excel. I want to get started with Azure Analytics. So, Azure Synapse would be enough for me or do I need something alongside that?

  • @Phoenixspin
    @Phoenixspin 2 ปีที่แล้ว

    I listened to this but I have no idea of whether or how I could use this as a normal mortal user.

  • @Mim_BI
    @Mim_BI 2 ปีที่แล้ว +3

    I know why you are doing this, but I hope you keep the message very clear, PowerBI is still an independent BI tool and works with any platform not only synapse

  • @josuelabaut9969
    @josuelabaut9969 2 ปีที่แล้ว

    CI/CD with synapse studio. Can we use synapse studio with one existing Data Factory project (Migration)

  • @anisnaim4947
    @anisnaim4947 2 ปีที่แล้ว

    Hello Will you more video related to this topic and maybe DP-500 ?

  • @PicaPauDiablo1
    @PicaPauDiablo1 2 ปีที่แล้ว

    Synapse Analytics is definitely amazing. I was thinking about a good way to visualize Delta changes . B/c of all the fields and multiple versions, there's quite a bit of possibility.

  • @vishnumuthyaboina7546
    @vishnumuthyaboina7546 2 ปีที่แล้ว +1

    I don't have Azure cloud experience can I directly jump in and learn ASA from scratch(including basics of Azure)

    • @GuyInACube
      @GuyInACube  2 ปีที่แล้ว

      It will require a few clicks and an Azure Subscription. Our goal is to help you in that journey with getting started and moving beyond.

  • @jessegorteronazure7224
    @jessegorteronazure7224 2 ปีที่แล้ว

    whats your vision on large datamodels that do not fit in power bi? direct query to synapse sometimes sends strange sql queries that don't perform either on large datasets +1 billion rows

  • @FajardoCtba
    @FajardoCtba 2 ปีที่แล้ว

    How can I compare Synapse Analytics to AAS and SSAS. Can I use DAX? Does it has a visual diagram? It leverages column store? Does it has modern data sources with M code? How it performs?

  • @rudroroy1054
    @rudroroy1054 2 ปีที่แล้ว

    So Synapse integrates ADL, ADF, SQL WH/Spark & Power BI service. Can we use other data storage services like MySQL Managed instances and PostgreSQL?

    • @the_invisible__
      @the_invisible__ 2 ปีที่แล้ว

      Yup....You can use one of the Cosmos DB API's of MySQL, Postgres

  • @davidriffey6500
    @davidriffey6500 2 ปีที่แล้ว

    Could you use Synapse for a asset management database in the Microsoft environment or is there something else?

  • @McTwistedTwisties
    @McTwistedTwisties 2 ปีที่แล้ว

    How does this differ from Azure Data Factory and can you have ingress or egress with it?

  • @AlvinRyellPrada
    @AlvinRyellPrada 2 ปีที่แล้ว

    Is it possible to cover Azure Machine Learning please?

  • @powerbiprodesigner7949
    @powerbiprodesigner7949 2 ปีที่แล้ว

    Hi. What I have read is that Azure Synapse Analytics (the MPP bit) has big advantages once the data reaches ~ 1tb in size. Else it is not cost efficient. Is this true ?

  • @YesAG
    @YesAG 2 ปีที่แล้ว

    would you outline a use case to migrate from DB2 to Synapse vs MI

  • @mauriziofaini9252
    @mauriziofaini9252 2 ปีที่แล้ว

    I wanna know more! YES!!!!!

  • @vikastangudu712
    @vikastangudu712 6 หลายเดือนก่อน

    Energy is awesome!

  • @kennylee1862
    @kennylee1862 2 ปีที่แล้ว

    How do you migrate from an on prem sql data warehouse to Synapse?

  • @kellimckee9121
    @kellimckee9121 2 ปีที่แล้ว

    Is Azure Synapse Analytics secure for GCC? My agency has been waiting for a while. 😉

  • @rafalg8575
    @rafalg8575 2 ปีที่แล้ว

    Keen to learn more 😀

  • @rachwalskimarcin
    @rachwalskimarcin 2 ปีที่แล้ว

    Why costs are so high?

  • @adanielmacedo
    @adanielmacedo 2 ปีที่แล้ว

    Hi guys thanks for your videos, you are amazing... About Synapse, where can I get a free way for testing, with the a Azure account, you pay for Data Factory for example. Best wishes 😃

  • @akthar3
    @akthar3 2 ปีที่แล้ว

    is azure synapse as good (comfortable to use) as sql server query analyser/management studio ? or not yet ?

  • @g.michaelaguirre8913
    @g.michaelaguirre8913 2 ปีที่แล้ว +1

    1) Migration. e.g. migrating on prem SQL data and SSIS packages (in bulk)
    2) Homogenizing SQL & Power BI w/ ML libraries

  • @kopalsrivastava222
    @kopalsrivastava222 ปีที่แล้ว

    more use cases on Azure Synapse Real-time Analytics

  • @josuelabaut9969
    @josuelabaut9969 2 ปีที่แล้ว

    can somebody recommend me a resource to learn python oriented to ETL/ELT data manipulation in notebooks? (synapse studio)

  • @matthiask4602
    @matthiask4602 2 ปีที่แล้ว

    I like the term "power house" . I would love to see a small usecase, so I can grasp the usefulness for my data

  • @jakobs2347
    @jakobs2347 2 ปีที่แล้ว

    I think it is strawberries…

  • @whowho2745
    @whowho2745 8 หลายเดือนก่อน

    why "yo..."?

    • @GuyInACube
      @GuyInACube  8 หลายเดือนก่อน

      Why not?

    • @whowho2745
      @whowho2745 8 หลายเดือนก่อน

      @@GuyInACube it is lame.

  • @FajardoCtba
    @FajardoCtba 2 ปีที่แล้ว +1

    How it compares to Snowflake?

    • @ericmclaren463
      @ericmclaren463 2 ปีที่แล้ว

      snowflake is better .. move cost effective.

  • @ericmclaren463
    @ericmclaren463 2 ปีที่แล้ว

    I do not recommend Azure synapse. When MS renames a product there is a reason why!

  • @sbdyelse
    @sbdyelse 2 ปีที่แล้ว +1

    Enough of all this talking , you know what we like you to do … so why not doing it this time ? Huh 🤔

  • @iiiiii-w8h
    @iiiiii-w8h 2 ปีที่แล้ว

    It's so frustrating to be subscribed to this channel. I only know some Power BI... and like what the fuck is spark? I really would like to understand the things you guys talk about on most of your videos but is way over my credentials.

    • @dezcraft_dev
      @dezcraft_dev 2 ปีที่แล้ว

      Hey Ivan. I was in the same boat as you a few years back. Guy In a Cube is great because they have LOTS of content for beginners (look at their "Getting Started with Power BI" playlist). But I promise if you keep watching the new content and do some google searching on the side as you go, you will eventually see how powerful each one of their videos is. From one PBI guy to another