Spark Tutorial in Microsoft Fabric (3.5 HOURS!)

แชร์
ฝัง
  • เผยแพร่เมื่อ 29 ธ.ค. 2024

ความคิดเห็น •

  • @LearnMicrosoftFabric
    @LearnMicrosoftFabric  11 หลายเดือนก่อน +6

    Hi all, I've launched a free Fabric learning community, join and ask me anything in there! www.skool.com/microsoft-fabric

  • @rasmusandreasson1548
    @rasmusandreasson1548 ปีที่แล้ว +8

    Just started using Fabrics, you are a savier, please do not stop doing this kind of content! Great Work!

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  ปีที่แล้ว

      Welcome to the party - great to have you on board :) taking a short break at the moment but will be back very soon!!

  • @christopherpfeifer9772
    @christopherpfeifer9772 9 หลายเดือนก่อน +2

    Completed thru day 7, everything works well. At my age (62) I have given up trying to memorize coding syntax, downloading your "learning" notebooks allows me to build a library of coding syntax. This allow me to spend my time learning "what" I need to do, then using the library examples to figure out the "how."

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  9 หลายเดือนก่อน +1

      Great job Christopher, that's a wise strategy! Syntax you can always look up, but learning how to problem solve is the most important thing 👍

  • @LearnMicrosoftFabric
    @LearnMicrosoftFabric  ปีที่แล้ว +1

    Please like and share with friends/ colleagues if you find this 3.5 hour tutorial useful!
    Also, I have uploaded all Fabric Notebooks to my GItHub (link in description above), to get the full learning experience, I recommend you:
    1. Download the Notebooks and sample datasets.
    2. To import a notebook into your Fabric Workspace, go to Workspace homepage, click on New > Import Notebook (at bottom of list).
    3. Run the code in your notebook as you watch the specific tutorial, and explore extensions to the notebook, using the documentation (also linked in the GitHub readme file).
    Enjoy!!! 😀

  • @AdrianMcGavock
    @AdrianMcGavock 9 หลายเดือนก่อน +1

    what a FANTASTIC vid... really enjoying your series, please keep them coming as you're putting out much higher quality content than anyone else ⭐

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  9 หลายเดือนก่อน +1

      Glad you enjoyed! Thanks for your kind comments, lots of other great people creating content too though 🙌🏽

    • @AdrianMcGavock
      @AdrianMcGavock 9 หลายเดือนก่อน

      @@LearnMicrosoftFabric good to hear, can only comment from what I've experienced... who else do you recommend for jargon-free enlightenment 🤔?

  • @ostrich97
    @ostrich97 ปีที่แล้ว +1

    Just wanted to let you know you are doing a great job. Hopefully you will get recognized properly.

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  ปีที่แล้ว +1

      Hey thanks for watching and thanks a lot for your very kind words, I truly appreciate it.

  • @tea0819
    @tea0819 11 หลายเดือนก่อน +1

    Great Job on this Series! Enjoyed watching it! Keep up the great work!!!

  • @PatrickBateman12420
    @PatrickBateman12420 10 หลายเดือนก่อน +1

    You stopped your consulting job to focus 100% on teaching Fabric?
    Wow, you're convinced about Fabric. Glad to hear!

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  10 หลายเดือนก่อน +3

      Yes I did do that, I'm all-in on fabric! 🙌

  • @aslakjonhaugen3004
    @aslakjonhaugen3004 ปีที่แล้ว +1

    Fantastic video! 🤩 Please continue with this amazing work! 👌

  • @Karenshow
    @Karenshow ปีที่แล้ว +1

    I absolutely love your videos. Please keep making them.

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  ปีที่แล้ว +1

      thanks for watching and for your lovely comment! don’t worry, if people still watch them and find them useful, I’ll keep making them!

  • @aslakjonhaugen3004
    @aslakjonhaugen3004 ปีที่แล้ว +2

    Yes please! :-) Please make a deep dive into machine learning and use of AI in Fabric-video! :-)

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  ปีที่แล้ว +2

      Fabric is the platform for the era of AI, so I’ll definitely be doing lots of AI/ML stuff soon!

  • @shafa7668
    @shafa7668 ปีที่แล้ว

    Really nice vedio mate. I have not watched the whole of it yet, but will do soon at one go.

  • @timmole-w5r
    @timmole-w5r 4 หลายเดือนก่อน

    Awesome tutorial - thanks!

  • @lanac9348
    @lanac9348 ปีที่แล้ว

    This is really interesting! glad I found your channel 😊Keep making more or them, your videos are easy to understand, not very basic but not difficult just in the perfect spot 😊 Your videos helped me with my MS Fabric learning journey and more 😊 next time show us how to pass the Fabric exam certifications 😊

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  ปีที่แล้ว

      Hey Lana, thanks for watching, and I'm glad you're finding it interesting! Definitely a lot more videos in the pipeline, just going through a busy period with work. And yes the Fabric exam certifications is definitely something I'll be covering in the future.

  • @peternguynguyen5208
    @peternguynguyen5208 ปีที่แล้ว

    Love these videos, thank you

  • @matheusmartinsmoreno
    @matheusmartinsmoreno ปีที่แล้ว

    Amazing. Thank you so much for this.

  • @ankittripathi8305
    @ankittripathi8305 3 หลายเดือนก่อน

    Great video

  • @OnkelMM
    @OnkelMM 3 หลายเดือนก่อน

    Good stuff

  • @otmaneababou4176
    @otmaneababou4176 10 หลายเดือนก่อน

    Thank u will needahm, awesome content. Could u tell me where are now the learning materials for your tutorial? didn't find them on github

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  10 หลายเดือนก่อน

      Hey thanks for watching! The materials/ notebooks should all still be available here... let me know if you cannot see them! github.com/LearnMicrosoftFabric/TH-cam/tree/main/learn_spark_in_fabric

  • @giorgikalandadze6172
    @giorgikalandadze6172 9 หลายเดือนก่อน

    So I need to learn Python before I start with Spark? or I could go easily with SQL?

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  9 หลายเดือนก่อน +1

      Hey, thanks for the question! It is possible to run SQL queries against spark dataframes (see spark.apache.org/docs/latest/sql-getting-started.html#running-sql-queries-programmatically)... but I think it's worthwhile learning Python too as it opens up a lot more options/ functionality

    • @giorgikalandadze6172
      @giorgikalandadze6172 9 หลายเดือนก่อน

      @@LearnMicrosoftFabric Thanks!

  • @BharathKumar-ch4tp
    @BharathKumar-ch4tp 11 หลายเดือนก่อน

    can we create and execute the stored procedure in notebook?

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  11 หลายเดือนก่อน

      Hey that's an interesting question. I think out-the-box there is no functionality for this currently. There _might_ be a way to do this through the TDS endpoint, but I haven't needed to do this myself yet (learn.microsoft.com/en-us/fabric/data-warehouse/connectivity)

    • @BharathKumar-ch4tp
      @BharathKumar-ch4tp 11 หลายเดือนก่อน

      @@LearnMicrosoftFabric Thank you for the reply, And I have few other queries as well, where can I ask you about the same

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  11 หลายเดือนก่อน

      @@BharathKumar-ch4tp Hey feel free to ask on the Skool community: skool.com/microsoft-fabric

  • @noahhadro8213
    @noahhadro8213 ปีที่แล้ว

    when I do df.printSchema() and I get an error statinng "'DataFrame' object has no attribute 'printSchema'". Can you help with this?

    • @LearnMicrosoftFabric
      @LearnMicrosoftFabric  ปีที่แล้ว

      Hey check type(df). I would guess that your df object is not of type spark dataframe. Is it a pandas dataframe?

    • @noahhadro8213
      @noahhadro8213 ปีที่แล้ว

      yes you are correct. It looks to be a "pandas.core.frame.DataFrame"@@LearnMicrosoftFabric

  • @DaleWells-w5j
    @DaleWells-w5j หลายเดือนก่อน

    I am a new member, and I have spent less than 30 days working with Fabric Environment, I am into my third project. Yesterday I started re-listening to all 30 of your Fabric videos and completed them today. I was particularly looking for an answer on how to properly code this script to extract a table and write it to an external CSV file.
    AttributeError Traceback (most recent call last)
    Cell In[17], line 177
    173 spark = SparkSession.builder.getOrCreate()
    175 df=spark.sql("""select * from SrvySmryWithContract""")\
    176 .show(n=10)
    --> 177 df.coalesce(1).write.format("csv")\
    178 .options(header='True', delimiter=',')\
    179 .mode('overwrite')\
    180 .save(path='Users/DWELLS/Downloads/SrvySmryWithContract.csv')
    AttributeError: 'NoneType' object has no attribute 'coalesce'