Maheer, your delivery of this course is excellent. You have arranged the topics in perfect bite sized vidoes in the sequense that it makes sense. I also appreciate that you do not linger and waste time on non useful topics and going at a faster speed to avoid distracting and boring your audience. I plan to also go over your rest of the channel as well. Great job, seriouly!
At 20:22, you have written display(df) . but you have created the dataframe with the name df1. So you have to pass df1 instead df in the display function. Correct me if i am wrong.
Hello Maheer. Can you please let me know why three double quotes are used in the final sql query that you have used to load data into the final passengercountstats table ?
what is the advantage of spark database why to create it.....when we can directly load flat file data to dataframe and register dataframe as table...to use sql queries on it.
I want to use Spark pool as Power App and Power BI's datasource. So that the data from data lake can be presented in App and BI during business hours. Is it means I need to turn on the serverless SQL for entire business hours? (i.e. we need to pay about 40 hours per week)
Hi, very nice video. But when I try to download video I receive error: Public access is not permitted on this storage account. Could you please give another link?
hi can you give some solution of this %%pyspark spark.sql("CREATE DATABASE IF NOT EXISTS nyctaxi") df.write.mode("overwrite").saveAsTable("nyctaxi.trip") Py4JJavaError: An error occurred while calling o586.saveAsTable. : org.apache.spark.SparkException: Job aborted.
Maheer, your delivery of this course is excellent. You have arranged the topics in perfect bite sized vidoes in the sequense that it makes sense. I also appreciate that you do not linger and waste time on non useful topics and going at a faster speed to avoid distracting and boring your audience. I plan to also go over your rest of the channel as well. Great job, seriouly!
Thank you 😊
Very nice Brother , it’s really helpful for people like us who is looking career in azure .. please keep doing such great work..
Great Explanation Azam. We will keep on supporting you.
Thank you Mohan ☺️
You are doing great work brother. God bless you.
Thank you 😊
I am eagerly waiting for this series to complete soon
At 20:22, you have written display(df) . but you have created the dataframe with the name df1. So you have to pass df1 instead df in the display function. Correct me if i am wrong.
make sense.
yes bro i am also got it
hi @amanpandey4550 , @wafastudies , I also have same doubt . someone pls clarify.
Keep up the great Work!!! I am so sharing this Synapse playlist to the engineers. Thanks!!
Thank you ☺️
Maheer, you did a great job in doing these videos. I can imagine lot of hard work and dedication went in... I Appreciate your effort.
Nice sir , no one can provide this type of playlist , bhot bhot dhanyawad sir ❤️
Thank you ☺️
Thank you. Excellent job in explaining.
Thank you ☺️
Very nice video. All of your videos are helpful.
Thank you 😊
At 20:36 data is from file right? Because display(df) is used in code.
@Wafastudies : after transformation you loaded the into table, may i know the data storage location to that table
Hello, is this possible to write data from spark database table to dedicated sql table?
Hello Maheer. Can you please let me know why three double quotes are used in the final sql query that you have used to load data into the final passengercountstats table ?
Because query is of multiple lines
Awesome Maheer..good work..thank you so much
Excellent Course Content
Thank you so much, this playlist is helping a lot.
Mashallah great knowledge.keep it going.
How did spark get the connection details for the database? Like the server name, username and password?
Continue to.watch this series u wil get it while progressiing
Hi Maheer,
Here for creating spark dataframe. Why you are passing ABFSS path instead of url. What is the difference. Thank You
what is the advantage of spark database why to create it.....when we can directly load flat file data to dataframe and register dataframe as table...to use sql queries on it.
Nice work bro!
Keep this spirit
Thank you 🙂
Maheer, why we not use Databricks instead of Spark after all both have spark? and What are the appropriate condition when we use this individual?
your videos are very helpful . Thanks
Thank you 😊
I want to use Spark pool as Power App and Power BI's datasource. So that the data from data lake can be presented in App and BI during business hours. Is it means I need to turn on the serverless SQL for entire business hours? (i.e. we need to pay about 40 hours per week)
what is differnce between data frame and normal table.Is data frames and rdd are data structures of Spark?
Any idea approx how many videos you will add to this playlist?
Cant say at this moment. But for sure there are so many videos to come
Good 1..Thank you so much Azure Rockstar..
Thank you 🙂
@@WafaStudies :Nice Videos Sessions, Could please let me know your mail id to discuss issues related to this topics
Excellent delivery
hello bro, iam getting quota exceed here error while i when was create spark pool notebook how can i resolve here guide me
where is donate link ?
Donate link? If it's regarding supporting me. Then u can consider using super thanks option below the video 😇
Hi, very nice video. But when I try to download video I receive error: Public access is not permitted on this storage account. Could you please give another link?
Really good one. Thanks bro
Thank you 🙂
Whiteboard Idea is nice please use it hence forth.
- From ur Channel Lover :)
Hehe thank you 😊
in databases Iam not able to create the default(spark) and that nyctaxi database. Can anyone tell me where I am wrong
same here. I am also not able to understand how to do it.
good content to learn
Superrrr...
Nice Explanation
Thank You Sir
Welcome madam 😊
hi
can you give some solution of this
%%pyspark
spark.sql("CREATE DATABASE IF NOT EXISTS nyctaxi")
df.write.mode("overwrite").saveAsTable("nyctaxi.trip")
Py4JJavaError: An error occurred while calling o586.saveAsTable.
: org.apache.spark.SparkException: Job aborted.
same prblm bro
Thanks for sharing. But so many adds are a little annoying.
Good. thanks
Welcome 🤗