If you enjoyed this video, then consider subscribing today! Am planning to put a series of small videos covering these concepts/tools! th-cam.com/channels/jO8Jq2sdpuI134axhMp0Fg.html
very comprehensive! If you can add a supplementary indicating the online sources from where one can learn all these technologies, it will be even more effective. Good Job!... Mukesh Rao
Sure Amit! Thanks for reaching out! Am planning to do so! Meanwhile, will be posting a couple of videos this week. So please do subscribe and keep watching!
### Scala ### Python is slower but very easy to use, while Scala is faster and moderately easy to use. Scala provides access to the latest features of Spark, as Apache Spark is written in Scala. Language choice for programming in Apache Spark depends on the features that best fit the project needs, as each one has its own pros and cons. Python is more analytical oriented while Scala is more engineering oriented but both are great languages for building Data Science applications. Overall, Scala would be more beneficial in order to utilize the full potential of Spark for Data Engineering. I have used both variants with Spark. Once you start coding in scala , you will fall in love with it , even though the initial learning curve is a bit on the rougher side. But it is worth the effort! Hope it helps! Please don't forget to subscribe to my channel !!!
@@stream2learn Hmm,that was insightful.Because my understanding with pandas ,arrows and pyspark .The speed would be comparable to native spark scala code while making it much faster to build applications.The only reason i asked was cause i know scala version upgrades tends to break things and i could see from JD there was a shift to python .Thank you for your answer
If you enjoyed this video, then consider subscribing today!
Am planning to put a series of small videos covering these concepts/tools!
th-cam.com/channels/jO8Jq2sdpuI134axhMp0Fg.html
Very nice roadmap for a data engineer. You are just not pasting stuffs on the screen but you very well know about everything you shared. Thanks a lot!
your explanation is very good, it will surely help many to better understand the roadmap.
Thank you very much Now I know where I am and thinking of which tools I need to master
very comprehensive! If you can add a supplementary indicating the online sources from where one can learn all these technologies, it will be even more effective. Good Job!... Mukesh Rao
Sure Mukesh, I will be adding a set of links pertaining to all the technologies that are needed for a data engineer.
Are you giving any live training on these concepts/tools that you mentioned in your videos ? if yes, i'll willing to join your session
Sure Amit! Thanks for reaching out! Am planning to do so! Meanwhile, will be posting a couple of videos this week. So please do subscribe and keep watching!
@@stream2learn Thanks. I have subscribe and please let me know when you plan anything in future
@@amitlamba4627 Sure!
Thanks , this is worth it.
மிக்க நன்றி sir .
Sir, are you providing any course for this all topics .?
Will be trying to put some videos covering these.
மிக்க நன்றி sir . If you do that , that would be very helpful for us sir .
Very nice video and hope it does not scare new comers :)
Thanks Kiran.
Do you take any classes for becoming Data Engineer.
Nice video, but can you let us know how to become dataengineer with snowflakes?
Sure!
Is it live now
Just Uploaded the Video as a Premiere!
What do you think is more important scala or python?
### Scala ###
Python is slower but very easy to use, while Scala is faster and moderately easy to use.
Scala provides access to the latest features of Spark, as Apache Spark is written in Scala.
Language choice for programming in Apache Spark depends on the features that best fit the project needs, as each one has its own pros and cons.
Python is more analytical oriented while Scala is more engineering oriented but both are great languages for building Data Science applications.
Overall, Scala would be more beneficial in order to utilize the full potential of Spark for Data Engineering.
I have used both variants with Spark. Once you start coding in scala , you will fall in love with it , even though the initial learning curve is a bit on the rougher side. But it is worth the effort!
Hope it helps!
Please don't forget to subscribe to my channel !!!
@@stream2learn Hmm,that was insightful.Because my understanding with pandas ,arrows and pyspark .The speed would be comparable to native spark scala code while making it much faster to build applications.The only reason i asked was cause i know scala version upgrades tends to break things and i could see from JD there was a shift to python .Thank you for your answer
@@ganeshbhat2289 Sure yes. Opinions do vary from person to person with respect to most tech stacks.
@@stream2learn Thanks,alot.cant wait for spark to adapt to scala 3.If possible would you make a video on building a spark application using scala
@Ganesh Bhat Am actually working on it right now. Hopefully should be posting the intro video by this weekend.