- 155
- 93 758
SkillSharp
India
เข้าร่วมเมื่อ 24 ต.ค. 2020
🚀 Welcome to SkillSharp, your destination for honing coding, data science, & professional skills! 🎯 I'm Akshay Rathod, thrilled to have you join our passionate learning community.
🎓 What to Expect from SkillSharp?
✅ High-Quality Tutorials,
✅ Stay Up-to-Date on tech trends,
✅ Beginner-Friendly Approach,
✅ Advanced Techniques,
✅ Career Growth insights.
🎯 Join the SkillSharp Community:
🔔 Subscribe & never miss new uploads.
📣 Engage in comments.
🤝 Collaborate with learners.
🌟 Share success stories.
🎬 Subscribe now & let's embark on this exciting journey of continuous learning together! 🎬
#SkillSharp #CodingTutorials #DataScience #ProfessionalSkills #TechEducation #LearnToCode #CareerGrowth #ContinuousLearning #TH-camChannel #CodingCommunity #DataScienceSkills #Programming #TechUpdates #BeginnerFriendly #AdvancedTutorials #TechEnthusiasts #Empowerment #KnowledgeSharing #TechInnovation #SubscribeNow #JoinTheCommunity #DataScienceJourney #CareerAdvice #TechTips #StayCurious
🎓 What to Expect from SkillSharp?
✅ High-Quality Tutorials,
✅ Stay Up-to-Date on tech trends,
✅ Beginner-Friendly Approach,
✅ Advanced Techniques,
✅ Career Growth insights.
🎯 Join the SkillSharp Community:
🔔 Subscribe & never miss new uploads.
📣 Engage in comments.
🤝 Collaborate with learners.
🌟 Share success stories.
🎬 Subscribe now & let's embark on this exciting journey of continuous learning together! 🎬
#SkillSharp #CodingTutorials #DataScience #ProfessionalSkills #TechEducation #LearnToCode #CareerGrowth #ContinuousLearning #TH-camChannel #CodingCommunity #DataScienceSkills #Programming #TechUpdates #BeginnerFriendly #AdvancedTutorials #TechEnthusiasts #Empowerment #KnowledgeSharing #TechInnovation #SubscribeNow #JoinTheCommunity #DataScienceJourney #CareerAdvice #TechTips #StayCurious
Working with json file in Spark | Data Engineering, Spark & Databricks Course
Welcome to the chapter of our comprehensive course on Data Engineering, Spark, and Databricks! In this video, We will see how we can read write json file with Spark
📌 What You’ll Learn:
Timestamps:
00:00 Introduction
00:45 Reading json file
03:43 Read a multiline json file
06:49 Read multipal json files
08:34 Read all files from a directory
09:59 Reading json file with user defined schema
11:42 Reading json file using spark sql
13:51 Write dataframe as json file
17:05 Available options while working with json
19:05 Thank you
Don't forget to like, subscribe, and hit the notification bell for more tutorials on data engineering, Apache Spark, and Databricks!
🌟 Why This Course?
Big Data is at the core of digital transformation, and understanding its fundamentals is crucial for anyone looking to build a career in data engineering. In this course, we'll break down complex concepts into easy-to-understand lessons, accompanied by practical examples and hands-on exercises.
🔧 Tools and Technologies:
Throughout this course, we'll dive deep into tools like Apache Spark and Databricks, which are essential for processing and analyzing Big Data. You'll learn how to set up your environment, write efficient Spark jobs, and leverage Databricks for seamless data engineering workflows.
🎯 Who Should Watch This?
1. Aspiring Data Engineers
2. Software Developers and Engineers
3. Data Analysts interested in Big Data
4. IT Professionals transitioning to Big Data roles
5. Students and enthusiasts eager to learn about Big Data
📅 What’s Next?
Stay tuned for the upcoming chapters History of Big Data
🔗 Useful Links:
Skillsharp www.youtube.com/ @SkillSharp
🌐 Source code
github.com/AkshayRathodIt/Skillsharp-Spark-for-biggeners.git
🤝 Get Involved:
★ Like this video if you found it helpful!
★ Comment below with your questions or topics you’d like to see covered in future chapters.
★ Share this video with fellow learners and colleagues who might benefit from this course.
Start your Big Data journey with Skillsharp, and let's explore the limitless possibilities of data together!
📌 What You’ll Learn:
Timestamps:
00:00 Introduction
00:45 Reading json file
03:43 Read a multiline json file
06:49 Read multipal json files
08:34 Read all files from a directory
09:59 Reading json file with user defined schema
11:42 Reading json file using spark sql
13:51 Write dataframe as json file
17:05 Available options while working with json
19:05 Thank you
Don't forget to like, subscribe, and hit the notification bell for more tutorials on data engineering, Apache Spark, and Databricks!
🌟 Why This Course?
Big Data is at the core of digital transformation, and understanding its fundamentals is crucial for anyone looking to build a career in data engineering. In this course, we'll break down complex concepts into easy-to-understand lessons, accompanied by practical examples and hands-on exercises.
🔧 Tools and Technologies:
Throughout this course, we'll dive deep into tools like Apache Spark and Databricks, which are essential for processing and analyzing Big Data. You'll learn how to set up your environment, write efficient Spark jobs, and leverage Databricks for seamless data engineering workflows.
🎯 Who Should Watch This?
1. Aspiring Data Engineers
2. Software Developers and Engineers
3. Data Analysts interested in Big Data
4. IT Professionals transitioning to Big Data roles
5. Students and enthusiasts eager to learn about Big Data
📅 What’s Next?
Stay tuned for the upcoming chapters History of Big Data
🔗 Useful Links:
Skillsharp www.youtube.com/ @SkillSharp
🌐 Source code
github.com/AkshayRathodIt/Skillsharp-Spark-for-biggeners.git
🤝 Get Involved:
★ Like this video if you found it helpful!
★ Comment below with your questions or topics you’d like to see covered in future chapters.
★ Share this video with fellow learners and colleagues who might benefit from this course.
Start your Big Data journey with Skillsharp, and let's explore the limitless possibilities of data together!
มุมมอง: 74
วีดีโอ
read write csv file with Spark | Data Engineering, Spark & Databricks Course
มุมมอง 8014 วันที่ผ่านมา
Welcome to the chapter of our comprehensive course on Data Engineering, Spark, and Databricks! In this video, We will see how we can read write csv file with Spark 📌 What You’ll Learn: Timestamps: 00:00 Introduction 00:50 Initial Setup 01:39 Read csv file in spark dataframe 03:59 use option header true 06:34 Read multipal csv files 07:55 Read all files from directry 09:28 Reading csv files with...
Spark shell and spark submit | Data Engineering, Spark & Databricks Course
มุมมอง 57หลายเดือนก่อน
Welcome to the chapter of our comprehensive course on Data Engineering, Spark, and Databricks! In this video, We will see Spark shell and spark submit 📌 What You’ll Learn: Timestamps: 00:00 Introduction 01:00 Spark-submit 02:38 Spark-submit example 04:14 Spark shell with example 06:03 Thank You Don't forget to like, subscribe, and hit the notification bell for more tutorials on data engineering...
Spark WebUI and Spark DAG understanding | Data Engineering, Spark & Databricks Course
มุมมอง 127หลายเดือนก่อน
Welcome to the chapter of our comprehensive course on Data Engineering, Spark, and Databricks! In this video, We will see Spark WebUI and Spark DAG understanding 📌 What You’ll Learn: Timestamps: 00:00 Introduction 00:47 Spark WebUI introduction 01:54 Overview of First Spark Application 03:45 Overview of SparkWebUI 04:47 Job Tab Spark WebUI 05:27 Stage tab Spark WebUI 05:57 Storage tab Spark Web...
Spark Session and conf objects | Data Engineering, Spark & Databricks Course
มุมมอง 169หลายเดือนก่อน
Welcome to the chapter of our comprehensive course on Data Engineering, Spark, and Databricks! In this video, We will see Spark Session and conf objects 📌 What You’ll Learn: Timestamps: 00:00 Introduction 00:25 Spark Session objects 04:16 Spark Conf object 07:40 Precedence of spark configuration 08:48 Spark Context objects 10:32 Thank You Don't forget to like, subscribe, and hit the notificatio...
First Spark Application | Data Engineering, Spark & Databricks Course
มุมมอง 228หลายเดือนก่อน
Welcome to the chapter of our comprehensive course on Data Engineering, Spark, and Databricks! In this video, we will see First Spark Application 📌 What You’ll Learn: Timestamps: 00:00 Introduction 00:26 Create Spark Application 01:13 Explore Data 02:38 Setup spark App 03:56 Create SparkSession object 06:43 Read csv file with spark 08:51 How to read Spark Doccumentation 12:27 InferSchema of dat...
Spark application execution mode and execution methods | Data Engineering, Spark & Databricks Course
มุมมอง 327หลายเดือนก่อน
Welcome to the chapter of our comprehensive course on Data Engineering, Spark, and Databricks! In this video, Spark application execution mode and execution methods 📌 What You’ll Learn: Timestamps: 00:00 Introduction 00:30 Clusters in spark Applications 00:50 How Spark work on local machine 02:07 Cluster mode in spark application 03:56 Cluster mode in spark application 05:56 Spark Application E...
Lifecycle of Spark Application | Data Engineering, Spark & Databricks Course
มุมมอง 118หลายเดือนก่อน
Welcome to the chapter of our comprehensive course on Data Engineering, Spark, and Databricks! In this video, Lifecycle of Spark Application 📌 What You’ll Learn: Timestamps: 00:00 Introduction 00:19 Narrow Transformation 01:34 Wide Transformation 03:05 Transformations and Actions 04:41 Lazy Evaluation 05:37 Spark Application lifecycle 06:57 Thanks Don't forget to like, subscribe, and hit the no...
Terminologies in Apache Spark | Data Engineering, Spark & Databricks Course
มุมมอง 932 หลายเดือนก่อน
Terminologies in Apache Spark | Data Engineering, Spark & Databricks Course
Working Of Apache Spark | Data Engineering, Spark & Databricks Course
มุมมอง 602 หลายเดือนก่อน
Working Of Apache Spark | Data Engineering, Spark & Databricks Course
How to setup Spark in Linux Ubuntu | Data Engineering, Spark & Databricks Course
มุมมอง 2802 หลายเดือนก่อน
How to setup Spark in Linux Ubuntu | Data Engineering, Spark & Databricks Course
Setup and Python 3.10.3 with PySpark on Windows 10 | Data Engineering, Spark & Databricks Course
มุมมอง 1522 หลายเดือนก่อน
Setup and Python 3.10.3 with PySpark on Windows 10 | Data Engineering, Spark & Databricks Course
Setup Apache Spark in Windows 10 | Data Engineering, Spark & Databricks Course
มุมมอง 4133 หลายเดือนก่อน
Setup Apache Spark in Windows 10 | Data Engineering, Spark & Databricks Course
Setup windows virtual machine | Data Engineering, Spark & Databricks Course
มุมมอง 4793 หลายเดือนก่อน
Setup windows virtual machine | Data Engineering, Spark & Databricks Course
Azure Databricks Account Setup and Overview | Data Engineering, Spark & Databricks Course
มุมมอง 2253 หลายเดือนก่อน
Azure Databricks Account Setup and Overview | Data Engineering, Spark & Databricks Course
Azure Cloud Account Setup and Portal Overview | Data Engineering, Spark & Databricks Course
มุมมอง 1243 หลายเดือนก่อน
Azure Cloud Account Setup and Portal Overview | Data Engineering, Spark & Databricks Course
Databricks Community Workspace Introduction | Data Engineering, Spark & Databricks Course
มุมมอง 763 หลายเดือนก่อน
Databricks Community Workspace Introduction | Data Engineering, Spark & Databricks Course
Databricks Community Account Setup | Data Engineering, Spark & Databricks Course
มุมมอง 813 หลายเดือนก่อน
Databricks Community Account Setup | Data Engineering, Spark & Databricks Course
Introduction to Apache Spark | Data Engineering, Spark, and Databricks Course
มุมมอง 504 หลายเดือนก่อน
Introduction to Apache Spark | Data Engineering, Spark, and Databricks Course
Limitations of Hadoop | Data Engineering, Spark, and Databricks Course
มุมมอง 354 หลายเดือนก่อน
Limitations of Hadoop | Data Engineering, Spark, and Databricks Course
Architecture of Hadoop | Data Engineering, Spark, and Databricks Course
มุมมอง 814 หลายเดือนก่อน
Architecture of Hadoop | Data Engineering, Spark, and Databricks Course
History of Hadoop | Lec 2 | Data Engineering, Spark, and Databricks
มุมมอง 424 หลายเดือนก่อน
History of Hadoop | Lec 2 | Data Engineering, Spark, and Databricks
Find the Index of the First Occurrence in a String | Leetcode | Easy | Python
มุมมอง 405 หลายเดือนก่อน
Find the Index of the First Occurrence in a String | Leetcode | Easy | Python
Not Boring Movies | Leetcode | Easy | SQL
มุมมอง 85 หลายเดือนก่อน
Not Boring Movies | Leetcode | Easy | SQL
Biggest Single Number | Leetcode | Easy | SQL
มุมมอง 185 หลายเดือนก่อน
Biggest Single Number | Leetcode | Easy | SQL
Remove Element | Leetcode | Easy | Python
มุมมอง 285 หลายเดือนก่อน
Remove Element | Leetcode | Easy | Python
Remove Duplicates from Sorted Array | Leetcode | Easy | Python
มุมมอง 215 หลายเดือนก่อน
Remove Duplicates from Sorted Array | Leetcode | Easy | Python
Mate, thank you your explanation was on point.
Thank you
thanks really helped
saved me!
bro i am getting a eror here that could not establishe connection to 172.14.6.100 the connection timed out
Ensure the remote server is running and accessible. Verify the server's IP address, username, and password. And if you are using key then check configure the remote ssh extension settings
Same here, connection timed out, no matter which server information i enter.
That Teams sound on the back is true PTSD
😂😂
Thank You for the Shortcut!
You're welcome!
You can also tap . (Fullstop) in your keyboard to get the same result
Another Day! Another Knowledge Nugget! Keep Going ...
Great Going! Finding amazing Value from this Content !!!
Thanks bro
Amazing Tutorial!
Hi man as you can see at 5:11 you can open python files but variables and libraries are white i can run them, is there any way to make intellisense work ?
i need acess unbunto platform, how i do it?
Will you elaborate on the problem you are facing?
are you marathi
Yes
How to add pem file
1. Open VSCode. 2. Open Command Palette (`Ctrl+Shift+P` or `Cmd+Shift+P`). 3. Type "Remote-SSH: Open SSH Configuration File" and select. 4. Add the following lines to the config file: ``` Host your-remote-host HostName your-remote-hostname User your-remote-username IdentityFile ~/.ssh/your-pem-file.pem
Thanks so much it has worked,God bless you
You're welcome!
THANKS
How to know my username...?
Check your azure vm overview page Or in your vm use the commond hostname
Password is not coming bro
Will you elaborate?
Thank you. That worked perfectly.
It’s showing error we encountered while processing in the first step
Thanks
Hy buddy , I'm getting error when i save the connection (Error opening connection Unknown database [databasename i provide] ) what to do? pls respond!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Thanks for this Video Series! Excited for the remaining Videos!
Tooooooop, Thanks
Works great!
Thank you Akshay. A day earlier I was having problems with lagging TH-cam videos and problems with sound distortion as well. I watched so many videos and found no solution to my problem. The next day TH-cam recommended me your channel. I clicked, just to see if it will solve my problem. Your video solved both of my problems. Your voice is so soothing to listen as well. You earned a new subscriber 👍
Most welcome 😊
guys dont forget so configure your IdentityFile and the Port
hi sir, why? what's that for?
@@babadook4173 I am honest I fortot it but do it
Thank you..easy to understand and execute
Thank you so much, this really helped me! I was looking all over the net and chatGPT to get this working but finally your video make it work for me!
It's a shame you forgot to configure it with a key. ☹
bro, how to turn on suggestion/hint when typing of git in vscode, like cmd
how cn this be a beginers guide if you already have the python3 already installe?!
In Linux system python is installed by default with os If it's not then this is the process
this is veryusefull for me for practice i've did this by myself but i'm struggling on one points . i'm trying to start LAMPP php server and apache2 with sudo systemctl start apache2 in the remote ssh of vs code i get error about port fortwarding 80 i've checked there is nothing using this ports while starting the server so a very strange problem i got . can i start a lampp server from remote ssh vs code or maybe i will need to be with root privilege for it ? was wondering if it was privileges being part of the problems or portforwarding of vs code and conflict with other extention like X11(suposely not since its not the same port) maybe ? if anyone have any idea or advice don't hesitate !
𝐷𝐸𝐖𝘼DO𝑅А
I am using 1.87.0 version.. when I am trying ssh with password authentication, it is not asking me to enter the password.. therefore authentication is failing. any suggestion to deal with this problem. ? Thanks,
Check your server settings to see if it allows passwords or if it requires a key.
hi brother, can i use rtx 3060 to centos os 7, i need it run with that setup. If it cant run, is there any alternative way to make it work?
You need to install drivers for rtx 3060 in centos 7 www.advancedclustering.com/act_kb/installing-nvidia-drivers-rhel-centos-7/ This artical might help you
😢
can you tell what should i do after this........ well everything was ok but i didnt see any python opener in my desktop or somewher im new to linux
What error are you getting? After running command python3
❤
Great Going!
Thank you so much
sudo: mkdir/usr/local/java: command not found
Sudo mkdir /use/local/Java please use space in between mkdir and /use/local/java
What can I do if my package architecture (amd64) does not match the system (arm64)? It will not let me download because of this.
releases.ubuntu.com/jammy/#:~:text=Desktop%20image&text=This%20type%20of%20image%20is,you%20are%20at%20all%20unsure. You can read this blog for amd64i hope it will work for you
Great one!!, really love it!!
Thanks a lot!
❤
Thank you, you saved my life.
You are welcome!
Very helpful. Thanks
Thanks
thanks
Great Video Bro
Enter started by capital letters(E )not small letter(e)
Thanks