วีดีโอ

indeed video is great but while explaining try to explain by considering the points you have put on your screen otherwise its bit confusing to know which point you are talking about......

operation_manager don't appear or simply [PATH_NOT_FOUND] Path does not exist

can someone help , i have downloaded hadoop 3.3 which is the newest version but it is not showing in github . what to do ?

After clicking on launch neo4j the application is not opening in my system

this is a lifesaver!

Ghanta .. architecture kuch samajh nhi aya

I am getting this error "WARN NativeCodeLoader: Unable to load native-hadoop library for your platform" I could get the hadoop 2.7, instead I used hadoop 3.3 and its respective winutils. Advise.

great 🤩

Note - It's not ---partition, but ---partitions

This type all services at single platform Nice, but any alternative for online for practice like cloud type, but for free?

Puri video shkal dikhane mei nikaal di

I want to run a workflow engine project on airflow using docker how can i do that, Do i have to do additional steps. If yes, can you provide it.

facing the error while saving the file

i did everything exact same but for the later versions of spark 3.x java 8 or 11 is required so just download the java 8 or 11 version and it worked for me.

To those who are getting error in CMD:Use "./spark-shell" Instead of just spark-shell in CMD

Bro in jupyter throwing error

spark runs only on java 8 or 11 version it doesn't work with latest version I've tried it

One of the best . Thank you very much

last two days onward i am struggling to install it..please help me

request returned Internal Server Error for API route and version %2F%2F.%2Fpipe%2FdockerDesktopLinuxEngine/v1.47/containers/json?all=1&filters=%7B%22label%22%3A%7B%22com.docker.compose.config-hash%22%3Atrue%2C%22com.docker.compose.project%3Ddairflow%22%3Atrue%7D%7D, check if the server supports the requested API version i am getting this issue

very nice explained

I am unable to install python and unable to install the epel https

Great content

PS C:\Users\dataeng> docker-compose up -d when i am using this command it is showing errors like---- no configuration file provided: not found

sir is it possible to install airflow without docker

I did everything until the environment variables setup, still while using cmd spark-shell it is giving me "'spark-shell' is not recognized as an internal or external command, operable program or batch file." versions I used - For Java: java version "11.0.24" 2024-07-16 LTS Java(TM) SE Runtime Environment 18.9 (build 11.0.24+7-LTS-271) Java HotSpot(TM) 64-Bit Server VM 18.9 (build 11.0.24+7-LTS-271, mixed mode) For Python: Python 3.11.0rc2 For Spark: spark-3.5.3-bin-hadoop3 For Hadoop: (file from below location) winutils/hadoop-3.3.6/bin /winutils.exe

Spark-Shell is not running

I am getting errors continuously after doing the same procedure as well, please reply to me.

High clarity and useful. Thanks Sir

I have followed all the steps and added all the system variables but at that time winutils file was not present in my system

plz teach more about programs like how to implement these in scenario based programs

your method of teaching is so good 👍

Getting PY4javaerror, i have followed all the installation steps

Do you have idea how to decrypt client side data of Mongo using spark?

Very good explanation ❤❤

can I get your email address, wanted to get in touch with you

How to open Linux terminal?? Do u use Amazon Linux or how u able to enter all these

Sir i need java script

Great brother..Thanks from codeyug

but what if we have installed apache spark manually? I have done this so when I am trying to execute my pyspark script in spyder it's saying no module name pyspark.

Please try to make videos bit interesting Even bore theory also...you are reading PDFs continuously....iam getting sleepy

still hadoop not recognize even with your installation it give you a warning message " unable to load native.hadoop library"

The best video on installing payspark, even in 2024. Many thanks to the author!

Hi @AmpCode Thanks for the great tutorial. I followed each steps and spark is working fine. But when I'm executing some of my pyspark script, I'm getting below Hadoop error: ERROR SparkContext: Error initializing SparkContext. java.lang.RuntimeException: java.io.FileNotFoundException: java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset. Can you please help me on this urgently.. I have set all paths as you showed in video but I'm not able to solve this error. Please Help.

hindi bolo

Tq so much must needed❤❤❤

"It's a fairly small file, only 573 MB" 😂

thank you so much, very helpful! The only error I got was running spark-shell, but from other comments I figured out that you can either run the command prompt as admin or cd into the spark folder and then call it

Hi sir, Is it possible to update the partial object in Mongo DB using spark

Very nice video can you create more of it