How to setup IntelliJ IDEA for Scala-Spark ? Easy Setup of Scala-Spark

In this video : I have setup the Scala-Spark Environment in the Intellij IDEA
Version used:
Java version : JDK 1.8
Spark version : 3.3.0
Scala Version: 2.12.19
with SBT executor and SCALA plugin
--------------------------------------------------------------------
SBT Configuration for SPAR Dependencies:
file : build.sbt
Paste below lines in build.sbt file in Intellij IDEA ..:
//dependencies
// mvnrepository....
libraryDependencies += "org.apache.spark" %% "spark-core" % "3.3.0"
// mvnrepository....
libraryDependencies += "org.apache.spark" %% "spark-sql" % "3.3.0"
==================================================
Tags:
Apache Spark tutorial
Spark programming for beginners
Big Data processing with Spark
Spark SQL tutorial
Spark streaming tutorial
Machine learning with Spark
PySpark tutorial
Spark RDD tutorial
Spark DataFrames tutorial
Spark Basic Tutorials
#intellij
#spark
#scala
#pyspark
#intellij
#bigdata
#programming
#dataanalytics
#dataanalysis
#coding

[@skviknesh]

Good Job bro! It works!!!

[@TechMAPR]

Glad to hear it's working for you!

[@chitvangupta2939]

Thank you for this session it helps🙌

[@TechMAPR]

Welcome

[@dineshwadhave8621]

Nice contest please more content like this it was very helpful for me #techieMangesh

[@TechMAPR]

Sure 👍

[@Bholekabhakt01]

Thank you for this session. It was really meaningful. ❤ please upload tutorial videos ...how to write more code for spark and scala in intellij.

[@TechMAPR]

Thank you, I will

[@TechMAPR]

th-cam.com/video/k-VUqndd3IU/w-d-xo.html
Watch Var and Val difference in scala

[@werghiaziz2943]

thank u

[@TechMAPR]

You're welcome!

[@skviknesh]

Hi Bro, It worked - [windows OS]. when I wrote a .csv file out, It was throwing error that HADOOP_HOME is not set & asked to install it. "java.io.FileNotFoundException: java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset." how to resolve this. Should I download winutils for windows and create a HADOOP_HOME for this? Is this mandatory?

[@TechMAPR]

Yes It is needed for windows to file to read and write, download winutils and set Hadoop_home = c:/Hadoop_home/winutils; in environment variable

[@skviknesh]

@@TechMAPR Thanks!