Read S3 Write MySQL & S3 with PySpark

From Smidsy Technologies,
Read S3 & Write MySQL and S3 with PySpark
Share with your friends & subscribe to my channel.
For Training on Bigdata PySpark with AWS please call or whatsapp on below no.
Saif from Smidsy Technologies
[phone]

[@williamhaque6183]

Excellent. Explanation is awesome.

[@santanugoswami3858]

Nice presentation👌

[@ganeshpadala3751]

Any classroom sessions ?

[@KnowledgeAmplifier1]

what jars you have used?

[@vinaygudi2089]

it is python :)

[@KnowledgeAmplifier1]

@@vinaygudi2089 that I know , but pyspark require some dependent jars to authenticate the s3 credentials...

[@adityakulkarni8881]

AWS SDK 1.4.3 Jar

[@abdulsattar7878]

hi sir , in my pyspark in virtual environment (._jsc) is unkown ro environment ) any guide line please , i am stuck

[@ariesdips123]

Hi Saif, please help as I am getting "Java gateway process exited before sending its port number" error at the line GetorCreate(). Please help ASAP. Appreciate you help.

[@surbhirani9583]

Hi Saif
I am unable to read s3 csv file using pyspark on Jupyter notebook running on ec2 instance .
The error states : No file scheme for s3
Is there any resolution to this .

[@shreyasarkar5806]

I am getting some certificate error

[@manu93ize]

Jupiter Notebooks have been way better for this tutorial.

[@10singam]

I am getting below error while trying to read CSV file from S3 bucket from Google colab
org.apache.hadoop.fs.s3a.S3AFileSystem not found
Could you please help me?