8. Write DataFrame into parquet file using PySpark | Azure Databricks

In this video, I discussed about writing dataframe data into parquet file using pyspark.
Link for PySpark Playlist:
• 1. What is PySpark?
Link for PySpark Real Time Scenarios Playlist:
• 1. Remove double quote...
Link for Azure Synapse Analytics Playlist:
• 1. Introduction to Azu...
Link to Azure Synapse Real Time scenarios Playlist:
• Azure Synapse Analytic...
Link for Azure Data bricks Play list:
• 1. Introduction to Az...
Link for Azure Functions Play list:
• 1. Introduction to Azu...
Link for Azure Basics Play list:
• 1. What is Azure and C...
Link for Azure Data factory Play list:
• 1. Introduction to Azu...
Link for Azure Data Factory Real time Scenarios
• 1. Handle Error Rows i...
Link for Azure Logic Apps playlist
• 1. Introduction to Azu...
#PySpark #Spark #databricks #azuresynapse #synapse #notebook #azuredatabricks #PySparkcode #dataframe #WafaStudies #maheer

[@caiyu538]

Great lectures.

[@yasirkhan1278]

Hi,
Did you cover this parquetoutput.parquet issue in any of the next video.?

[@polakigowtam183]

Thanks Maheer

[@WafaStudies]

Welcome 😀

[@vasudev3421]

Hi Maheer, Thank you for sharing this.. how can I write all three rows in to a single parquet file?

[@julies5085]

df.repartition(1).write ??

[@manu77564]

thank you for this

[@vutv5742]

Completed

[@surajsingh712]

Hi Maheer, I am getting 'AnalysisException: Unable to infer schema for Parquet. It must be specified manually.' while trying to read a parquet file

[@arjundev4908]

just remove the word Path

[@rahulvarmap]

What's the trick to explicitly create the
.parquet file

[@mareswararaomalle9958]

hi @WafaStudies, I am using community edition and unable to delete unwanted files or folders under FileStore. can you help with deleting files/folders please!!!

[@krishnaginka-m5s]

use dbutili.fs.rm command in AZDB