Very good tutorial! Can you please show how to 1. extract json schema file from data frame and 2. load complex json files based on json schema file? Thanks!
Hi, thanks for the video. In my case my nested struct type column does not contain any nested array type column instead it contains nested struct type. Is there any other way I could use?
Thanks very much for the tutorial :) , I have a query regarding reading in json files. so i have an array of structs where each struct has a different structure/schema. And based on a certain property value of struct I apply filter to get that nested struct , however when I display using printschema it contains fields that do not belong to that object but are somehow being associated with the object from the schema of other structs , how can i possibly fix this issue ?
Muchas gracias amigo, me sirvió de mucho. 1)existen en un json datos vacios y quisiera que no aparecieran. 2) Cómo hacer para que en un json me cargue las columnas por defecto y no me agregue el nombre de la columna principal sino el el nombre solo
@@srikanthpatil9469 you add a new column dataframe and you can change data in dataframe using cast function. you can try that. using withColumn() for adding a new column and chaging data type
Excellent tutorial, looking forward to many more scenario based questions. Thanks a lot :)
Super bro, looking forward for next json tutorial
Thank you for this very useful video!
Awesome tutorial👏
Very good explanation sir! Kudos
Thank you. Good one.
Thank you too!
Nice explain sir
super! thank you!
Thankyou Brother
Thank you Ramana 👍
Very good tutorial! Can you please show how to 1. extract json schema file from data frame and 2. load complex json files based on json schema file? Thanks!
th-cam.com/video/qfJb45SusMo/w-d-xo.html
Hi, thanks for the video. In my case my nested struct type column does not contain any nested array type column instead it contains nested struct type. Is there any other way I could use?
hi, can you increase video quality: 360p only current video -> increase to 720p, 1080p for better visibility.
Just now uploaded
It will take some time to convert full hd
Nice Explanation with good example. Can you please give the video link, that you were talking about, dynamically add columns?
th-cam.com/video/qfJb45SusMo/w-d-xo.html
great ..did you upload the dynamically exploding one? not able to locate
th-cam.com/video/qfJb45SusMo/w-d-xo.html
Thanks very much for the tutorial :) , I have a query regarding reading in json files.
so i have an array of structs where each struct has a different structure/schema.
And based on a certain property value of struct I apply filter to get that nested struct , however when I display using printschema it contains fields that do not belong to that object but are somehow being associated with the object from the schema of other structs , how can i possibly fix this issue ?
Can you try it dynamically..like if the schema is changing is constantly and without mentioning the column names and all , dynamically parse it
How to extract if it is JSON object. This works only for array. Any idea?
Can u show how to create this multiline json file from table
Muchas gracias amigo, me sirvió de mucho.
1)existen en un json datos vacios y quisiera que no aparecieran.
2) Cómo hacer para que en un json me cargue las columnas por defecto y no me agregue el nombre de la columna principal sino el el nombre solo
Can I add a column in nested json array??
Yes, you can add any datatype on dataframe using withcolumn
@@TRRaveendra In dataframe you cannot modify json nested array
@@srikanthpatil9469 you add a new column dataframe and you can change data in dataframe using cast function. you can try that. using withColumn() for adding a new column and chaging data type