Hello, Nice Tutorial! Not sure if you can help with a scenario I am facing, but I wanted to check. My CSV has integer values in a date column, I created a schema with DateType() for this column and tried to load the file into a data frame, unfortunately, the dataframe throws null values. May be I should ingest timestamp data as integer. Please let me know if you can help? I am also happy to get into a call to show the pseudo code
and if there are continuous null values then first populate the average for the first null values with the average and then .. with that updated value and the next successive value calculate the average for the 2nd null value
Let’s say in row no 1 . Name ,I’d,Gen, Sal in which I’d and gen are null but name and Sal have values . Row no2 . Name-null,Sal -null but gen ,I’d are having values . How to display the result . I want op with null removed wherever data is available I want to display
Excellent sir. You cleared all my doubts . Thank you
Thank you for this content
3:49, "all" drops the row when all the values in the row are null. It has nothing to do with columns.
Hi Sir,what if I want to collect the data which have null values ?
Neat explanation
My data frame is having null values in some columns I want to drop that null column and show other columns .
Hello, Nice Tutorial! Not sure if you can help with a scenario I am facing, but I wanted to check. My CSV has integer values in a date column, I created a schema with DateType() for this column and tried to load the file into a data frame, unfortunately, the dataframe throws null values. May be I should ingest timestamp data as integer. Please let me know if you can help? I am also happy to get into a call to show the pseudo code
If I need to remove null in any of the columns and display other columns results then??
hi Gaurav, please see this video th-cam.com/video/oPtCbVG65oU/w-d-xo.html
Hi sir , what if i want to fill the null columns in salary with the average of preceding and successive values ?
and if there are continuous null values then first populate the average for the first null values with the average and then .. with that updated value and the next successive value calculate the average for the 2nd null value
@@Suriya_MSM I think I am not clear. Can you please paste the example
Let’s say in row no 1 . Name ,I’d,Gen, Sal in which I’d and gen are null but name and Sal have values . Row no2 . Name-null,Sal -null but gen ,I’d are having values . How to display the result . I want op with null removed wherever data is available I want to display