Differences AVRO vs Protobuf vs Parquet vs ORC, JSON vs XML | Kafka Interview Questions

[@mauriciopereyra3339]

good explanation

[@surendraarivappagari7011]

Very well explained..!!

[@GKTechplex]

Thank you

[@kiranreddy9103]

Good job................

[@GKTechplex]

Thanks

[@RajeshSahooacs]

Its very informative

[@GKTechplex]

Glad to know that.

[@ABHIJAYPATNE]

Good concise video but the background music was unnecessary.

[@rajeshkumardash1222]

what it means by json is not splitable does that mean all get processed in one executor .I assume thats not correct.. But its informative video thanks

[@GKTechplex]

No I said - Non-Binary formats (JSON, XML) "can not be Split".

[@rajeshkumardash1222]

@@GKTechplex So does it mean if I process a json file in spark all will come to one executor .

[@GKTechplex]

Let me put it this way - say you hv a single json file and you are using spark.read.json , it will create a single task to process the json data.
When the “wholeFile” option is set to true in spark, Json is NOT splittable.
So u have to figure out a way to pre-process your json file into chunks before feeding those to spark !

[@rajeshkumardash1222]

@@GKTechplex Thanks cleared the doubt