This was like drinking from a fire hose. I liked it but would like to see a much more detailed video where you download the file describe it and then go over the tools needed to make use of the file.
Hi Scott, Thanks for your comments. Have you checked out some of the other videos in the Parquet play list? I've gone into a bit more detail in some of those ones.
Hello, I have many .parquet files of the same type and I would like to display these files as a 'select * from ...many_file.parquet', how can I do this with parq please?
compress the csv with zstd or any other modern algorithm of your choice and compare that to the parque if compression is your selling point no thanks.. you could also set another row for meta data in csv and use the datatype you have in it.. i am not really sold on parquet yet
Every binary format will be more size effective than CSV, YAML, JSON or god forgive me XML. Just because the latter are very bloated when it comes to size.
I found the speed fine, compact enough to not make me slack off. Maybe try pausing when he's showing the code section to read through the logged parts on the terminal?
You always have the option to pause and playback at 0.75x. Remember you're the person learning so it's more important that you find a way to customize to your learning habits.
Mark, I have to say, you are one of the few youtube people I don't feel like I need to set 1.5 or 2x speed on to watch. :) Thanks for the videos!
I think that's the best compliment I could ever get ! Thanks :)
@@learndatawithmarkit's an honest comment. I second it!
0% ego, 100% useful info.
Thanks Mark. You're not only explaining the usefulness of using Parquet in about 5m, but giving us extra tips on using some very useful tools as well.
Very great video, achieved something that numerous cloud providers couldn't achieve with their lengthy documentations within 5 minutes.
Thanks - I'm glad you liked it!
Wow, succinct, to the point, and above all useful!
Thanks for your kind words 🤠
Excellent tutorial, Mark!!
Thank you for edification that doesn't waste time. Well done, Sir!
Succinct and to the point. Just what you need to go from "dumb" to "dangerous." Thanks!
perfectly explained.. didn't need too much verbosity and you did a great job
Thanks!
Thanks, Mark, for this awesome video and this is very informative
Definitely useful. Love it.
This is fine but can this survive a crash? Let's say my system gets its power cut, will my data be corrupted?
this was so easy to understand thanks mark
Well done! Thank you!
Thanks!
Good video, mark.
Hi Mark, great video. Could you pls cover Parquet Modular encryption topic also.
I actually needed a little slow speed to digest some concepts. Before I could digest you fed me with next chunk of food !
how do you ex[port it to a csv file ?
Wow! big space saving.
This was like drinking from a fire hose. I liked it but would like to see a much more detailed video where you download the file describe it and then go over the tools needed to make use of the file.
Hi Scott, Thanks for your comments. Have you checked out some of the other videos in the Parquet play list? I've gone into a bit more detail in some of those ones.
Hello, I have many .parquet files of the same type and I would like to display these files as a 'select * from ...many_file.parquet', how can I do this with parq please?
I would use DuckDB to do this!
compress the csv with zstd or any other modern algorithm of your choice and compare that to the parque if compression is your selling point no thanks.. you could also set another row for meta data in csv and use the datatype you have in it.. i am not really sold on parquet yet
Fast like Ferrari
Every binary format will be more size effective than CSV, YAML, JSON or god forgive me XML. Just because the latter are very bloated when it comes to size.
That's a fair point!
Good video but u need to slow down your speech mate
I found the speed fine, compact enough to not make me slack off. Maybe try pausing when he's showing the code section to read through the logged parts on the terminal?
Why are you so fast? It's overwhelming for the people who doesn't know a specific topic.
Sorry! It's not intentionally fast - that's just the pace that I speak at! Is there any bit that didn't make sense that I can try to explain more?
You always have the option to pause and playback at 0.75x. Remember you're the person learning so it's more important that you find a way to customize to your learning habits.
🫤 this would have been more helpful if you'd had significantly less caffeine.
I don't actually drink caffeine, but I know what you mean! I've been told I speak too quickly since forever, but I find it so difficult to slow down!
Slow the video speed down