Hi Nick, I have 2 tables with different number of columns. I want to merge the table 2 with table 1 using python in databricks, have you covered it in any videos?
a loop to edit a data frame would take forever to run through a decent size data table (each row at a time), doesn't data bricks support pandas df-cleaning commands?
Yup, agreed. Pandas or Spark data frames are much better. I'm not sure why Nick does it this way. Perhaps to make it more accessible for people who don't know Pandas?
One of the best tutorials on TH-cam.
Thank you for this tutorial! It's very well explained!
Awesome video! i have learned a lot. u have explained so well. please make videos on data engineering interview questions
Thanks for sharing this us a great tutorial
Great video! Learned a lot.
Hi Nick,
I have 2 tables with different number of columns.
I want to merge the table 2 with table 1 using python in databricks, have you covered it in any videos?
a loop to edit a data frame would take forever to run through a decent size data table (each row at a time), doesn't data bricks support pandas df-cleaning commands?
Yup, agreed. Pandas or Spark data frames are much better. I'm not sure why Nick does it this way. Perhaps to make it more accessible for people who don't know Pandas?
Thanks Nick very interesting video. if we use pandas in our calculation is it possible to effect the performance?
How much would something like this cost?
Can you please share the script..
Hi Nick,
Provide your contact information to approach to you