What Pandas users should know about NumPy 2.0 and dtypes

แชร์
ฝัง
  • เผยแพร่เมื่อ 19 ก.ย. 2024

ความคิดเห็น • 10

  • @h4ck314
    @h4ck314 3 หลายเดือนก่อน +1

    Instructive video, thanks

    • @ReuvenLerner
      @ReuvenLerner  3 หลายเดือนก่อน

      I'm glad you enjoyed it!

  • @pietraderdetective8953
    @pietraderdetective8953 3 หลายเดือนก่อน +1

    great content!
    do you know if Numpy 2.0 brings performance speedup? If it does, I'm hoping it will speedup up Pandas as well! I've been holding off migrating to Polars due to the 30-50k loc Pandas code I got.
    Would rather not having to refactor them and stay with Pandas if there's major speedup with the new Numpy 2.0

    • @ReuvenLerner
      @ReuvenLerner  3 หลายเดือนก่อน

      My impression is that it doesn't really speed things up, but rather cleans up the API in a lot of ways. That said, I wouldn't be surprised if they managed to find *some* ways to speed things up a bit more.
      The real Pandas speedup will come, I think, via PyArrow. It already reduces memory usage quite a lot, and for many things it's super speedy. The other things (e.g., joins) aren't quite there yet, but I have to assume that they will.

  • @abc_cba
    @abc_cba 3 หลายเดือนก่อน +1

    Thank You for this video, i just wanted to know if we can run both by summoning one version when the other isn't needed or maybe have both of them and invoking a specific version?
    My English is weak, as i originate from a rural area of India and English is my 9th spoken language in day to day communications.
    - Samuel

    • @ReuvenLerner
      @ReuvenLerner  3 หลายเดือนก่อน

      I wish that my 9th language were as good as your English!
      Python doesn't let you have more than one version in use at a time. However, you can have virtual environments (venvs) with different versions of the same package. In that way, one project can use NumPy 1.x, and another project (in another directory) can use NumPy 2.0.

    • @abc_cba
      @abc_cba 3 หลายเดือนก่อน +1

      @@ReuvenLerner thank you for the appreciation.
      I am very fascinated that i came across your channel and i added your playlist into my watch later videos, i would love to watch and learn more from them.
      thank you for contributing to the developer world in this age of chat prompts. it is more understandable.
      btw, did you take the developer's survey from stackoverflow which they silently pushed and didn't make a lot of noise about this year? I found the questionnaire was only based on A.I. NOTHING ELSE, kind of signaled that many in the Dev space say is the end of Stackoverflow since the inception of LLM's.
      what's your take on that? also, i assume it must be very late in the US, and for you to reply me this quickly, i want to thank you again for that.
      My name is Samuel, nice to know you, Mr. ___?!