Notes on AI Hardware - Benjamin Spector | Stanford MLSys #88

แชร์
ฝัง
  • เผยแพร่เมื่อ 25 พ.ย. 2024

ความคิดเห็น • 8

  • @rfernand2
    @rfernand2 6 หลายเดือนก่อน +4

    This is a presentation that Ben "threw together" at the last minute? Amazingly well done!

  • @420_gunna
    @420_gunna 10 หลายเดือนก่อน +3

    Ben continues to be a stud 💪💪💪
    Thanks Stanford students/faculty for putting these online, they're among the beast learning opportunities for people on the sidelines 😄

  • @drpangai
    @drpangai 4 หลายเดือนก่อน +1

    I am glad you talked about inverse lithography technology (ILT), which I named twenty years ago, and I am still working on it using GPU acceleration. BTW, I also got my PhD from Stanford

  • @radicalrodriguez5912
    @radicalrodriguez5912 6 หลายเดือนก่อน

    great presentation. thanks

  • @andrewm4894
    @andrewm4894 10 หลายเดือนก่อน

    Love this! Thanks!

  • @maximliu
    @maximliu 10 หลายเดือนก่อน

    Great presentation! Wondering if there is any literatures or papers, tutorials on the similar topics? The talk was kind of quick, need read more specifics from literatures. Any pointer would be appriciated. Thanks!

    • @BenjaminFSpector
      @BenjaminFSpector 10 หลายเดือนก่อน +3

      I blew through a ton of different topics in the course of the talk, so it really depends what you're looking for.
      If you want more on making the most of an H100, NVIDIA has fairly good docs on both the CUDA programming model as well as the specific features of the H100, but actually using them can be tricky, so your best bet is probably to read the CUTLASS repo and see how they do things.
      If you want more on hardware design, I'm not sure there are great alternatives to taking a class. Hardware design seems to me like an awful lot of work -- writing good RTL is hard enough, but the whole EDA stack is a bit of a nightmare.
      If you want more on semiconductor manufacturing, I'd highly recommend the Asianometry YT channel, which has a lot of really excellent content.
      Otherwise, some of my main sources for this talk were SemiAnalysis ($500/yr, but I like it enough that I pay for it even from a grad student stipend), Bill Dally's HC2023 talk, and various coursework, particularly 6.172 from MIT for performance engineering. (It's on OCW at ocw.mit.edu/courses/6-172-performance-engineering-of-software-systems-fall-2018/video_galleries/lecture-videos/ and while it's focused on CPU performance engineering many of the principles apply across both.)
      Hope this helps!

    • @prasannaprabhakar1323
      @prasannaprabhakar1323 10 หลายเดือนก่อน +1

      @@BenjaminFSpector Thanks a ton man! What you have shared here is gold. I really appreciate it.