1st! Subbed. Playing with this now. GPT-J 6B was just a bit too large (14.5 GB) for my 12 GB GPU, and I really want to get an AI running on my GPU to compare performance to CPU. I wasn't at all impressed with GPT-J on my CPU and am really hoping I can get DistilGPT, TinyGPT, or MiniGPT running well and get into some training. Thanks for the video!
1st! Subbed. Playing with this now. GPT-J 6B was just a bit too large (14.5 GB) for my 12 GB GPU, and I really want to get an AI running on my GPU to compare performance to CPU. I wasn't at all impressed with GPT-J on my CPU and am really hoping I can get DistilGPT, TinyGPT, or MiniGPT running well and get into some training. Thanks for the video!