ขนาดวิดีโอ: 1280 X 720853 X 480640 X 360
แสดงแผงควบคุมโปรแกรมเล่น
เล่นอัตโนมัติ
เล่นใหม่
Great! simple way to implement a LLM.Thank you!
Glad you like it!
I have 64gb ram and 8gb vram, i want to run llama 70B but it doesn't fit. how can i run it on system ram with python. can you make a video for that?
I also have 64gb RAM, it worked for me. My system used about 58GB RAM for llama-3:70B. I show RAM I use if I make a video with llama 3:70B.
Great! simple way to implement a LLM.Thank you!
Glad you like it!
I have 64gb ram and 8gb vram, i want to run llama 70B but it doesn't fit. how can i run it on system ram with python. can you make a video for that?
I also have 64gb RAM, it worked for me. My system used about 58GB RAM for llama-3:70B. I show RAM I use if I make a video with llama 3:70B.