Test 3c - Testing Meta Llama 3.1 405B, 70B, and 8B: Windows 11 VM (16 Cores, 236 GB RAM, No GPU)

Test 3
I used the same setup as Test 2 but reduced the amount of RAM and the number of CPU cores. VM specs: vCPU 60 cores, RAM 180GB, later increased to 236GB. In the video, you can see the usage of RAM, CPU, storage, and power, as well as the response times. I included a timer to show how quickly it responds
vandu.tech/met...