It is important to set the temperature for this model to 0.15 for good results. It must not be an expensive MacBook Pro. I am using a mini PC ASRock DeskMeet with the Ryzen 5 8600G CPU, 64GB RAM (6,000 MHz), a Samsung 1TB NVMe drive and a 4TB HDD. That system runs LLMs up to 48 GB and has cost me only $900. Its max. power consumption is 65 watts. Inference is not the fastest (with 16 TOPS) but sufficient for my coding and authoring purposes.
Mistral, the best!!!
It is important to set the temperature for this model to 0.15 for good results. It must not be an expensive MacBook Pro. I am using a mini PC ASRock DeskMeet with the Ryzen 5 8600G CPU, 64GB RAM (6,000 MHz), a Samsung 1TB NVMe drive and a 4TB HDD. That system runs LLMs up to 48 GB and has cost me only $900. Its max. power consumption is 65 watts. Inference is not the fastest (with 16 TOPS) but sufficient for my coding and authoring purposes.
Thank you
Runs on my m4 MacBook Pro very good and it’s capable for a lot off thing