Install Pixtral 12B Locally - Mistral's First Multi-modal Model

This video installs Pixtral-12B model locally and tests it on various images for OCR and image understanding.
🔥 Buy Me a Coffee to support the channel: ko-fi.com/fahd...
🔥 Get 50% Discount on any A6000 or A5000 GPU rental, use following link and coupon:
bit.ly/fahd-mirza
Coupon code: FahdMirza
▶ Become a Patron 🔥 - / fahdmirza
#pixtral #mistreal #pixtral12b
PLEASE FOLLOW ME:
▶ LinkedIn: / fahdmirza
▶ TH-cam: / @fahdmirza
▶ Blog: www.fahdmirza.com
RELATED VIDEOS:
▶ Resource huggingface.co...
All rights reserved © Fahd Mirza

[@tails_the_god]

hmm is there a mmproj and gguf of it for koboldcpp?

[@aa-xn5hc]

Upfront vram necessary, please.

[@PaulStoicaSebastian]

Hopefully they will make it API-based because 25GB is a lot for running on usual devices.

[@fahdmirza]

You can access it through Mistral's API which is a paid option.

[@naeemulhoque1777]

cool

[@fahdmirza]

It is

[@TheCinefotografiando]

What is the lowest vram it can run on?

[@fahdmirza]

At least more than 48GB VRAM.

[@satvik4225]

is there a way to do it without giving url, by directly giving image?

[@fahdmirza]

Yes, and it's shown in video

[@satvik4225]

@@fahdmirza pls share notebook

[@goudou5099]

​@@satvik4225Just watch the video...

[@jossejosse952]

Gguf?

[@fahdmirza]

Yes there is on hugging face

[@jossejosse952]

I haven't found any pixtral, and yet thank you.

[@henkhbit5748]

Thanks, hopefully aquantized version will be release...