Accelerate Transformer inference on CPU with Optimum and ONNX

[@anabildea9274]

Thank you for sharing! great content!

[@geekyprogrammer4831]

Thanks a lot for creating this video. I saved a month by watching this video!

[@juliensimonfr]

Great to hear, thank you.

[@youssefbenhachem993]

To the point ! great explanation, thanks 😀

[@juliensimonfr]

Glad it was helpful!

[@TheBontenbal]

I am trying to follow along. Many updates to the code so many errors unfortunately.

[@juliensimonfr]

Docs and examples here: huggingface.co/docs/optimum/onnxruntime/overview

[@Gerald-iz7mv]

How do you export to onnx using cuda? It seems optimum doesnt support it - is there an alternative?

[@juliensimonfr]

huggingface.co/docs/optimum/onnxruntime/usage_guides/gpu

[@ahlamhusni6258]

is there any optimization methods applied on word2vec 2.0 model ? and can I apply these methods on the word2vec 2.0

[@juliensimonfr]

Hi, Word2Vec isn't based on the transformer architecture. You should take a look at Sentence Transformers, they're a good way to get started with Transformer embeddings huggingface.co/blog/getting-started-with-embeddings

[@ibrahimamin474]

@@juliensimonfr I think he meant wav2vec 2.0

[@Gerald-xg3rq]

what the difference between setfit.exporters.onnx and optimum.onnxruntime (optimizer = ORTModelFromFeatureExtraction.from_pretrained(...) optimizer.optimize()) etc.?

[@juliensimonfr]

Probably the same :)