Training a new tokenizer

Did you ever wonder how to create a BERT or GPT2 tokenizer in your own language or on your own corpus? This video will teach you how to do this with any tokenizer of the 🤗 Transformers library.
This video is part of the Hugging Face course: huggingface.co/...
Open in colab to run the code samples:
colab.research...
Related videos:
Building a new tokenizer: • Building a new tokenizer
Don't have a Hugging Face account? Join now: huggingface.co/...
Have a question? Checkout the forums: discuss.huggin...
Subscribe to our newsletter: huggingface.cu...