Using PyO3, Rust helps Python to calculate lexical diversity

I use PyO3 to write Rust code that I call from within Python to calculate lexical diversity, specifically the MTLD_wrap algorithm (MTLD = Measure of Textual Lexical Diversity).
Thanks to Scott Jarvis for his Python code that highly informed my Python code here:
github.com/ekb...
Here's my Rust code:
github.com/ekb...
#corpuslinguistics #pythonprogramming #rustlang #pyo3

[@josecantu8195]

Thanks Professor! I'm learning on the job on my own how to implement python & rust together given my interests in software development, data science & biomedical science so this is an interesting series you made!

[@ekbphd3200]

Great to hear it!

[@playea123]

This is fantastic! Thank you for sharing!!

[@ekbphd3200]

You're very welcome!

[@j-p-d-e-v]

I tried PyO3 and its actually a really good library. BTW great content.

[@ekbphd3200]

Yeah, it seems to be well written and well documented. Thanks! I'm glad you enjoy my videos!

[@SBrown-ou1xl]

I thought about this a bit more, and I think the MTLD_wrap algorithm has a time complexity of O(n^2). It might be interesting to try to fit a quadratic to the scatter plot instead of a line!

[@ekbphd3200]

Good idea. Is that different from the LOESS line?

[@RealLexable]

But only as long Mojo isn't out there to perform python to it's coming new standard limits even faster than c++. The future is going to be fast as hell bro 🎉

[@ekbphd3200]

Awesome!