Encoding Charactersets - may the force be with you [PyCon DE & PyData Berlin 2024]

🔊 Recorded at PyCon DE & PyData Berlin 2024, 23.04.2024
2024.pycon.de/...
🎓 Watch as Martin Hoermann delves into the intricate world of character encoding, unraveling the mysteries behind garbled text and providing practical solutions using Python.
Speakers:
Martin Hoermann
Description:
Martin Hoermann, Bereichsleiter Ausbildung at ORDIX AG, with over 25 years of experience in database and programming consultancy, sheds light on the persistent challenge of garbled text in IT projects despite Unicode. The talk focuses on using Python to analyze and rectify encoding issues by distinguishing between graphemes and codepoints, understanding Unicode versus UTF-8, and efficiently decoding and encoding various data sources like files, database results, and REST-API calls. Additionally, practical insights are shared on leveraging the unicodedata module and addressing ISO charset complexities in the Unicode landscape. Attendees will benefit from real-world examples illustrating effective solutions to tackle encoding dilemmas.
⭐️ About PyCon DE & PyData Berlin:
The PyCon DE & PyData conference unite the Python, AI, and data science communities, offering a unique platform for collaboration and innovation. The PyCon DE & PyData Berlin 2024 conference, hosted in partnership with the local Berlin PyData chapter, provided an exceptional experience, fostering deeper connections within the Python community while showcasing advancements in AI and data science. Attendees enjoyed a diverse and engaging program, solidifying the event as a highlight for Python and AI enthusiasts nationwide.
Follow us:
• LinkedIn: / 28908640
• X: www.x.com/pyconde
• X: www.x.com/pyda...
Links:
• Conference website: pycon.de
• Related sessions: 2024.pycon.de/p...
The conference is organized by
• Python Softwareverband e.V.: pysv.org
• NumFOCUS Inc.: numfocus.org
• Pioneers Hub gemeinnützige GmbH: pioneershub.org
If you enjoyed this session, please like, comment, and subscribe to our channel for more insightful talks and discussions.
Share this video with your network to spread the knowledge!
Hashtags:
#Python #PyConDE #PyData #OpenSource #AI #DataScience #MachineLearning #SoftwareDevelopment #LLMs #Community
Acknowledgements:
Special thanks to all the volunteers and sponsors who made this event possible.
About:
Python Softwareverband e.V.:
PySV is a non-profit that promotes the use and development of Python in Germany through events, education, and advocacy, fostering an open Python community.
NumFOCUS Inc.
supports open-source scientific computing by providing financial and logistical support to key projects like NumPy and Jupyter, promoting sustainable development and collaboration.
Pioneers Hub gemeinnützige GmbH:
is a non-profit fostering innovation in AI and tech by connecting experts and promoting knowledge exchange through events and collaborative initiatives.