Multi-Source Simultaneous Speech Translation [ LingMon

📅 March 4, 2024 | 🗣 Dominik Macháček (ÚFAL MFF UK) | 📝 Multi-Source Simultaneous Speech Translation
🔖 ABOUT THE LECTURE
▔▔▔▔▔▔▔▔▔▔▔▔▔
▸We investigate the opportunity to use multiple parallel speech signals - the original and simultaneous interpreting - as sources for translation to achieve higher quality of the simultaneous speech translation. We create an evaluation set ESIC (Europarl Simultaneous Interpreting Corpus). We analyze the challenges of simultaneous interpreting when used as an additional parallel source. Then, we investigate the robustness of multi-sourcing to transcription errors and assess the reliability of machine translation metrics when evaluating simultaneous speech translation. Last but not least, we demonstrate Whisper-Streaming, our tool that enables real-time processing of large offline speech-to-text models.
📽️ ABOUT THE SERIES
▔▔▔▔▔▔▔▔▔▔▔▔
▸The history of Linguistic Mondays dates back to the 1980s and their original aim was to make both the students and the faculty members as well as the wider research community aware of the field of computational linguistics in general and of the results achieved by the members of our team in particular. During the years, with the growing awareness of the domain and with new trends appearing on the scene and with more master and doctoral students coming in, the scope of the topics introduced has broadened correspondingly, covering all aspects of the field from the basics of computational linguistics, its linguistic and formal background through corpora case studies and natural language processing applications such as machine translation and information retrieval up to the most modern trends including machine learning. It is also offers an excellent opportunity for PhD students to present their results and to receive a relevant response from leading experts in the field.
❔ SOCIAL MEDIA
▔▔▔▔▔▔▔▔▔▔
▸web: ufal.mff.cuni.cz
▸facebook: / ufalmffuk
▸twitter: / ufal_cuni