Hello 👋!

I am Yusheng Dai, a second-year M.S. student at NERC-SLIP, University of Science and Technology of China, working with Prof. JunDu and Prof. Chin-hui Lee. I obtained my Bachelor’s Degree of Engineering from Sichuan University in June 2022.

My research interests now are controllable audio generation based on given video&text, audio-visual speech recognition and time series analysic on finacial scenario.

News

• [Feb. 2024]: One paper on the robustness of audio-visual speech recognition (AVSR) has been accepted as the first CVPR paper in history of our speech group! We unexpectedly discovered this interesting multimodal bias phenomenon and successfully solve the problem of modality dropout, achieving a unification of AVSR and ASR. The paper has been upload on the arxiv and code will be coming soon!
• [Jan. 2024]: The extended paper of our self-driven work on financial time series prediction has been accepted by SDM 2024. Thanks to my co-authors for this unforgettable cooperation! Hopefully, this algorithm can help us make enough money for the future Mars trip :).
• [Dec. 2022] Welcome to join our MISP2023 competition on speech enhancement task! Here is the baseline system.
• [Mar. 2023]: One paper on low-level audio-visual signal processing has been accepted by ICME 2023, which is the first paper in my graduate career. I have the opportunity to go to Australia! For sure, here is the code.
• [Dec. 2022] Welcome to join our MISP2022 competition on speaker diarization and long-time AVSR task! Here is the baseline system.
• [Oct. 2022] We have some ideas to firstly extend MAMMAL in financial data analysis and the paper is accepted by NeurIPS DistShift 2022 workshop.
• [Dec. 2021] We release the largest Mandarin audio-visual dataset called MISP-AVSR. The dataset is recorded in TV rooms of home environments with multiple groups chatting simultaneously. Welcome to join our MISP2021 competition as the grand challenge of ICASSP! Here is the baseline system.

Selected Publications [Google Scholar]