目前書報討論已改為線上課程，欲旁聽的「電機系」同學可以寄信給助教(happy990044@gmail.com)索取直播連結

Date&Time : 

2022 / 01 / 07 (Fri) 14:20 - 16:20

Location : 

Online Course

Speaker : 

 李宏毅教授 (Prof. Hung-Yi Lee)

國立台灣大學 電機工程學系 Dept. of Electrical Engineering, NTU 

Topic : 

The Miracle of Self-supervised Learning 

Abstract : 

        Self-supervised learning (SSL) has shown to be vital for advancing research in natural language processing (NLP) and computer vision (CV). The paradigm pretrains a shared model on large volumes of unlabeled data and achieves state-of-the-art for various tasks with minimal adaptation. This talk will start with showing the cross-lingual capabilities of SSL models. Then we will talk about the cross-discipline learning of SSL models. This talk will introduce the Speech processing Universal PERformance Benchmark (SUPERB), which is a leaderboard to benchmark the performance of SSL model across a wide range of speech processing tasks. The results on SUPERB demonstrates that SSL representations show competitive generalizability across speech processing tasks. 

Bio :

       Hung-yi Lee is an associate professor of the Department of Electrical Engineering of National Taiwan University (NTU), with a joint appointment at the Department of Computer Science & Information Engineering of the university. His recent research focuses on developing technology that can reduce the requirement of annotated data for speech processing (including voice conversion and speech recognition) and natural language processing (including abstractive summarization and question answering). He won Salesforce Research Deep Learning Grant in 2019, AWS ML Research Award in 2020, Outstanding Young Engineer Award from The Chinese Institute of Electrical Engineering in 2018, Young Scholar Innovation Award from Foundation for the Advancement of Outstanding Scholarship in 2019, Ta-You Wu Memorial Award from Ministry of Science and Technology of Taiwan in 2019, and The 59th Ten Outstanding Young Person Award in Science and Technology Research & Development of Taiwan. He owns a YouTube channel teaching deep learning in Mandarin with more than 8M Total Views and 90k Subscribers.