Date & Time: 

   2024 / 6 / 14 (Fri) 14:20 - 16:20

 

Location: 

   Delta Building R216, NTHU

 

Speaker: 

    吳卓諭 教授

   國立陽明交通大學 電信工程研究所.

 

Topic: 

   Classify Deep Learning Networks for Data Classification

 

Abstract: 

   Massive experimental studies have witnessed the great success of deep learning (DL) in practical applications. However, DL remains by and large a mysterious “black-box”, spurring recent theoretical research to uncover its underlying principles. In this talk, we share our reflections, and obtained results, about mathematics of DL for data classification. Considering that the Euclidean metric over the network weight space typically fails to discriminate DL networks according to their classification performances, we propose from a probabilistic point of view a meaningful distance measure, whereby DL networks yielding similar performances are close. The proposed distance measure defines such an equivalent relation between network weights that networks with identical classification performance belong to the same equivalent class. This enables us to construct an associated quotient set, over which our proposed distance measure is provably a metric. Then, it is shown that the obtained metric quotient space is compact, apart from a vanishingly small subset. Our study contributes to some fundamental understanding of DL, though its impacts on practical algorithmic analysis and design are yet to be explored.

 

Autobiography: 

　Jwo-Yuh Wu received the B.S., M.S., and Ph.D. degrees from National Chiao Tung University, Taiwan, in 1996, 1998, and 2002, respectively, all in Electrical and Control Engineering. From 2003 to 2007, he was a Post-Doctoral Research Fellow with the Department of Communications Engineering, National Chiao Tung University. Since 2008, he has been with the Department of Electrical and Computer Engineering, and Institute of Communications Engineering, National Chiao Tung University, where he is currently a Full Professor. His general research interests are in signal processing, wireless communications, and control systems. He received several research awards, including the 2015 Academia Sinica Research Award for Junior Research Investigators, the Ta-You Wu Memorial Award from the Ministry of Science and Technology of Taiwan in 2014, the 12th Y. Z. Hsu Scientific Paper Award (Communication Technology Category) in 2014, and the 2013 Best Paper Award for Young Scholars by the IEEE Information Theory Society Taipei Chapter and the IEEE Communications Society Taipei/Tainan Chapter. He served as the chair of IEEE Information Theory Society Taipei Chapter during Aug. 2017~July 2019. He is currently the Director of the Institute of Communications Engineering, National Yang Ming Chiao Tung University, Taiwan.