About Me
Hi! I am joint PhD student of Nankai University and Microsoft Research Asia (MSRA), supervised by Prof. Zhenglu Yang and Dr. Ming Zhou. I received my bachelor degree from Nankai University in 2018. Currently, I am working as a research intern at Natural Language Computing Group in MSRA, mentored by Dr. Yu Wu and Dr. Shujie Liu. My research interests include speech recognition, speech pre-training and speech translation.
Email: cywang@mail.nankai.edu.cn Google Scholar
Publications
Chengyi Wang, Yu Wu, Shujie Liu, Zhenglu Yang and Ming Zhou. Bridging the Gap between Pre-training and Fine-tuning for End-to-End Speech Translation. (AAAI 2020). [pdf]
Chengyi Wang, Yu Wu, Shujie Liu, Ming Zhou and Zhenglu Yang. Curriculum Pre-training for End-to-End Speech Translation. (ACL 2020). [pdf]
Chengyi Wang, Yu Wu, Yao Qian, Kenichi Kumatani, Shujie Liu, Furu Wei, Michael Zeng, Xuedong Huang. Unispeech: Unified Speech Representation Learning with Labeled and Unlabeled Data. (ICML 2021). [pdf] [code]
Chengyi Wang, Yu Wu, Sanyuan Chen, Shujie Liu, Jinyu Li, Yao Qian, Zhenglu Yang. Self-Supervised Learning for speech recognition with Intermediate layer supervision. (ICASSP 2022). [pdf][code]
Chengyi Wang, Yu Wu, Yujiao Du, Jinyu Li, Shujie Liu, Liang Lu, Shuo Ren, Guoli Ye, Sheng Zhao and Ming Zhou. Semantic Mask for Transformer-based End-to-End Speech Recognition. (InterSpeech 2020). [pdf][code]
Chengyi Wang, Yu Wu, Liang Lu, Shujie Liu, Jinyu Li, Guoli Ye and Ming Zhou. Low Latency End-to-End Streaming Speech Recognition with a Scout Network. (Interspeech 2020). Best Paper nomination [pdf][code]
Sanyuan Chen*, Chengyi Wang*, Zhengyang Chen*, Yu Wu*, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Micheal Zeng, Furu Wei. WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing. ArXiv Preprent. (*joint first author) [pdf][code]
Sanyuan Chen, Yu Wu, Chengyi Wang, Zhengyang Chen, Zhuo Chen, Shujie Liu, Jian Wu, Yao Qian, Furu Wei, Jinyu Li, Xiangzhan Yu. Unispeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-training. (ICASSP 2022). [pdf][code]
Junyi Ao*, Rui Wang*, Long Zhou, Chengyi Wang, Shuo Ren, Yu Wu, Shujie Liu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei. SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing. (ACL 2022). [pdf]
Jinyu Li, Yu Wu, Yashesh Gaur, Chengyi Wang, Rui Zhao, Shujie Liu. On the Comparison of Popular End-to-End Models for Large Scale Speech Recognition. (InterSpeech 2020). [pdf]