AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling
Jun Zhan*, Junqi Dai*, Jiasheng*, Yunhua Zhou*, Dong Zhang, Zhigeng Liu, Xin Zhang, Ruibin Yuan, Ge Zhang, Linyang Li, Hang Yan, Jie Fu, Tao Gui, Tianxiang Sun, Yugang Jiang1, Xipeng Qiu

Project

• Role: Project Lead
• AnyGPT is the first any-to-any multimodal LLM based on discrete representations.
• Academic Impact: This work has received 800+ stars on GitHub, promoted by more than 10 media and forums, such as 机器之心

SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities
Dong Zhang, Shimin Li, Xin Zhang, Jun Zhan, Pengyu Wang, Yaqian Zhou, Xipeng Qiu

Project

• SpeechGPT is the first LLM with intrinsic cross-modal generation abilities.
• Academic Impact: This work has received 1.3k+ stars on GitHub, promoted by more than 10 media and forums, such as 机器之心

MOSS: A Conversational Language Model

• Tianxiang Sun, Xiaotian Zhang, Zhengfu He, Peng Li, Qinyuan Cheng, Hang Yan, Xiangyang Liu, Yunfan Shao, Qiong Tang, Xingjian Zhao, Ke Chen, Yining Zheng, Zhejian Zhou, Ruixiao Li, Jun Zhan, Yunhua Zhou, Linyang Li, Xiaogui Yang, Lingling Wu, Zhangyue Yin, Xuanjing Huang, Xipeng Qiu.
• 🌟 MOSS is the first ChatGPT-like LLM in China, and fully open sourced with 12k+ stars. GitHub

SpeechGPT2: End-to-End Human-Like Spoken Chatbot

• Dong Zhang, Qian Tu*, Ruifan Deng*, Jun Zhan*, Zixin Wang*, Xingjian Zhao, Ke Chen, Xin Zhang, Pengyu Wang, Zhaowei Li, Shimin Li, Yaqian Zhou, Xipeng Qiu.
• 🌟 SpeechGPT2 is a emotional intelligent end-to-end spoken dialogue LLM.