AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling
Jun Zhan, Junqi Dai, Jiasheng Ye, Yunhua Zhou, Dong Zhang, Zhigeng Liu, Xin Zhang, Ruibin Yuan, Ge Zhang, Linyang Li, Hang Yan, Jie Fu, Tao Gui, Tianxiang Sun, Yugang Jiang1, Xipeng Qiu

Project

• AnyGPT is the first any-to-any multimodal LLM based on discrete representations.
• Academic Impact: This work has received 350+ stars on GitHub, promoted by more than 10 media and forums, such as 机器之心

SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities
Dong Zhang, Shimin Li, Xin Zhang, Jun Zhan, Pengyu Wang, Yaqian Zhou, Xipeng Qiu

Project

• SpeechGPT is the first LLM with intrinsic cross-modal generation abilities.
• Academic Impact: This work has received 800+ stars on GitHub, promoted by more than 10 media and forums, such as 机器之心

MOSS: A Conversational Language Model

• Tianxiang Sun, Xiaotian Zhang, Zhengfu He, Peng Li, Qinyuan Cheng, Hang Yan, Xiangyang Liu, Yunfan Shao, Qiong Tang, Xingjian Zhao, Ke Chen, Yining Zheng, Zhejian Zhou, Ruixiao Li, Jun Zhan, Yunhua Zhou, Linyang Li, Xiaogui Yang, Lingling Wu, Zhangyue Yin, Xuanjing Huang, Xipeng Qiu.
• 🌟 MOSS is the first ChatGPT-like LLM in China, and fully open sourced with 11.7k+ stars. GitHub