I currently work at AGI startup Moonshot AI (月之暗面).
My research interests are LLM Scaling, Efficient DL Methods, etc.

We are hiring! If you are passionate about developing next generation of AI, or if you're keen on crafting the next super app, or if you see yourself fitting into a role at Moonshot AI, don't hesitate to get in touch with me!

[Email] [Google Scholar]

Experiences

• LLM Researcher @ Moonshot AI
  Jul. 2023 ~ Now
  
  

• Senior Researcher @ Tencent
  Dec. 2021 ~ Jul. 2023
  
  

Publications

1. MoE-SLU: Towards ASR-Robust Spoken Language Understanding via Mixture-of-Experts
   [NAACL'24] X. Cheng, Z. Zhu, X. Zhuang, Z. Chen, Z. Huang, Y. Zou
2. Alignment before Awareness: Towards Visual Question Localized-Answering in Robotic Surgery via Optimal Transport and Answer Semantics
   [COLING'24] Z. Zhu, Y. Zhang, X. Cheng, Z. Huang, D, Xu, X. Wu, Y. Zheng

3. KC-Prompt: End-to-end Knowledge-Complementary Prompting for Rehearsal-free Continual Learning
   [ICASSP'24] Y. Li, Y. Liu, X. Cheng, Z. Zhu, H. Li, B. Yang, Z. Huang

4. Towards Unified SLU Decoding via Label-aware Compact Linguistics Representations
   [ACL'23] Z. Zhu, X. Cheng, Z. Huang, D. Chen, Y. Zou

5. A Multi-grained Contrastive Learning Framework for ASR-robust Language Understanding
   [EMNLP'23] Z. Huang, D. Chen, Z. Zhu, X. Cheng

6. Audio-Oriented Multimodal Machine Comprehension via Dynamic Inter- & Intra-modality Attention
   [AAAI'21] Z. Huang, F. Liu, X. Wu, S. Ge, H. Wang, W. Fan, Y. Zou

7. GhostBERT: Generate More Features with Cheap Operations for BERT
   [ACL'21] Z. Huang, L. Hou, L. Shang, X. Chen, X. Jiang, Q. Liu
   

8. DynaBERT: Dynamic BERT with Adaptive Width and Depth
   [NeurIPS'20] L. Hou, Z. Huang, L. Shang, X. Jiang, X. Chen, Q. Liu