Summary

AI Researcher

Education

• Ph.D in Version Control Theory

  2018
  GitHub University
• M.S. in Jekyll

  2014
  GitHub University
• B.S. in GitHub

  2012
  GitHub University

Publications

• Expert Merging in Sparse Mixture of Experts with Nash Bargaining

  2025
  arXiv preprint

  TL;DR: NAMEx uses Nash bargaining and complex momentum to merge experts more fairly and efficiently, outperforming prior methods across tasks. Abstract:Existing expert merging strategies for Sparse Mixture of Experts (SMoE) typically rely on input-dependent or input-independent averaging of expert parameters, but often lack a principled weighting mechanism. In this work, we reinterpret expert merging through the lens of game theory, revealing cooperative and competitive dynamics among experts. Based on this perspective, we introduce Nash Merging of Experts (NAMEx), a novel framework that incorporates Nash Bargaining into the merging process, enabling more balanced and efficient collaboration among experts. Additionally, we incorporate complex momentum into NAMEx to accelerate expert propagation with theoretical guarantees for convergence. Extensive experiments across language modeling, text classification, image classification, and zero-shot robustness under data corruption show that NAMEx consistently outperforms competing methods while integrating seamlessly with popular MoE architectures. Finally, we demonstrate NAMEx’s scalability by applying it to large-scale systems, including Qwen1.5-MoE (14B) and DeepSeek-MoE (16B), where it proves effective in both zero-shot and fine-tuning settings.

  View Publication
• Paper Title Number 2

  2025
  Sensors and Actuators A: Physical

  This paper is about the number 2. The number 3 is left for future work.

  View Publication
• Paper Title Number 3

  2015
  Journal 1

  This paper is about the number 3. The number 4 is left for future work.

  View Publication
• Paper Title Number 4

  2024
  GitHub Journal of Bugs

  This paper is about fixing template issue #693.

  View Publication

Presentations

• Talk 1 on Relevant Topic in Your Field

  2012
  UC San Francisco, Department of Testing

  San Francisco, CA, USA
• Tutorial 1 on Relevant Topic in Your Field

  2013
  UC-Berkeley Institute for Testing Science

  Berkeley, CA, USA
• Talk 2 on Relevant Topic in Your Field

  2014
  London School of Testing

  London, UK
• Conference Proceeding talk 3 on Relevant Topic in Your Field

  2014
  Testing Institute of America 2014 Annual Conference

  Los Angeles, CA, USA

Teaching

• Teaching experience 1

  2014
  University 1, Department

  Role: Undergraduate course
• Teaching experience 2

  2015
  University 1, Department

  Role: Workshop

Portfolio

• Portfolio item number 1
  Portfolio

  Short description of portfolio item number 1
  

  View Project