Selected Projects

😺 I enjoy open-sourcing. Here are a selection of projects that I’ve led or served as the core contributor.

Native Multimodal RL

Kimi-K2.5

Moonshot's most powerful native multimodal agentic model. I led the Native Multimodal RL (K2.5 Report Chap2.2): ZeroVision ColdStart → Vision-Centric RL, Vision Reasoning & TIR RL, and Chart Understanding.

Mar 27, 2025

MoE in Downstream Tasks

ChartMoE: Mixture of Diversely Aligned Expert Connector for Chart Understanding

ChartMoE is a multimodal large language model with Mixture-of-Expert connector for advanced chart 1️⃣understanding, 2️⃣replot, 3️⃣editing, 4️⃣highlighting and 5️⃣transformation.

Jan 22, 2025

Native Multimodal MoE

Aria (1000+ ⭐)

Aria is a multimodal native MoE model. It features：1️⃣State-of-the-art performance on various multimodal and language tasks, superior in video and document understanding; 2️⃣Long multimodal context window of 64K tokens; 3️⃣3.9B activated parameters per token, enabling fast inference speed and low fine-tuning cost.

Oct 10, 2024

MLLM Training Framework (Supporting Multimodal Pipeline Parallel)

MPP-LLaVA (600+ ⭐)

The Repo supports {video/image/multi-image} {single/multi-turn} conversations. All 7B/14B llava-like training is conducted on 3090/4090 GPUs. To prevent poverty (24GB of VRAM) from limiting imagination, I implemented an MLLM version based on deepspeed Pipeline Parallel.

Dec 25, 2023

Awards

🎤 ICLR 2025 Oral · Top 1.8% - ChartMoE

ICLR 2025 ∙ February 2025

ChartMoE: Mixture of Diversely Aligned Expert Connector for Chart Understanding

Selected for Oral Presentation at the 2025 International Conference on Learning Representations (Top 1.8%).

🐙 See github repo

🥉3rd winner of NTIRE 2024 Quality Assessment for AI-Generated Content - Track 2 Video

CVPR & NTIRE ∙ April 2024

Exploring AIGC Video Quality: A Focus on 1️⃣Visual Harmony, 2️⃣Video-Text Consistency and 3️⃣Domain Distribution Gap.

Paper: https://arxiv.org/abs/2404.13573

See certificate

🥈Kaggle Silver Medal：Stable Diffusion - Image to Prompts

Kaggle ∙ May 2023

As a captain, win a silver medal🥈.(42/1231, Top3%)

See certificate

🏅Honorous Bachelor Degree

Huazhong University of Science and Technology (HUST) ∙ June 2022

Honours Bachelor Degree (Summa Cum Laude, Top 2%), due to GPA, scientific research achievements, and student work awards.