Jiaming Ji (吉嘉铭)Phd Student at Peking University
AI Alignment |
|
About me
I’m a PhD student at the Institute of Artificial Intelligence, Peking University, advised by Prof. Yaodong Yang (both a good teacher and a helpful friend in my life). In parallel, I am also a visiting scholar at the Hong Kong University of Science and Technology, advised by renowned computer scientist Prof. Yike Guo. My research focuses on Reinforcement Learning, Large Language Models, Multimodal Models and Safety Alignment, with a strong emphasis on bridging academic advances and real-world deployment. I have contributed to the open-source and real-world deployment of several large-scale models, including Baichuan2, the Hong Kong AI Model HKGAI-v1, the Pengcheng Brain model, and the medical triage model MedGuide. Notably, MedGuide has been deployed in hospitals and is actively supporting doctors and nurses in emergency triage—something I take great pride in beyond my academic achievements.
In 2025, I was honored to be selected as an Apple Scholar in AI/ML, mentored by Rin Metcalf Susa and Natalie Mackraz. In 2024, I received the first batch of National Natural Science Foundation funding for the Youth Student Basic Research Project (Ph.D. track), as the sole awardee from Peking University in the field of intelligence. Prior to my Ph.D., I conducted research on neuromorphic computing and brain-computer interfaces with Prof. Gang Pan at Zhejiang University. I began my research journey focusing on safe reinforcement learning and won the championship in the NeurIPS 2022 MyoChallenge for robotic dexterous manipulation.
关于我（中文）
吉嘉铭，北京大学人工智能研究院博士生在读，导师为杨耀东老师，研究方向为强化学习、大模型的安全与价值对齐，在计算机顶级会议期刊发表口头、焦点论文等十余篇，谷歌学术引用累计2200余次，模型开源累计下载500W，GitHub开源累计获得2W+ Star。曾获首批国自然博士青年基金资助（2023年度北京大学智能学科唯一），苹果学者奖学金（Apple Scholar，全国仅两位），获北京大学博士最高研究奖“校长奖学金”， 首届中国电子学会—腾讯博士生科研激励计划（全国17人），获 NeurIPS‘22 机器人灵巧操作比赛冠军，研究成果及模型被OpenAI 、Meta引用，被MIT Tech Review报道。
News
-
2025-07Language Model Resist Alignment has been awarded the ACL 2025 Best Paper!
-
2024-01MedAligner has been accepted to The Innovation (Impact Factor=32.1).
-
2025-05Four papers are accepted by ACL 2025 Main.
-
2025-05SAE-V has been accepted as ICML 2025.
-
2024-12
-
2024-09
-
2024-09RL framework: OmniSafe is accepted by JMLR 2024 (The most popular Safe Reinforcement Learning framework).
-
2024-06We released PKU-SafeRLHF dataset, the 2nd version of BeaverTails (The total number of downloads: 800K+).
-
2024-01
Research Summary
Currently, i focus on AI Safety and Alignment.
-
AI Alignment: Given the biases and discriminations that may exist in pre-training data, large models (LMs) may exhibit unintended behaviors. I am interested in alignment methods (e.g., Reinforcement Learning from human feedback (RLHF)) and post-hoc alignment methods to ensure the safety and trustworthy of LLMs.
-
Theoretical Explanations and Mechanism Design for Alignment: Aligning these AI System (e.g. LLMs) effectively to ensure consistency with human intentions and values (though some views may question universal values) is a significant current challenge. I am particularly interested in ensuring the feasibility of these alignment methods in both theoretical and practical mechanisms.
-
Applications (LM + X): I am interested in the application of large models in various domain, such as healthcare and education, and the potential impact of rapid industry development and iteration brought about by large models.
Honors
-
2025-03Apple Scholars in AI/ML. 苹果学者，全国仅两位。
-
2024-12CIE-Tencent Doctoral Research Incentive Project. 首届中国电子学会—腾讯博士生科研激励计划，全国17人，科研基金10万。
-
2024-05Peking University President Scholarship, the highest doctoral research honor. 北京大学校长奖学金。
-
2024-05National Natural Science Foundation for Ph.D. students (first batch; the sole recipient in the Peking University's intelligence field). 首批国家自然科学基金青年学生基础研究项目（博士研究生）项目资助，北大智能学科唯一。
Preprints
Borong Zhang, Yuhao Zhang, Jiaming Ji, Yingshan Lei, Josef Dai, Yuanpei Chen, Yaodong Yang
Arxiv, 2025
[Project Webpage]
Jiaming Ji, Jiayi Zhou, Hantao Lou, Boyuan Chen, Donghai Hong, Xuyao Wang, ..., Yaodong Yang
Arxiv, 2025
[Code][Data]
Jiaming Ji, Tianyi Qiu, Boyuan Chen, Borong Zhang, Hantao Lou, Kaile Wang, ..., Jie Fu, Stephen McAleer, Yaodong Yang, Yizhou Wang, Song-Chun Zhu, Yike Guo, Wen Gao
Arxiv, 2024
[Project Webpage]
Publications (* denotes equal contribution, and † denotes the corresponding author)
Jiaming Ji, Kaile Wang, Tianyi Qiu, Boyuan Chen, Jiayi Zhou, Changye Li, Hantao Lou, Juntao Dai, Yunhuai Liu, Yaodong Yang
ACL Best Paper, 2025
[Paper]
Jiaming Ji, Donghai Hong, Borong Zhang, Boyuan Chen, Josef Dai, Boren Zheng, Tianyi Qiu, Boxun Li, Yaodong Yang
ACL Main, 2025
[Paper][Data]
Tianyi Qiu, Fanzhi Zeng, Jiaming Ji, Dong Yan, Kaile Wang, Jiayi Zhou, Yang Han, Josef Dai, Xuehai Pan, Yaodong Yang
ACL Findings, 2025
[Paper]
Hantao Lou, Jiaming Ji, Kaile Wang, Yaodong Yang
AAAI, 2025
[Paper]
Jiayi Zhou, Jiaming Ji, Juntao Dai, Yaodong Yang
AAAI Oral, 2025
[Paper]
Jiaming Ji, Jiayi Zhou, Borong Zhang, Juntao Dai, Xuehai Pan, Ruiyang Sun, Weidong Huang, Yiran Geng, Mickel Liu, Yaodong Yang
JMLR, 2024
Jiaming Ji, Boyuan Chen, Hantao Lou, Donghai Hong, Borong Zhang, Xuehai Pan, Juntao Dai, Yaodong Yang
NeurIPS Oral, 2024
[Code][Data]
Tianyi Qiu, Yang Zhang, Xuchuan Huang, Jasmine Xinze Li, Jiaming Ji, Yaodong Yang
NeurIPS Spotlight, 2024
Josef Dai, Xuehai Pan, Ruiyang Sun, Jiaming Ji, Xinbo Xu, Mickel Liu, Yizhou Wang, Yaodong Yang
ICLR Spotlight, 2024
[Code]
Weidong Huang, Jiaming Ji, Chunhe Xia, Borong Zhang, Yaodong Yang
ICLR, 2024
[Code]
Jiaming Ji, Borong Zhang, Jiayi Zhou, Xuehai Pan, Weidong Huang, Ruiyang Sun, Yiran Geng, Yifan Zhong, Juntao Dai, Yaodong Yang
NeurIPS, 2023
[Paper][Code]
Jiaming Ji, Mickel Liu, Juntao Dai, Xuehai Pan, Chi Zhang, Ce Bian, Chi Zhang, Ruiyang Sun, Yizhou Wang, Yaodong Yang
NeurIPS, 2023
[Paper][Code][Data]
Jiaming Ji, Other Authors (Alphabetic Order)
Arxiv (Technical Report), 2023
[Code]
Long Yang, Jiaming Ji, Juntao Dai, Linrui Zhang, Binbin Zhou, Pengfei Li, Yaodong Yang, Gang Pan
NeurIPS, 2022
[Paper][Code]
Services
-
Reviewer for ICLR 2025
-
Reviewer for CVPR 2025
-
Reviewer for NeurIPS 2023, 2024 (main track, db track), 2025.
-
Reviewer for TMLR (Transactions on Machine Learning Research).
-
Program Committee for AAAI 2025.
Teaching Assistant
-
2024, 2025