Yifei Ming

Contact: alvinming5 [at] gmail [dot] com

Hi! I am a research scientist at Salesforce AI Research. I am broadly interested in trustworthy AI that aligns with human values, and agentic systems powered by large language models (LLM). In particular,

  • Understand what LLM-based systems can and cannot do—through world simulations, sandbox environments, challenging benchmarks, and evaluation protocols.
  • Design and build effective and trustworthy agentic systems—agents that can use tools, process long contexts, conduct deep research, and engage in multi-turn interactions.

News

09/2024 Is a picture worth a thousand words? 🤔 Check out our new work on spatial reasoning of LLMs and multi-modal LLMs at NeurIPS 2024 ✨
05/2024 Starting a new position as a Research Scientist at Salesforce! Super excited to explore the frontiers of LLM, VLM, reliable ML, among other fascinating topics.
05/2024 Defended my Ph.D. thesis on Reliable Foundation Models in the Open World :mortar_board:
01/2024 Our paper Understanding Retrieval-Augmented Task Adaptation for Vision-Language Models is accepted by ICML 2024. :tada:
01/2024 Our paper Provable Out-of-Distribution Generalization in Hypersphere is accepted by ICLR 2024. :tada:
More News

Publications

  1. TMLR
    A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems
    Zixuan Ke, Fangkai Jiao, Yifei Ming, Xuan-Phi Nguyen, Austin Xu, Do Xuan Long, Minzhi Li, Chengwei Qin, Peifeng Wang, Silvio Savarese, Caiming Xiong, and Shafiq Joty
    In Transactions on Machine Learning Research (TMLR) 2025
    Paper
  2. ACL
    Does Context Matter? ContextualJudgeBench for Evaluating LLM-based Judges in Contextual Settings
    Austin Xu, Srijan Bansal, Yifei Ming, Semih Yavuz, and Shafiq Joty
    In Annual Conference of the Association for Computational Linguistics (ACL) 2025
    Code Paper
  3. ACL
    Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
    Atsuyuki Miyai, Jingkang Yang, Jingyang Zhang, Yifei Ming, Qing Yu, Go Irie, Yixuan Li, Hai Li, Ziwei Liu, and Kiyoharu Aizawa
    In Annual Conference of the Association for Computational Linguistics (ACL) 2025
    Code Paper
  4. TMLR
    Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Survey
    Atsuyuki Miyai, Jingkang Yang, Jingyang Zhang, Yifei Ming, Yueqian Lin, Qing Yu, Go Irie, Shafiq Joty, Yixuan Li, Hai Li, Ziwei Liu, Toshihiko Yamasaki, and Kiyoharu Aizawa
    In Transactions on Machine Learning Research (TMLR) 2025
    Paper
  5. ICLR
    FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"
    Yifei Ming, Senthil Purushwalkam, Shrey Pandit, Zixuan Ke, Xuan-Phi Nguyen, Caiming Xiong, and Shafiq Joty
    In International Conference on Learning Representations (ICLR) 2025
    Code Paper
  6. NeurIPS
    Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models
    Jiayu Wang, Yifei Ming, Zhenmei Shi, Vibhav Vineet, Xin Wang, Yixuan Li, and Neel Joshi
    In Neural Information Processing Systems (NeurIPS) 2024
    Paper
  7. ICML
    Understanding Retrieval-Augmented Task Adaptation for Vision-Language Models
    Yifei Ming, and Yixuan Li
    In International Conference on Machine Learning (ICML) 2024
    Paper
  8. ICLR
    Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
    Atsuyuki Miyai, Jingkang Yang, Jingyang Zhang, Yifei Ming, Qing Yu, Go Irie, Yixuan Li, Hai Li, Ziwei Liu, and Kiyoharu Aizawa
    In International Conference on Learning Representations (ICLR), Workshop on Reliable and Responsible Foundation Models 2024
    Code Paper
  9. ICLR
    Provable Out-of-Distribution Generalization in Hypersphere
    Haoyue Bai*, Yifei Ming*, Julian Katz-Samuels, and Yixuan Li
    In International Conference on Learning Representations (ICLR) 2024
    Paper
  10. CPAL Oral
    Domain Generalization via Nuclear Norm Regularization
    Zhenmei Shi*, Yifei Ming*, Ying Fan*, Frederic Sala, and Yingyu Liang
    In Conference on Parsimony and Learning (CPAL) 2023
    Paper
  11. EMNLP
    A Critical Analysis of Document Out-of-Distribution Detection
    Jiuxiang Gu*, Yifei Ming*, Yi Zhou, Jason Kuen, Vlad I Morariu, Handong Zhao, Nikolaos Barmpalios Ruiyi Zhang, Anqi Liu, Yixuan Li, Tong Sun, and Ani Nenkova
    In Empirical Methods in Natural Language Processing (EMNLP Findings) 2023
    Paper
  12. IJCV
    How Does Fine-Tuning Impact Out-of-Distribution Detection for Vision-Language Models?
    Yifei Ming, and Yixuan Li
    In International Journal of Computer Vision (IJCV) 2023
    Paper
  13. ICLR
    How to Exploit Hyperspherical Embeddings for Out-of-Distribution Detection?
    Yifei Ming, Yiyou Sun, Ousmane Dia, and Yixuan Li
    In International Conference on Learning Representations (ICLR) 2023
    Code Paper
  14. NeurIPS
    Delving into Out-of-Distribution Detection with Vision-Language Representations
    Yifei Ming, Ziyang Cai, Jiuxiang Gu, Yiyou Sun, Wei Li, and Yixuan Li
    In Neural Information Processing Systems (NeurIPS) 2022
    Code Paper
  15. NeurIPS
    SIREN: Shaping Representations for Detecting Out-of-distribution Objects
    Xuefeng Du, Gabriel Gozum, Yifei Ming, and Yixuan Li
    In Neural Information Processing Systems (NeurIPS) 2022
    Code Paper
  16. NeurIPS
    Domain Generalization with Nuclear Norm Regularization
    Zhenmei Shi*, Yifei Ming*, Ying Fan*, Frederic Sala, and Yingyu Liang
    In Neural Information Processing Systems (NeurIPS’W) DistShift Workshop 2022
    Paper
  17. EMNLP
    Utilizing Language-Image Pretraining for Efficient and Robust Bilingual Word Alignment
    Tuan Dinh, Jy-yong Sohn, Shashank Rajput, Timothy Ossowski, Yifei Ming, Junjie Hu, Dimitris Papailiopoulos, and Kangwook Lee
    In Empirical Methods in Natural Language Processing (EMNLP Findings) 2022
    Code Paper
  18. ICML Oral
    POEM: Out-of-Distribution Detection with Posterior Sampling
    Yifei Ming*, Ying Fan*, and Yixuan Li
    In International Conference on Machine Learning (ICML) 2022
    Oral Presentation [Top 2%]
    Code Paper
  19. ICML
    Out-of-Distribution Detection with Deep Nearest Neighbors
    Yiyou Sun, Yifei Ming, Xiaojin Zhu, and Yixuan Li
    In International Conference on Machine Learning (ICML) 2022
    Code Paper
  20. ICML
    Are Vision Transformers Robust to Spurious Correlations?
    Soumya Suvra Ghosal, Yifei Ming, and Yixuan Li
    In International Conference on Machine Learning (ICML’W), SCIS Workshop 2022
    Paper
  21. AAAI Oral
    On the Impact of Spurious Correlation for Out-of-distribution Detection
    Yifei Ming, Hang Yin, and Yixuan Li
    In The AAAI Conference on Artificial Intelligence (AAAI) 2022
    Code Paper
  22. ICML Oral
    Model-based Reinforcement Learning for Continuous Control with Posterior Sampling
    Ying Fan, and Yifei Ming
    In International Conference on Machine Learning (ICML) 2021
    Oral Presentation [Top 3%]
    Code Paper