Hanyang Li

Email: hanyang_li AT berkeley DOT eduGoogle ScholarGitHub

About

Hanyang Li

I am a Ph.D. candidate in the Department of Industrial Engineering and Operations Research (IEOR) at the University of California, Berkeley, advised by Professor Ying Cui.

My research focuses on theoretically grounded numerical methods for optimization and decision-making in large-scale complex systems and on the computational foundations of AI, particularly methods for training LLMs at low precision and compressing them for efficient inference.

I am on the 2026–2027 academic job market.

Education

Publications and Preprints

Nonsmooth and Stochastic Optimization

  1. Subgradient Regularization: A Descent-Oriented Subgradient Method for Nonsmooth Optimization

    Hanyang Li, Ying Cui

    Submitted, 2025 [code]

  2. Variational Theory and Algorithms for a Class of Asymptotically Approachable Nonconvex Problems

    Hanyang Li, Ying Cui

    Mathematics of Operations Research, 51(1), 1–34 [slide]

    • Katta G. Murty Prize for Best Paper in Optimization, UC Berkeley (2025).
  3. A Decomposition Algorithm for Two-Stage Stochastic Programs with Nonconvex Recourse Functions

    Hanyang Li, Ying Cui

    SIAM Journal on Optimization, 34(1), 306–335 [code] [slide]

    • Runner-up, Dupacova–Prekopa Best Student Paper Prize (2023).
    • Third Place, INFORMS JFIG Paper Competition (2022).

Optimization for Efficient LLM Training and Inference

  1. Beyond Shadow Weights: Quantization-Aware Training as Quantized-Endpoint Descent

    Sheng-An Xu, Hanyang Li, Jianhao Ma, Ying Cui

    Submitted, 2026

  2. Understanding Quantization-Aware Training: Gradients at Quantized Weights Bias to the Low-Loss Basin

    Hanyang Li, Jianhao Ma, Ying Cui

    Submitted, 2026

  3. Rounding in Preconditioner Space: Redesigning 4-bit AdamW Optimizer-State Quantization

    Hanyang Li, Shao Tang, Daniel Thomas Braithwaite, Gregory Dexter, Leonardo Neves, Aman Gupta, Hiroto Udagawa, Abhishek Shivanna, Daniel Silva, Rohan Ramanath

    Submitted, 2026 [code]

    • Preliminary version appears in the NeurIPS 2026 Workshop on Optimization for Machine Learning (OPT 2026).

2026

  1. Beyond Shadow Weights: Quantization-Aware Training as Quantized-Endpoint Descent

    Sheng-An Xu, Hanyang Li, Jianhao Ma, Ying Cui

    Submitted, 2026

  2. Understanding Quantization-Aware Training: Gradients at Quantized Weights Bias to the Low-Loss Basin

    Hanyang Li, Jianhao Ma, Ying Cui

    Submitted, 2026

  3. Rounding in Preconditioner Space: Redesigning 4-bit AdamW Optimizer-State Quantization

    Hanyang Li, Shao Tang, Daniel Thomas Braithwaite, Gregory Dexter, Leonardo Neves, Aman Gupta, Hiroto Udagawa, Abhishek Shivanna, Daniel Silva, Rohan Ramanath

    Submitted, 2026 [code]

    • Preliminary version appears in the NeurIPS 2026 Workshop on Optimization for Machine Learning (OPT 2026).

2025

  1. Subgradient Regularization: A Descent-Oriented Subgradient Method for Nonsmooth Optimization

    Hanyang Li, Ying Cui

    Submitted, 2025 [code]

  2. Variational Theory and Algorithms for a Class of Asymptotically Approachable Nonconvex Problems

    Hanyang Li, Ying Cui

    Mathematics of Operations Research, 51(1), 1–34 [slide]

    • Katta G. Murty Prize for Best Paper in Optimization, UC Berkeley (2025).

2024

  1. A Decomposition Algorithm for Two-Stage Stochastic Programs with Nonconvex Recourse Functions

    Hanyang Li, Ying Cui

    SIAM Journal on Optimization, 34(1), 306–335 [code] [slide]

    • Runner-up, Dupacova–Prekopa Best Student Paper Prize (2023).
    • Third Place, INFORMS JFIG Paper Competition (2022).

Honors and Awards

Talks and Presentations

  • INFORMS Annual MeetingSession on Optimization Methods for Quantizing and Pruning LLMs
    11/2026San Francisco, CA
  • Cornell ORIE Young Researchers WorkshopPoster presentation
    10/2026Ithaca, NY
  • INFORMS Optimization Society ConferenceSession on Recent Advances in Stochastic and Large-Scale Optimization
    03/2026Atlanta, GA
  • Hong Kong University of Science and TechnologyJoint IEDA/ISOM Seminar
    01/2026Hong Kong
  • Hong Kong Polytechnic UniversityAMA Seminar Series on Young Scholars in Optimization and Data Science
    01/2026Hong Kong
  • International Conference on Continuous OptimizationSession on First-order Methods for Nonsmooth Constrained Optimization
    07/2025Los Angeles, CA
  • INFORMS Annual MeetingSession on Recent Advances in Nonsmooth Optimization
    10/2023Phoenix, AZ
  • XVI International Conference on Stochastic ProgrammingStudent Paper Prize Competition
    07/2023Davis, CA

Teaching

Graduate Student Instructor at University of California, Berkeley

  • INDENG 242A: Machine Learning and Data Analytics (graduate)Fall 2025

Teaching Assistant at University of Minnesota, Twin Cities

  • IE 3012: Optimization II (undergraduate)Spring 2022
  • IE 5441: Financial Decision Making (graduate)Spring 2022

Teaching Assistant at University of Science and Technology of China

  • Mathematical Analysis B1 (undergraduate)Fall 2020
Last updated: November 2026