Changhao Li

This is Changhao Li’s personal homepage.

A short introduction

I am a first-year Ph.D. student at Georgia Institute of Technology, advised by Bo Dai and Chao Zhang. Previously, I was an undergraduate student studying at Tsinghua University, majoring in Computer Scienece. I was a member of the TSAIL group, where I was advised by Jianfei Chen and Jun Zhu.

During my undergraduate years, I have explored the way of accelerating neural network training using 4-bit Quantization, which was published at Neruips 2023 (paper).

In 2023 summer, I worked with Woojeong Jin and Xiang Ren on how to improve the multi-step reasoning qualities using distillation and reinforcement-learning methods.

In the spring of 2024, I further explored how to train a zero-shot quantized neural network by synthsizing data from a pre-trained model.

Papers

Haocheng Xi, Changhao Li, Jianfei Chen and Jun Zhu. Training Transformers with 4-bit Integers. (Paper)

For more information

More info about Changhao Li can be found in CV or downloaded CV.