| H2o: Heavy-hitter oracle for efficient generative inference of large language models Z Zhang, Y Sheng, T Zhou, T Chen, L Zheng, R Cai, Z Song, Y Tian, C Ré, ... Advances in Neural Information Processing Systems 36, 34661-34710, 2023 | 355 | 2023 |
| Deja vu: Contextual sparsity for efficient llms at inference time Z Liu, J Wang, T Dao, T Zhou, B Yuan, Z Song, A Shrivastava, C Zhang, ... International Conference on Machine Learning, 22137-22176, 2023 | 285 | 2023 |
| A model for the triboelectric nanogenerator with inductive load and its energy boost potential M Lu, W Yin, A Peyton, Z Qu, X Meng, Y Xie, P Zhao, J Luo, Q Zhao, Y Tao, ... Nano Energy 63, 103883, 2019 | 37 | 2019 |
| Algorithm and hardness for dynamic attention maintenance in large language models J Brand, Z Song, T Zhou International Conference on Machine Learning 2024, 2023 | 36 | 2023 |
| Faster algorithm for structured john ellipsoid computation Z Song, X Yang, Y Yang, T Zhou arXiv preprint arXiv:2211.14407, 2022 | 31 | 2022 |
| Fourier circuits in neural networks: Unlocking the potential of large language models in mathematical reasoning and modular arithmetic J Gu, C Li, Y Liang, Z Shi, Z Song, T Zhou arXiv preprint arXiv:2402.09469, 2024 | 20 | 2024 |
| Space-efficient interior point method, with applications to linear programming and maximum weight bipartite matching SC Liu, Z Song, H Zhang, L Zhang, T Zhou arXiv preprint arXiv:2009.06106, 2020 | 18 | 2020 |
| Pre-trained large language models use fourier features to compute addition T Zhou, D Fu, V Sharan, R Jia arXiv preprint arXiv:2406.03445, 2024 | 5 | 2024 |
| Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training L Qin, S Mitra, Z Song, Y Yang, T Zhou Bigdata, 2023 | 2 | 2023 |
| FoNE: Precise Single-Token Number Embeddings via Fourier Features T Zhou, D Fu, M Soltanolkotabi, R Jia, V Sharan arXiv preprint arXiv:2502.09741, 2025 | | 2025 |
Zhao SongSimons Institute for the Theory of Computing, UC BerkeleyVerified email at ias.edu
