Zhu, Jian https://orcid.org/0000-0002-4198-9009
Feng, Peicheng
Lu, Jiawei
Fang, Bowei
Yang, Hesong https://orcid.org/0009-0009-0523-8337
Funding for this research was provided by:
Postdoctoral Research Foundation of China (2022M712540)
Article Title: ZeROf-Offload: forward-gradient scheme for efficient full parameter fine-tuning of billion-scale language models
Journal Title: Machine Learning: Science and Technology
Article Type: paper
Copyright Information: © 2024 The Author(s). Published by IOP Publishing Ltd
Publication dates
Date Received: 2024-06-20
Date Accepted: 2024-11-22
Online publication date: 2024-12-04