Crossmark

Head information bottleneck (HIB): leveraging information bottleneck for efficient transformer head attribution and pruning

Published Online: 2025-07-01

Authors

Qian, Yukun

Zhuang, Xuyi

Wang, Mingjiang
Funding

Funding for this research was provided by:

National Natural Science Foundation of China (62276076)

National Natural Science Foundation of China (62176102)
License Information

Text and Data Mining valid from 2025-07-01

Version of Record valid from 2025-07-01
More Information

Article History

Received: 8 January 2025

Accepted: 11 June 2025

First Online: 1 July 2025

Declarations

:

: The authors declare that they have no competing interests.

Document is current