Crossmark

SparkAttention: high-performance multi-head attention for large models on Volta GPU architecture

Published Online: 2025-02-12

Published Print: 2025-02

Authors

Xu, Youxuan

Wu, Tong

Li, Shigang https://orcid.org/0000-0003-0022-7865
Wang, Xueying

Wang, Jingjing
Funding

Funding for this research was provided by:

National Science and Technology Major Project of China (2023ZD0120502)

National Natural Science Foundation of China (62372055)
License Information

Text and Data Mining valid from 2025-02-01

Version of Record valid from 2025-02-01
More Information

Article History

Received: 16 August 2024

Accepted: 19 December 2024

First Online: 12 February 2025

Declarations

:

: On behalf of all authors, the corresponding author states that there is no Conflict of interest.

Document is current