Tamang, Sagar https://orcid.org/0009-0007-8038-1278
Bora, Dibya Jyoti https://orcid.org/0000-0001-7809-5220
Article History
Received: 30 October 2024
Accepted: 30 January 2025
First Online: 26 February 2025
Declarations
:
: The authors declare that they have no financial or non-financial competing interests related to this research. This study is an independent analysis of tokenizer performance in Assamese language across various state-of-theart large language models.