Token
A chunk of text — usually a word or a piece of a word.
LLMs read and produce text token by token. 'AIKO' might be one or two tokens depending on the model.
Where you'll meet this on AIKO
- School Track: Class 6 onwards
- Campus Track: from Age 18
A chunk of text — usually a word or a piece of a word.
LLMs read and produce text token by token. 'AIKO' might be one or two tokens depending on the model.