The EOS Token (End of Sequence), often denoted as [EOS], is a special token positioned at the end of a text sequence.
Purpose:
- Especially useful where concatenating multiple unrelated text
- Usage is similar to the EndOfText Token for separating independent documents.
