The BOS Token (Beginning of Sequence), often denoted as [BOS], is a special token that marks the start of a text sequence.
Purpose:
- Signifies to the llm where a piece of context begins or where a piece of content begins.
- Some researchers use this explicitly, though GPT models typically rely on the EndOfText Token.
