LLamaTokenAttr
Namespace: LLama.Native
Token attributes
1 | |
Inheritance Object → ValueType → Enum → LLamaTokenAttr
Implements IComparable, ISpanFormattable, IFormattable, IConvertible
Attributes FlagsAttribute
Remarks:
C# equivalent of llama_token_attr
Fields
| Name | Value | Description |
|---|---|---|
| Undefined | 0 | |
| Unknown | 1 | |
| Unused | 2 | |
| Normal | 4 | |
| Control | 8 | |
| UserDefined | 16 | |
| Byte | 32 | |
| Normalized | 64 | |
| LStrip | 128 | |
| RStrip | 256 | |
| SingleWord | 512 |