RopeScalingType
Namespace: LLama.Native
RoPE scaling type.
1 |
|
Inheritance Object → ValueType → Enum → RopeScalingType
Implements IComparable, IFormattable, IConvertible
Remarks:
C# equivalent of llama_rope_scaling_type
Fields
Name | Value | Description |
---|---|---|
Unspecified | -1 | No particular scaling type has been specified |
None | 0 | Do not apply any RoPE scaling |
Linear | 1 | Positional linear interpolation, as described by kaikendev: https://kaiokendev.github.io/til#extending-context-to-8k |
Yarn | 2 | YaRN scaling: https://arxiv.org/pdf/2309.00071.pdf |