Skip to content

< Back

LLamaAttentionType

Namespace: LLama.Native

1
public enum LLamaAttentionType

Inheritance Object → ValueType → Enum → LLamaAttentionType
Implements IComparable, ISpanFormattable, IFormattable, IConvertible

Remarks:

llama_attention_type

Fields

Name Value Description
Unspecified -1 Unspecified attention type. The library will attempt to find the best fit
Causal 0 The causal mask will be applied, causing tokens to only see previous tokens in the same sequence, and not future ones
NonCausal 1 The causal mask will not be applied, and tokens of the same sequence will be able to see each other

< Back