LLamaPoolingType
Namespace: LLama.Native
1 |
|
Inheritance Object → ValueType → Enum → LLamaPoolingType
Implements IComparable, ISpanFormattable, IFormattable, IConvertible
Remarks:
llama_pooling_type
Fields
Name | Value | Description |
---|---|---|
Unspecified | -1 | No specific pooling type. Use the model default if this is specific in IContextParams.PoolingType |
None | 0 | Do not pool embeddings (per-token embeddings) |
Mean | 1 | Take the mean of every token embedding |
CLS | 2 | Return the embedding for the special "CLS" token |
Last | 3 | Return the embeddings of the last token |
Rank | 4 | Used by reranking models to attach the classification head to the graph |