Skip to content

< Back


LLamaPoolingType

Namespace: LLama.Native

1
public enum LLamaPoolingType

Inheritance ObjectValueTypeEnumLLamaPoolingType
Implements IComparable, ISpanFormattable, IFormattable, IConvertible

Remarks:

llama_pooling_type

Fields

Name Value Description
Unspecified -1 No specific pooling type. Use the model default if this is specific in IContextParams.PoolingType
None 0 Do not pool embeddings (per-token embeddings)
Mean 1 Take the mean of every token embedding
CLS 2 Return the embedding for the special "CLS" token
Last 3 Return the embeddings of the last token
Rank 4 Used by reranking models to attach the classification head to the graph

< Back