GPUSplitMode
Namespace: LLama.Native
1 | |
Inheritance Object → ValueType → Enum → GPUSplitMode
Implements IComparable, ISpanFormattable, IFormattable, IConvertible
Remarks:
llama_split_mode
Fields
| Name | Value | Description |
|---|---|---|
| None | 0 | Single GPU |
| Layer | 1 | Split layers and KV across GPUs |
| Row | 2 | split layers and KV across GPUs, use tensor parallelism if supported |