TensorBufferOverride

Namespace: LLama.Abstractions

Represents a mapping between a tensor name pattern and a specific buffer type

public class TensorBufferOverride

Properties

Pattern to match tensor names. This is a regular expression. You can check the tensor names via the model.Metadata.

public string Pattern { get; set; }

Buffer type to use for matching tensors. Examples: CPU, GPU0, GPU1

public string BufferType { get; set; }

Creates a new tensor buffer override

public TensorBufferOverride(string pattern, string bufferType)

pattern String
Pattern to match tensor names

bufferType String
Buffer type to use for matching tensors