LLamaModelTensorBufferOverride

Namespace: LLama.Native

Represents a mapping between a tensor name pattern and a backend buffer type
Original type: llama_model_tensor_buft_override

public struct LLamaModelTensorBufferOverride

Fields

Tensor name pattern to match

public Byte* Pattern;

Backend buffer type to use for matching tensors, as obtained via ggml_backend_dev_buffer_type

public IntPtr BufferType;