LLamaTokenDataArrayNative

Namespace: LLama.Native

Contains a pointer to an array of LLamaTokenData which is pinned in memory.

public struct LLamaTokenDataArrayNative

Remarks:

C# equivalent of llama_token_data_array

Properties

A pointer to an array of LlamaTokenData

public Span<LLamaTokenData> Data { get; }

Indicates if the items in the array are sorted, so the most likely token is first

public bool Sorted { get; set; }

The index of the selected token (i.e. not the token id)

public long Selected { get; set; }

Number of LLamaTokenData in the array. Set this to shrink the array

public ulong Size { get; set; }

Create a new LLamaTokenDataArrayNative around the data in the LLamaTokenDataArray

MemoryHandle Create(LLamaTokenDataArray array, LLamaTokenDataArrayNative& native)

array LLamaTokenDataArray
Data source

native LLamaTokenDataArrayNative&
Created native array

MemoryHandle
A memory handle, pinning the data in place until disposed