LLamaBeamsState
Namespace: LLama.Native
Passed to beam_search_callback function. Whenever 0 < common_prefix_length, this number of tokens should be copied from any of the beams (e.g. beams[0]) as they will be removed (shifted) from all beams in all subsequent callbacks.
public struct LLamaBeamsState
Inheritance Object → ValueType → LLamaBeamsState
Fields
CommonPrefixLength
Current max length of prefix tokens shared by all beams.
public ulong CommonPrefixLength;
LastCall
True iff this is the last callback invocation.
public bool LastCall;
Properties
Beams
The current state of each beam
public Span<LLamaBeamView> Beams { get; }