LLamaBeamView
Namespace: LLama.Native
Information about a single beam in a beam search
public struct LLamaBeamView
Inheritance Object → ValueType → LLamaBeamView
Fields
CumulativeProbability
Cumulative beam probability (renormalized relative to all beams)
public float CumulativeProbability;
EndOfBeam
Callback should set this to true when a beam is at end-of-beam.
public bool EndOfBeam;
Properties
Tokens
Tokens in this beam
public Span<LLamaToken> Tokens { get; }