LLamaBeamView

Namespace: LLama.Native

Information about a single beam in a beam search

public struct LLamaBeamView

Fields

Cumulative beam probability (renormalized relative to all beams)

public float CumulativeProbability;

Callback should set this to true when a beam is at end-of-beam.

public bool EndOfBeam;

Tokens in this beam

public Span<LLamaToken> Tokens { get; }