SafeLLamaGrammarHandle

Namespace: LLama.Native

A safe reference to a llama_grammar

public class SafeLLamaGrammarHandle : SafeLLamaHandleBase, System.IDisposable

Properties

public bool IsInvalid { get; }

public bool IsClosed { get; }

protected bool ReleaseHandle()

Create a new llama_grammar

public static SafeLLamaGrammarHandle Create(IReadOnlyList<GrammarRule> rules, ulong start_rule_index)

rules IReadOnlyList<GrammarRule>
A list of list of elements, each inner list makes up one grammar rule

start_rule_index UInt64
The index (in the outer list) of the start rule

Create a new llama_grammar

public static SafeLLamaGrammarHandle Create(LLamaGrammarElement** rules, ulong nrules, ulong start_rule_index)

rules LLamaGrammarElement**
rules list, each rule is a list of rule elements (terminated by a LLamaGrammarElementType.END element)

nrules UInt64
total number of rules

start_rule_index UInt64
index of the start rule of the grammar

Create a copy of this grammar instance

public SafeLLamaGrammarHandle Clone()

Accepts the sampled token into the grammar

public void AcceptToken(SafeLLamaContextHandle ctx, LLamaToken token)