ILLamaExecutor
Namespace: LLama.Abstractions
A high level interface for LLama models.
public interface ILLamaExecutor
Properties
Model
The loaded model for this executor.
public abstract LLamaModel Model { get; }
Property Value
Methods
Infer(String, InferenceParams, CancellationToken)
Infers a response from the model.
IEnumerable<string> Infer(string text, InferenceParams inferenceParams, CancellationToken token)
Parameters
text String
Your prompt
inferenceParams InferenceParams
Any additional parameters
token CancellationToken
A cancellation token.
Returns
InferAsync(String, InferenceParams, CancellationToken)
IAsyncEnumerable<string> InferAsync(string text, InferenceParams inferenceParams, CancellationToken token)
Parameters
text String
inferenceParams InferenceParams
token CancellationToken