ILLamaExecutor

Namespace: LLama.Abstractions

A high level interface for LLama models.

public interface ILLamaExecutor

Properties

The loaded context for this executor.

public abstract LLamaContext Context { get; }

Identify if it's a multi-modal model and there is a image to process.

public abstract bool IsMultiModal { get; }

Muti-Modal Projections / Clip Model weights

public abstract LLavaWeights ClipModel { get; }

List of images: Image filename and path (jpeg images).

public abstract List<string> ImagePaths { get; set; }

Asynchronously infers a response from the model.

IAsyncEnumerable<string> InferAsync(string text, IInferenceParams inferenceParams, CancellationToken token)

text String
Your prompt

inferenceParams IInferenceParams
Any additional parameters

token CancellationToken
A cancellation token.