ILLamaExecutor

Namespace: LLama.Abstractions

A high level interface for LLama models.

public interface ILLamaExecutor

Properties

The loaded context for this executor.

public abstract LLamaContext Context { get; }

Identify if it's a multi-modal model and there is a image to process.

public abstract bool IsMultiModal { get; }

Multi-Modal Projections / Clip Model weights

public abstract LLavaWeights ClipModel { get; }

List of images: List of images in byte array format.

public abstract List<Byte[]> Images { get; }

Asynchronously infers a response from the model.

IAsyncEnumerable<string> InferAsync(string text, IInferenceParams inferenceParams, CancellationToken token)

text String
Your prompt

inferenceParams IInferenceParams
Any additional parameters

token CancellationToken
A cancellation token.