ResettableLLamaModel

Namespace: LLama

A LLamaModel what could be reset. Note that using this class will consume about 10% more memories.

public class ResettableLLamaModel : LLamaModel, System.IDisposable

Properties

The initial state of the model

public Byte[] OriginalState { get; set; }

The context size.

public int ContextSize { get; }

The model params set for this model.

public ModelParams Params { get; set; }

The native handle, which is used to be passed to the native APIs. Please avoid using it unless you know what is the usage of the Native API.

public SafeLLamaContextHandle NativeHandle { get; }

The encoding set for this model to deal with text input.

public Encoding Encoding { get; }

public ResettableLLamaModel(ModelParams Params, string encoding)

encoding String

Reset the state to the initial state.

public void Reset()