InteractiveExecutor

Namespace: LLama

The LLama executor for interactive mode.

public class InteractiveExecutor : StatefulExecutorBase, LLama.Abstractions.ILLamaExecutor

Properties

The mode used by the executor.

public LLamaModel Model { get; }

public InteractiveExecutor(LLamaModel model)

public ExecutorBaseState GetStateData()

public void LoadState(ExecutorBaseState data)

public void SaveState(string filename)

filename String

public void LoadState(string filename)

filename String

Define whether to continue the loop to generate responses.

protected bool GetLoopCondition(InferStateArgs args)

protected void PreprocessInputs(string text, InferStateArgs args)

text String

Return whether to break the generation.

protected bool PostProcess(InferenceParams inferenceParams, InferStateArgs args, IEnumerable`1& extraOutputs)

inferenceParams InferenceParams

extraOutputs IEnumerable`1&

protected void InferInternal(InferenceParams inferenceParams, InferStateArgs args)

inferenceParams InferenceParams