LLamaPerfContextTimings

Namespace: LLama.Native

LLama performance information

public struct LLamaPerfContextTimings

Remarks:

llama_perf_context_data

Properties

Timestamp when reset was last called

public TimeSpan ResetTimestamp { get; }

Time spent loading

public TimeSpan Loading { get; }

total milliseconds spent prompt processing

public TimeSpan PromptEval { get; }

Total milliseconds in eval/decode calls

public TimeSpan Eval { get; }

number of tokens in eval calls for the prompt (with batch size > 1)

public int PrompTokensEvaluated { get; }

number of eval calls

public int TokensEvaluated { get; }