LLamaWeights

Namespace: LLama

A set of model weights, loaded into memory.

public sealed class LLamaWeights : System.IDisposable

Properties

The native handle, which is used in the native APIs

public SafeLlamaModelHandle NativeHandle { get; }

Remarks:

Be careful how you use this!

Encoding to use to convert text into bytes for the model

public Encoding Encoding { get; }

Total number of tokens in vocabulary of this model

public int VocabCount { get; }

Total number of tokens in the context

public int ContextSize { get; }

Dimension of embedding vectors

public int EmbeddingSize { get; }

Load weights into memory

public static LLamaWeights LoadFromFile(IModelParams params)

public void Dispose()

Create a llama_context using this model

public LLamaContext CreateContext(IModelParams params)