LLavaWeights
Namespace: LLama
A set of llava model weights (mmproj), loaded into memory.
1 | |
Inheritance Object → LLavaWeights
Implements IDisposable
Attributes NullableContextAttribute, NullableAttribute
Properties
NativeHandle
The native handle, which is used in the native APIs
1 | |
Property Value
Remarks:
Be careful how you use this!
Methods
LoadFromFile(String)
Load weights into memory
1 | |
Parameters
mmProject String
path to the "mmproj" model file
Returns
LoadFromFileAsync(String, CancellationToken)
Load weights into memory
1 | |
Parameters
mmProject String
path to the "mmproj" model file
token CancellationToken
Returns
CreateImageEmbeddings(LLamaContext, Byte[])
Create the Image Embeddings from the bytes of an image.
1 | |
Parameters
ctxLlama LLamaContext
image Byte[]
Image bytes. Supported formats:
-
-
Returns
CreateImageEmbeddings(Byte[], Int32)
Create the Image Embeddings.
1 | |
Parameters
image Byte[]
Image in binary format (it supports jpeg format only)
threads Int32
Number of threads to use
Returns
SafeLlavaImageEmbedHandle
return the SafeHandle of these embeddings
CreateImageEmbeddings(LLamaContext, String)
Create the Image Embeddings from the bytes of an image.
1 | |
Parameters
ctxLlama LLamaContext
image String
Path to the image file. Supported formats:
-
-
Returns
Exceptions
CreateImageEmbeddings(String, Int32)
Create the Image Embeddings from the bytes of an image.
1 | |
Parameters
image String
Path to the image file. Supported formats:
-
-
threads Int32
Returns
Exceptions
EvalImageEmbed(LLamaContext, SafeLlavaImageEmbedHandle, Int32&)
Eval the image embeddings
1 | |
Parameters
ctxLlama LLamaContext
imageEmbed SafeLlavaImageEmbedHandle
n_past Int32&
Returns
Dispose()
1 | |