Enum RandomEmbeddingKernel
- Namespace
- OptunaSharp.Samplers
- Assembly
- OptunaSharp.dll
Which of REMBO's two kernels (Wang et al. 2016, §3.2) the inner Bayesian optimizer uses.
public enum RandomEmbeddingKernel
Fields
LowDimensional = 0The low-dimensional kernel: the inner sampler models the objective as a function of the latent point
ydirectly (a GP inddimensions). Cheap and the paper's choice for very high extrinsic dimension, but it can waste effort on the large part of the boxYthat projects onto the boundary of the real box (two far-aparty's can map to nearly the same point).HighDimensional = 1The high-dimensional kernel: the GP measures similarity in the projected real parameter space
p_X(A·y), soy's that map to the same clipped point are treated as identical — removing the boundary over-exploration and making a single embedding far more reliable. It fits a GP in the real (embedded) parameter space and optimizes expected improvement over the reachable subspace, so it is best suited to moderate extrinsic dimension, and it also embeds categorical parameters (the §3.2 categorical/Hamming kernel).