TabRNumericEmbedding

Enums · AiDotNet.Enums

How TabR embeds its numeric features before the encoder’s first linear map: the reference implementation’s num_embeddings.

For Beginners

keep None for the simple TabR-S model; choose PeriodicLinearReLU for the stronger variant the paper reports as TabR.

How It Works

Gorishniy et al. (2023) report TabR-S without numeric embeddings and their main TabR results with the PLR embedding in its lite form (lib.deep.PLREmbeddings, configured by n_frequencies, frequency_scale, d_embedding and lite).

Fields

Field Summary
TabRNumericEmbedding None num_embeddings = None: the raw features enter the encoder, as in TabR-S.
TabRNumericEmbedding PeriodicLinearReLU PLREmbeddings: every feature becomes ReLU(Linear([cos(2 pi c x), sin(2 pi c x)])) with learned frequencies c.
int value__