TabDPTOptions<T>
Options & Configuration · AiDotNet.Models.Options
Configuration options for TabDPT (Tabular Data Pre-Training).
Inheritance: ModelOptions → NeuralNetworkOptions → ModelHyperparameterOptions → FinancialNeuralNetworkOptions → RiskModelOptions<T> → TabDPTOptions<T>
For Beginners
TabDPT brings the power of foundation models to tabular data:
- Pre-training: The model learns patterns from many tabular datasets
- Transfer learning: These patterns help on new, unseen datasets
- In-context learning: Can adapt to new tasks without fine-tuning
Example:
How It Works
TabDPT is a foundation model approach for tabular data that uses pre-training on diverse datasets to learn transferable representations.
Reference: “TabDPT: Scaling Tabular Foundation Models” (2025)
Constructors
| Constructor | Summary |
|---|---|
TabDPTOptions() |
Properties
| Property | Summary |
|---|---|
IActivationFunction<T> HiddenActivation { get; set; } |
Gets or sets the hidden layer activation function. |
IActivationFunction<T> InputActivation { get; set; } |
Gets or sets the input projection activation function. |
IVectorActivationFunction<T> HiddenVectorActivation { get; set; } |
Gets or sets the hidden layer vector activation function (alternative to scalar activation). |
bool UseFeatureAttention { get; set; } |
Gets or sets whether to use feature-wise attention. |
bool UseLayerNorm { get; set; } |
Gets or sets whether to use layer normalization. |
bool UsePreNorm { get; set; } |
Gets or sets whether to use pre-norm (norm before attention). |
double DropoutRate { get; set; } |
Gets or sets the dropout rate. |
double InitScale { get; set; } |
Gets or sets the initialization scale. |
int ContextLength { get; set; } |
Gets or sets the context length (number of examples for in-context learning). |
int EmbeddingDimension { get; set; } |
Gets or sets the embedding dimension. |
int FeedForwardDimension { get; } |
Gets the feed-forward dimension. |
int FeedForwardMultiplier { get; set; } |
Gets or sets the feed-forward dimension multiplier. |
int NumHeads { get; set; } |
Gets or sets the number of attention heads. |
int NumLayers { get; set; } |
Gets or sets the number of transformer layers. |
int[] CategoricalCardinalities { get; set; } |
Gets or sets the cardinalities of categorical features. |
int[] OutputHeadDimensions { get; set; } |
Gets or sets the hidden dimensions for the output head. |