TabDPTOptions<T>

Options & Configuration · AiDotNet.Models.Options

Configuration options for TabDPT (Tabular Data Pre-Training).

Inheritance: ModelOptions → NeuralNetworkOptions → ModelHyperparameterOptions → FinancialNeuralNetworkOptions → RiskModelOptions<T> → TabDPTOptions<T>

For Beginners

TabDPT brings the power of foundation models to tabular data:

  • Pre-training: The model learns patterns from many tabular datasets
  • Transfer learning: These patterns help on new, unseen datasets
  • In-context learning: Can adapt to new tasks without fine-tuning

Example:

How It Works

TabDPT is a foundation model approach for tabular data that uses pre-training on diverse datasets to learn transferable representations.

Reference: “TabDPT: Scaling Tabular Foundation Models” (2025)

Constructors

Constructor Summary
TabDPTOptions()

Properties

Property Summary
IActivationFunction<T> HiddenActivation { get; set; } Gets or sets the hidden layer activation function.
IActivationFunction<T> InputActivation { get; set; } Gets or sets the input projection activation function.
IVectorActivationFunction<T> HiddenVectorActivation { get; set; } Gets or sets the hidden layer vector activation function (alternative to scalar activation).
bool UseFeatureAttention { get; set; } Gets or sets whether to use feature-wise attention.
bool UseLayerNorm { get; set; } Gets or sets whether to use layer normalization.
bool UsePreNorm { get; set; } Gets or sets whether to use pre-norm (norm before attention).
double DropoutRate { get; set; } Gets or sets the dropout rate.
double InitScale { get; set; } Gets or sets the initialization scale.
int ContextLength { get; set; } Gets or sets the context length (number of examples for in-context learning).
int EmbeddingDimension { get; set; } Gets or sets the embedding dimension.
int FeedForwardDimension { get; } Gets the feed-forward dimension.
int FeedForwardMultiplier { get; set; } Gets or sets the feed-forward dimension multiplier.
int NumHeads { get; set; } Gets or sets the number of attention heads.
int NumLayers { get; set; } Gets or sets the number of transformer layers.
int[] CategoricalCardinalities { get; set; } Gets or sets the cardinalities of categorical features.
int[] OutputHeadDimensions { get; set; } Gets or sets the hidden dimensions for the output head.