FederatedAdapterOptions

Options & Configuration ยท AiDotNet.Models.Options

Configuration options for federated parameter-efficient fine-tuning (PEFT).

Inheritance: ModelOptions โ†’ FederatedAdapterOptions

For Beginners

When fine-tuning large models (like LLMs) in a federated setting, sending all model parameters between clients and server is too expensive. PEFT adapters only train and communicate a tiny fraction of parameters (often <1%), making federated LLM fine-tuning practical.

Constructors

Constructor Summary
FederatedAdapterOptions()

Properties

Property Summary
FederatedAdapterType AdapterType { get; set; } Gets or sets the adapter type.
bool AdapterLevelDP { get; set; } Gets or sets whether to apply adapter-level differential privacy.
double AdapterDPNoiseMultiplier { get; set; } Gets or sets the DP noise multiplier for adapter-level privacy.
double LoRAAlpha { get; set; } Gets or sets the LoRA alpha scaling factor.
int EmbeddingDimension { get; set; } Gets or sets the embedding dimension for prompt tuning.
int LayerInputDimension { get; set; } Gets or sets the layer input dimension for LoRA.
int LayerOutputDimension { get; set; } Gets or sets the layer output dimension for LoRA.
int LoRARank { get; set; } Gets or sets the LoRA rank.
int MaxHeterogeneousRank { get; set; } Gets or sets the maximum LoRA rank for heterogeneous LoRA.
int NumAdaptedLayers { get; set; } Gets or sets the number of layers to apply LoRA adapters to.
int NumPromptTokens { get; set; } Gets or sets the number of soft prompt tokens for prompt tuning.