FederatedAdapterOptions
Options & Configuration ยท AiDotNet.Models.Options
Configuration options for federated parameter-efficient fine-tuning (PEFT).
Inheritance: ModelOptions โ FederatedAdapterOptions
For Beginners
When fine-tuning large models (like LLMs) in a federated setting, sending all model parameters between clients and server is too expensive. PEFT adapters only train and communicate a tiny fraction of parameters (often <1%), making federated LLM fine-tuning practical.
Constructors
| Constructor | Summary |
|---|---|
FederatedAdapterOptions() |
Properties
| Property | Summary |
|---|---|
FederatedAdapterType AdapterType { get; set; } |
Gets or sets the adapter type. |
bool AdapterLevelDP { get; set; } |
Gets or sets whether to apply adapter-level differential privacy. |
double AdapterDPNoiseMultiplier { get; set; } |
Gets or sets the DP noise multiplier for adapter-level privacy. |
double LoRAAlpha { get; set; } |
Gets or sets the LoRA alpha scaling factor. |
int EmbeddingDimension { get; set; } |
Gets or sets the embedding dimension for prompt tuning. |
int LayerInputDimension { get; set; } |
Gets or sets the layer input dimension for LoRA. |
int LayerOutputDimension { get; set; } |
Gets or sets the layer output dimension for LoRA. |
int LoRARank { get; set; } |
Gets or sets the LoRA rank. |
int MaxHeterogeneousRank { get; set; } |
Gets or sets the maximum LoRA rank for heterogeneous LoRA. |
int NumAdaptedLayers { get; set; } |
Gets or sets the number of layers to apply LoRA adapters to. |
int NumPromptTokens { get; set; } |
Gets or sets the number of soft prompt tokens for prompt tuning. |