GemmAutoTuner

Models & Types · AiDotNet.Tensors.Engines.DirectGpu.OpenCL

No summary documentation available yet.

Constructors

Constructor Summary
GemmAutoTuner()

Properties

Property Summary
ILogger Logger { get; set; }
bool EnableDiagnostics { get; set; }
bool EnableProgress { get; set; }
int CachedConfigCount { get; }
int ProgressInterval { get; set; }
int TrialHeartbeatSeconds { get; set; }
string LogFilePath { get; set; }
string TrialLogFilePath { get; set; }

Methods

Method Summary
EvolutionKernelAutotuner<OpenClGemmConfiguration> CreateEvolutionTuner(int m, int n, int k, GpuCapabilities capabilities, KernelTuningDeviceFingerprint fingerprint, Func<OpenClGemmConfiguration, EvolutionEvaluationContext, CancellationToken, ValueTask<KernelTuningTrialResult>> evaluator, IKernelTuningFinalistEvaluator<OpenClGemmConfiguration> finalistEvaluator, KernelSearchSpaceVersion searchSpaceVersion, KernelBenchmarkProtocolVersion benchmarkProtocolVersion, GemmKernelTemplate? requiredTemplate, EvolutionEngineOptions engineOptions, KernelTuningOptions tuningOptions, IEvolutionCheckpointStore checkpointStore, KernelTuningDeploymentRegistry<OpenClGemmConfiguration> deploymentRegistry, IKernelTuningStore<OpenClGemmConfiguration> store)
GemmConfig SelectConfig(int M, int N, int K, GpuCapabilities capabilities)
IReadOnlyList<OpenClGemmConfiguration> GetEvolutionSeeds(int m, int n, int k, GpuCapabilities capabilities, IEnumerable<GemmConfig> additionalSeeds, GemmKernelTemplate? requiredTemplate)
Task<EvolutionKernelTuningResult<OpenClGemmConfiguration>> TuneWithEvolutionAsync(int m, int n, int k, GpuCapabilities capabilities, KernelTuningDeviceFingerprint fingerprint, Func<OpenClGemmConfiguration, EvolutionEvaluationContext, CancellationToken, ValueTask<KernelTuningTrialResult>> evaluator, IKernelTuningFinalistEvaluator<OpenClGemmConfiguration> finalistEvaluator, KernelSearchSpaceVersion searchSpaceVersion, KernelBenchmarkProtocolVersion benchmarkProtocolVersion, IEnumerable<GemmConfig> additionalSeeds, GemmKernelTemplate? requiredTemplate, EvolutionEngineOptions engineOptions, KernelTuningOptions tuningOptions, IEvolutionCheckpointStore checkpointStore, KernelTuningDeploymentRegistry<OpenClGemmConfiguration> deploymentRegistry, IKernelTuningStore<OpenClGemmConfiguration> store, CancellationToken cancellationToken)
TuningResult[] TuneForDimensions(int M, int N, int K, GpuCapabilities capabilities, Func<GemmConfig, double> benchmarkFunc, int warmupRuns, int benchmarkRuns, bool useFullSearchSpace)
TuningResult[] TuneWithBayesianOptimization(int M, int N, int K, GpuCapabilities capabilities, Func<GemmConfig, double> benchmarkFunc, int maxTrials, int initialRandomSamples, int warmupRuns, int benchmarkRuns, int? seed)
void ClearCache()