MinHashDeduplicatorOptions
Options & Configuration · AiDotNet.Data.Quality
Configuration options for MinHash-based near-duplicate detection.
Constructors
| Constructor |
Summary |
MinHashDeduplicatorOptions() |
|
Properties
| Property |
Summary |
double SimilarityThreshold { get; set; } |
Jaccard similarity threshold for duplicate detection. |
int NumBands { get; set; } |
Number of bands for LSH banding. |
int NumHashFunctions { get; set; } |
Number of hash functions for the MinHash signature. |
int ShingleSize { get; set; } |
N-gram size for shingling. |
int? Seed { get; set; } |
Random seed for reproducibility. |
Methods
| Method |
Summary |
void Validate() |
Validates that all option values are within acceptable ranges. |