MinHashDeduplicatorOptions

Options & Configuration · AiDotNet.Data.Quality

Configuration options for MinHash-based near-duplicate detection.

Constructors

Constructor Summary
MinHashDeduplicatorOptions()

Properties

Property Summary
double SimilarityThreshold { get; set; } Jaccard similarity threshold for duplicate detection.
int NumBands { get; set; } Number of bands for LSH banding.
int NumHashFunctions { get; set; } Number of hash functions for the MinHash signature.
int ShingleSize { get; set; } N-gram size for shingling.
int? Seed { get; set; } Random seed for reproducibility.

Methods

Method Summary
void Validate() Validates that all option values are within acceptable ranges.