StopWordRemovalQueryProcessor
Models & Types · AiDotNet.RetrievalAugmentedGeneration.QueryProcessors
Removes common stop words from queries to improve retrieval precision.
Inheritance: QueryProcessorBase → StopWordRemovalQueryProcessor
For Beginners
Removes common words that don’t help with searching.
Examples:
- “What are the main features of the new iPhone?”
→ “main features new iPhone”
- “How does a neural network learn from data?”
→ “neural network learn data”
Words like “what”, “are”, “the”, “of” are removed because they don’t help find specific documents.
How It Works
This processor filters out common, uninformative words that don’t contribute to retrieval quality. By removing these words, the search becomes more focused on meaningful content.
Constructors
| Constructor | Summary |
|---|---|
StopWordRemovalQueryProcessor(HashSet<string> customStopWords, bool preserveFirstWord) |
Initializes a new instance of the StopWordRemovalQueryProcessor class. |