ProgramSynthesisTokenizerFactory
Helpers & Utilities · AiDotNet.ProgramSynthesis.Tokenization
Creates safe, code-aware default tokenizers for ProgramLanguage values.
Methods
| Method | Summary |
|---|---|
ITokenizer CreateDefault(ProgramLanguage language, bool splitIdentifiers) |