PhonemeTokenizer

Models & Types ยท AiDotNet.Tokenization.Specialized

Phoneme-based tokenizer for speech synthesis (TTS) applications.

Inheritance: TokenizerBase โ†’ PhonemeTokenizer

Constructors

Constructor Summary
PhonemeTokenizer(IVocabulary vocabulary, Dictionary<string, string> g2pRules, SpecialTokens specialTokens, PhonemeSet phonemeSet) Creates a new phoneme tokenizer.

Methods

Method Summary
List<string> Tokenize(string text) Tokenizes text into phonemes.
PhonemeTokenizer CreateARPAbet(SpecialTokens specialTokens) Creates a phoneme tokenizer with ARPAbet phonemes.