API Reference
Interface
IStorySourceTokenizer
Extension seam for optional language tokenizers. Implementations map parser-specific tokens into exact, renderer-neutral story source spans without adding parser dependencies to ChartForgeX.
Methods
Tokenize(System.String arg1) #Tokenizes exact source text into renderer-neutral semantic spans.
Parameters
- arg1 System.String
Properties
Language #Gets the canonical language identifier handled by this tokenizer.