I'm just getting started and trying working off of the examples. Where is the Tokenizer class?
The following lines in CreateFormattedDocument (in the example.xaml.cs for the Document API example), is what I'm trying to build:
Tokenizer tokenizer = new Tokenizer();
List<Token> tokens = tokenizer.TokenizeCode(text, fileFormat);
The following lines in CreateFormattedDocument (in the example.xaml.cs for the Document API example), is what I'm trying to build:
Tokenizer tokenizer = new Tokenizer();
List<Token> tokens = tokenizer.TokenizeCode(text, fileFormat);