I don't know of any papers, but if you can support the same abstractions over a stream of tokens that is supported over a stream of characters, then I can't think of any technical reason that the PEG input alphabet can't be tokens instead of characters.
Best, Aaron Moss On May 10, 2019, at 18:02, "Juancarlo Añez" <[email protected]<mailto:[email protected]>> wrote: Hello, Please point me to the reading list for making PEG work when there's an existing and required tokenizer? Thanks in advance, and regards, -- Juancarlo Añez
_______________________________________________ PEG mailing list [email protected] https://lists.csail.mit.edu/mailman/listinfo/peg
