No, the kind of tokens I'm thinking aren't arranged at all. Tokens. Just plain old tokens, in a stream. That's what I mean when I say tokens. I think we're all doing a little too much presuming what other people are thinking.
I was thinking of a syntax tree for the method of parsing, but that has nothing to do with what kind of tokens I was thinking of.
|