How bash do tokenization?

[Peng Yu]

Hi, I have been checking bash source code. But it is not clear to me
how bash do tokenization as I don't find a lex file.

Could anybody point to me where I should look for the information
about tokenization in bash source code?

-- 
Regards,
Peng