The manual says [1]: In addition, the following table describes the special characters which can appear in the prompt variables PS1 to PS4:
..which misses PS0 (and seems to imply that PS3 gets expanded in this fashion as well). [1] https://www.gnu.org/software/bash/manual/bash.html#Controlling-the-Prompt