Kevin,
> should I suggest taking these panels down from the wall, and replacing them with different, more diffusive panels? <
In a small booth you generally want absorption rather than diffusion. And usually as much as possible. As I often say, "Small room ambience is bad ambience."
> Or are wenger rooms not really meant to be "re-treated" acoustically in this way? <
I'm pretty sure that booth would benefit from more, and thicker, absorption than what it came with. If you have only a small budget and need to DIY your own panels, check Bryan's site Sensible Sound Solutions for prices and delivery options. The link is right under his alter ego Shirley's name above.
--Ethan