My Sonus Fabers are crap then?
Not crap, but probably not quite as good as you think they are either

just messing with you, don't worry

In the larger Sonus Faber speakers (with the curved sides) they make up their own plywood using Maple for example. This then makes the wood a plywood rather than a solid wood as the cross grain of the ply makes expansion a non-issue.
Solid wood is perfectly fine as long as you can take care of the wood movement:
* If your panel is narrow enough across the grain, then there is no problem. My thumb suck estimate is that you shouldn't use a solid wood panel any wider than about 250mm. If you can get away with dimensions smaller than that, then go for it. The length along the grain makes no difference, and also please take into consideration that different types of wood have different expansion properties.
* If your panel is wide, then use a veneer, or have solid wood resawn to 6mm thickness or less as Attie has advised. Doing this greatly reduces any issues you will have.
Failure to take these matters into consideration is well documented and understood by cabinet makers who craft furniture in solid wood. The item will break itself apart if you don't design it correctly, so be careful!
Regards,
Ian.