If you have access to a laser you can make laser-cut own speakers out of 1/4" plywood.
If not, you can use online laser cutting service such as Outfab
and cut it out for under a hundred bucks.
You can use old speakers for the components like I did, or purchase the speakers and amplifier from your local electronics store.
An old stereo system should have everything you need.