how to make a portable speaker usinga 3 to 4 volt battery. ?

why using the battery?
you can just plug the speaker to the device using a jack.
But if you still want an amplifier here are some simple and small ones:
You need an AMPLIFIER. Take a look on the right of the page here for some related designs>>>>>>>>>>>>>>>>>