There is a plastic pitcher and filter company out there making a good buck selling the benefits of user water filtration. It uses a throw away filter. It's a great thought. I have a better one.
If you are in a rush I'll let you in on the secret right now. Instead of making coffee in a coffee maker, use the coffee maker and filter along with Activated Filter Carbon (instead of coffee) to filter your water. Who doesn't have a spare old coffee maker lying around? Don't have one? Go to a charity store and pick one up. I like to use half gallon used PET juice bottles (cleaned, c'mon) to hold the filtered water.
Activated filter Carbon - I got mine from a pet store. I called the manufacturer and they very nicely told me that it is NOT for human consumption. YOU might like to go to a health food store and buy some meant for human consumption. I recommend that method.
Drip Coffee Maker with accessories. - Carafe, filters etc.
Sieve - for rinsing the dust off the carbon particles.
Carafe - to put finished water in.
Absorbent material to mop up any possible spills.