Get together a drill with a 1/16" drill bit or smaller, plus a small plastic container (~2 oz) that has a removable lid. Some options are used (clean!) prescription medication jars, used spice jars, or findings from your local dollar store.
Step 1: Drill the holes!
Drill a whole bunch of small holes all over the body of the jar. You can do straight rows, designs, letters/words, whatever comes to mind. Drilling into the bottom of the jar and/or lid is optional, but reccomended for extra flow of water through your tea.