The chicken-n-egg situation while working with microcontrollers is that you need to get your program in a microcontroller to program another microcontroller. I know that's whacky but it's only one-time. There are some ways which I'm listing below. You only need one:
I will be using the earlier version of USBtinyISP I made. I had used a parallel programmer to program it's ATtiny2313. You only need a few minutes to upload the USBtinyISP code onto your ATtiny2313, so you can get someone's help who has a PC with parallel port/serial port/AVR programmer/Arduino.
If you're going to someone's place to get ATtiny2313 programmed, remember to download and keep these files in a pendrive:
To use, install all that you've downloaded and extract the firmware zip file to a convenient location.