Make Windows Icon Files With Photoshop

Step 2 Edit Like Normal File

Just make what you want the icon to be.
You probably want to start with a transparent background.