Yeah, me too...
so here's what I did:
Step 1: Tools and Materials
ID card reel
hook thingie keychain
a piece of fabric that doesn't fray (I used felt)
Step 2: Attach ID Card Reel to Bag
take the piece of fabric and start attaching the fabric, when it's stable enough put the ID card reel underneath the fabric and continue sewing around it. Sew a second round 'cause this thing is gonna suffer a lot of abuse.
Cut the access fabric, but leave a bit of seam allowance.
Step 3: Attach Key to Hook, and to Bag
Now you can attach the keys to the bag (and detach whenever you want to), and quickly find and pull them to open your door.