Suddenly, it hit me! Wine bottles could be flower pots, thus solving all of my problems! And it looks really cool in my window to have some bottles full of water, some empty, and some full of plants.
I did the first one less than a week ago, so no promises on the results (long-term, I'm pretty sure this isn't good for a plant), but right now it is so cool that I had to share.
UPDATE 3/10: Growing great! And I planted a few more. See last picture in this step.
Step 2: Put some gravel in it.
Step 3: Put some water in it.
Step 4: Put some dirt in it.
Fill about halfway up the neck.
Step 5: Plant your seedling!
This would also work with a seed.
Just pick a plant that seems willing to put up with living in a wine bottle.
Best if its root structure is straight down and not broad.
Put some more dirt around it so that it will stay.
Pictured are the seedlings and parent plant that I used. I have no idea what plant it is, but it doesn't die easily.
Step 6: Enjoy!