Warm air rises. When the tea bag is burned, it fills with warm air. When the warm air rises it carries the tea bag with it. This is similar to how a hot air balloon works.
Check out my website www.monkeyvsgravity.com or subscribe to my youtube channel www.youtube.com/user/ThirstForScience for more!