I doubt the small amounts of spices, watered down, will cause any harm. It probably depends on how often you plan to use tea and at what concentration. I often have put tea leaves in my plants and, last year, even put used tea bags on top of the orchids...no ill effects. Mostly, it is green tea, rarely, black tea...always flavored.
I actually grow Camellia sinensis as it is a rather pretty houseplant with its glossy leaves and, once a year, white flowers, then red berries.