I want to replace black tea with these, what could be the downsides?

[NewtoGinger]

Hi all, I've decided to cut caffeine from my diet so I will be cutting off black tea and coffee, and will be replacing them with:

• Ginger-lemon tea
  Anise tea
  Roselle tea
  Marjoram tea

I will be drinking 2~3 cups per day of each, would there be in side effects to this? Are there any other herbal teas that I can just indulge in with no side effects? Or better yet, have positive effects.