Riene, I have found that when trying new teas, I spent a LOT more money when I was trying to find good buys on the cheap, than when I just went for a couple of well-recommended, albeit more expensive, teas.
If you really want to try a bunch of teas for a reasonable price, I highly recommend Adagio's samplers. Some other companies have samplers too, or something equivalent. Tao of Tea will sell many of their teas in 1oz quantities, and so will some other major US vendors. I like Adagio particularly because their samples come in a convenient and mess-free tin, plus their shipping is very reasonable.
These samples will usually give you enough for several sessions, or if you are gongfu brewing, 2-3 sessions.
I'm sure others can pipe in with vendors who have good sample deals. Also I have a few samples from other teachatters, and from my own purchases, that didn't float my boat. If you like, I could mail a few out to you.