'Cartridges of the World' by Frank Barnes will give you a good description of each of the commonly available cartridges.
Cost varies - you might have to get a custom rifle built by a gunsmith for some of the rarer wildcats. If the round is rare enough, you'll also end up paying more or handloading your own ammo. Say a couple thousand dollars or so. On the other hand a basic .22LR might fit your requirements for fifty bucks including a box of ammo. At the higher 4000+ fps velocities barrel erosion and per-round cost become factors you should consider. 22LR is popular and so inexpensive it's almost free. 22 WMRF, .223 Remington, 22-250 and 220 Swift are also popular .22 chamberings with progressively more power as you go through that list.
Edited to please grammar teachers everywhere.