For like $20, you can get the CR (conventional recoil) end that doesn't have a muzzle break incorporated into it. No louder than any other rifle.
It does make a difference. You can tune the barrel to get better and better accuracy with whatever load you shoot... and if you reload, you don't necessarily have to sacrifice velocity for accuracy anymore. Get the bullet as fast as you can safely get it to go, tune the barrel and you're done.
I have one and it's worth it.
ETA: The average hunter couldn't keep his shots on a dinner plate offhand at 100 yards with a match quality rifle... I'm an accuracy freak though, so it's up to the individual as to how important accuracy is to them.
ETA II: For all the 'ear-splitting loud' posters above, a link to fix your problem for around $20.
BOSS CR