Well, I have seen the Les Baers first hand and they are definitely nice. I also own a Varminter. I have heard a lot of mixed reaction to the Baer line, some think its worth it and some don't.
Honestly, I don't think you will ever regret spending a dime on the Varminter. It is a sweet rifle and, as someone else here once put it, it is scary accurate and very easy to be accurate with. As far as the Les Baer, you may never regret it either. I think it all boils down to two things:
A) If there was a .25 MOA difference between the guns (and I don't believe there is), are you good enough to realize it? In other words, if the worst of the two can do .25 to .5 inch groups religiously, is that enough for you?
B) How serious a shooter are you? How often will you use it and in what environment? In other words, if you spent $3k do you think you would get your money's worth out of it?
Personally, if forced to have only one, I would choose the Varminter. (actually, I did and I don't regret it for a second) But that's just me...