You'll likely no have any function issues, but if absolute accuracy is a concern then it can be a detriment. The benchrest guys tend to stay as low as they can get away with. The thought is that the higher the torque the greater the potential is for distortion at the barrel extension. This is also why they always lap their uppers. By removing even the slightest imperfections from the face of the upper the interface with the barrel extension flange is perfect, and therefore distortion minimized. The lapping can also be used to reduce the torque necessary as there is a minute delay in the contact between the upper and the extension flange, thus allowing the nut to rotate slightly further at any particular torque setting. If it concerns you lap the upper and reap all the benifits thereof. It's easy and the tool is about $35, plus a bit more for the compound. I do all my uppers before I assemble them, using the 600 grip compound. It goes slow and allows me more control compared to 300 or 200.