Good question ajacobs.
I dwelled on this issue because it sometimes aggravates me not to fully understand. I agree with your statement regarding not limiting the part performance to the diameter.
In a way, I want my 308 lowers to last for my sons and not want to have the pin holes open up. They pin holes do open in time and this depends on their use. Years ago, I bought a M16 which came form a large city police department on the west coast, and the pins were quite loose, too loose to be exact. I use the KNS pins on a 9mm and on a 223 and it is rock solid. I suspect than the 308 is harder on the pins than the 223 and the 308 receiver is an extrapolation of a 223 receiver - perhaps not as beefy in 308 as an original 223 design, so for a few dollars I am buying insurance (I hope).
Admittedly, it is more of a personal choice as opposed to a full rational fact.