If it is really bothering you, get an inch-pound torque wrench and a ransom rest and head to the range. The only real data is accurately obtained data, not heresay.
1. Fire some test groups at correct torque.
2. Loosen and retorque to a minimum, fire groups
3. Torque tighter and fire groups.
4. Apply correct torque and fire groups.
5. Control all other variables.
Optional: completely remove sight assembly and kick it and the rifle around the room a bit. Remount, start at step 1.
Now sleep soundly.
My Matech Buis had come loose without my notice and was slipping fore and aft. At no point did groups shift in any manner at 100 yards with the irons. (loctite is my friend...)
If you have a loose scope, you will start to see some movement in point of impact as ranges increase. All of this degree of looseness is subjective. If it is loose as a $2 whore, it will shoot all over the place.
If you had a bad day, were dehydrated, had some trigger pull issues, had vision issues, or breathing issues-- your group was probably not due to a few inch pounds variance in your sight screws. All of us have one day where we just can't hit a barn from the inside, as in lucky to hit a pie plate at 100yd. The last time it happened to me, it was dehydration. It affects your concentration and metabolism to an unnoticeable degree and you just can't work your way out of it.
YMMV!