Jerry,
Just to throw out this WAG, it could still be the scope. As the cross hairs in most scopes are held in place by spring pressure, it could be that the erector assembly (inner tube) is getting moved by recoil, and possibly not settling back in the same place for subsequent shots. Not sure of the scope that you are using, but any half decent scope will hold up to the 5.56. Perhaps the tube is settled and staying put with the lighter recoil, but moving with heavy recoil. Again, just a wild a__ guess. If there is any way to check with iron sights, even at 50 yards. I am assuming that you have tugged real hard on the mounts to make sure that they are not moving at all.
I have a Leupold scope (older, lesser model) that appeared to go to heck with my heavy loads. I sent it to Leupold and they gave it a clean bill of health, no repair work. Never put it back on the 458, and it works fine on lighter recoiling rigs.
Craig