Have you pulled the safety detent and spring all the way out and see if the lever/shaft will rotate with that removed? I ran across a setup where the hole for the safety shaft detent didn't like the detent pin, I think I remember it was too pointed and would not let it rock up out of the detent from safe to fire position once it had pressure from the FCG springs on the system.
Kinda scared me cause the lower worked fine with a different lower kit. My daughter wanted to build one so I stripped it down and gave her all new parts and guess tolerances just were not right. Massaged the detent pin end and the detent hole on the safety shaft, now smooth as butter but still locks up firm at the stops.
Can't really speak to the pin holes being round, might be lube or shadows in the picture or they could be egged out but didn't look like the FCG was crossed up in the pocket putting stress on the safety, at least to my old eyes.
Good luck with troubleshooting.