You have too many variables with no standard. Put the scope back on, get your cheek Mig welded on and shoot the gun on a rest to see your "standard" group. That will be the group by which you measure your iron sight groups.
THEN you start taking 5 shot groups and measure them, not 30 shot groups. I'm guessing here that you took 30 shots relatively quickly? (within 15 minutes)
You need to cut down on your variables and answer your own question. If you are asking what kind of groups we've received, then I can tell you that shooting my friend's M4gery, I had about a 1.75" group at 100 yards with american eagle ammo. Looks like you should get your equipment in line with your shooting before you try any of this though. Unless you are in close quarter combat, I'd chuck the stock in favor of the A2. That's how all my rifles look and they all shoot like bolt guns!
Good luck with your setup, I hope you tune it they way you want it and get better with the irons! (Keep in mind those 6" groups open up to 12" @200!)