The hole is probably undersized. It happened to me on my last Noveske lower. I drove the pin in from the other side, so removing it is not going to be a huge issue.
You could have an over-sized pin too; is it DPMS by any chance?
To remove mine, I'm going to put some lube in the pin hole and use a heat gun to gently expand the Alu before I drive out the old pin. In theory it should work b/c Alu expands under heating at a lower temp than steel.
And I'm going to use some alumablack to touch up the scratches b/c that will act like a cold blue and give you a chemically converted surface finish instead of the cerakote, which is obviously a painted finish.
Don't try to just dremel off the extra hanging bit of the pin, though. It will look terrible and you won't be able to live with it.
Go ahead, ask me how I know.
Upshot is, around here the scratched Noveskes are considered even more tacticool-tools.
FWIW: I'm cerakoting mine at a future date.