Hi Terry,
Don't worry too much if the hole is only .015 out of shape.It really shouldn't be a big problem.
Do you have a Dremel Tool?If you do or have access to one,try using a thin abrasive cutoff wheel to cut into the head of the pin from the side(right beside and as close as possible to and paralell to the flat).This should cut into the retaining pin and enable you to release it.Of course the pin will be ruined but it beats damaging the lower.
If you need a pic,I'll borrow a digital camera and learn how to post it here!
Good luck,Robert.
Edited to add:
If you don't have a Moto tool,you could center punch the head of the pivot pin and drill the head off with a 15/64" bit.This will drill the head off with out drilling into the reciever if you drill dead in the center of the pin.If it wanders to one side,use a smaller bit.After you get past the head,a pair of pliers may twist the head off of the pin body.Any slight damage to the reciever will be hidden by the replacemant pins head.
Robert.