Is there a certain way to drive this out, left to right or the other or does it matter.

I don't think it matters...  What I would suggest is looking at the pin to see if you have any clue which side the pn was pressed in on.  If you can tell, press from the opposite side.  Otherwise, I think I have been pressing left to right as I would shoot the rifle...

What kit do you have?  If it is a Rommy "G" kit you might want to look at some of the other threads here for advise on getting the pin out.

Yes a rom. I was gonna try the large hammer and punch Job, Its all I have accesess to right now.

use non impact ways to remove the pin. otherwise it will expand ever so lightly, wich meens drill time