If you are trying to remove a bullet button, the big, outside part that looks like a button won't push in. Did you try the technique mentioned above, but push the inner, smaller portion of the button into the receiver. The button itself should not move, just the inside part. It is the same way you would take the mag out, but push it in a lot farther. You may need a long tip, small diameter punch instead of an eraser. If you can get the latch to protrude enough out the left side, grab it and pull as hard as you can and unscrew it. Sometimes it will not clear the bolt catch because of the design.
If it is the one I'm thinking of you will have a total of four pieces (latch, outside plastic block that looks like a hollow long button, spring and the small oval nut. The new catch will only have a latch, spring and button.