Thanks for all of the replies.
I tried the freeze/heat method and it allowed the bumper to be hammered super slightly lower but still not enough. The pin hole, while not low enough, was also not lined up on one side. Kind of strange that one side was pretty well lined up and the other side was not.
I did take it back apart again and there were no extra parts.
I foolishly decided to try pounding the roll pin in, thinking it may pull the bumper the rest of the way. Unfortunately once I got the pin half way in it was not lined up on the other side and is now impossible to get out. Pulling with pliers was laughable and the pin was misaligned so there was no way to push it out from the other side.
I made the decision to drive the pin in the rest of the way and then file down the 1/8” of pin sticking out. So the end result is a bumper that is impossible to pull out of the tube held together by its own friction, and now is pinned on one side, so I am pretty confident his thing will never come apart. The buffer is maybe 1/16 inch longer overall.
If I were to do it again, I would not have attempted to put the pin in, but once I did that it was basically too late to do anything else.