So what that someone called you? If it is important, they'll call back. YOUR phone is for YOUR convenience, not theirs.
Look at it from the other end... I got a call one day, a woman said, "You called me?"
AFM: "Uh, no, I don't think so. Tell me who you are and I'll tell you if I called you or not."
Woman: "Who I am is none of your business... you called me. It's on my caller ID."
AFM: "I don't think it was me. Maybe it was my wife who called you. Or maybe one of my kids was calling one of your kids."
Woman: "Well you called me, it's got your number right here."
AFM: "No, I didn't, but perhaps someone from here did. If it's important, they'll call you back. But I promise you, I didn't call you, and I won't call you in the future, whoever you are."
Woman: "Well don't call here again!!!" (Slams phone down.)
I guess I'm the rude one.