Two things:
First, unless you've already done so, it's likely it's time for a new recoil spring. These small micro autos are hard on springs and they need to be replaced more often then larger guns.
Buy a new FACTORY WEIGHT recoil spring, NO extra power springs.
A new spring may correct any problems.
Second, guns often do odd things when you ease the slide closed especially with hollow point ammo.
The Kahr is intended to be loaded by locking the slide open, inserting a magazine, and pressing the slide release.
The Kahr manual SPECIFICALLY says not to "sling shot" the slide by hand, it says to load using the slide stop.
Easing the slide closed is also known as "riding" the slide and that's something all semi-auto and full-auto firearms expressly warn not to do or it will cause stoppages.
In other words, stop playing around with easing the slide closed. No automatic is intended to work like that. Lock the slide open, put a mag in it and press the slide stop.