This is the crux of the downside, which you may(?) be glossing over: close range is where you need to be fastest and you can't afford to distrust your aiming solution. The RMR also obscures some of the "subconscious" aiming mechanisms that you may rely on for more instinctive shooting like the outline or top of the slide, your ability to pick up iron sights in your peripheral vision on extension, and the tint of the glass and the RMR body itself make the iron sights (at least the front) harder to acquire. Not a total deal breaker but the oft-quoted defense of the RMR that "you always have your irons" is not the whole story: irons through an RMR are not 100% compared to irons without the RMR.
If I thought all my threats would be <25yd there's no way I would consider a RMR for EDC. Sure, they work fairly well on a flat range, sunny day, against multiple static targets in predictable locations, and they're fantastic for 50-100yd+ but is that 0.01% what you really want to optimize for, while compromising your ability to deal more effectively with the 99.9%?
After years of using different RMR solutions and putting thousands of rounds downrange with them, my advice: unless your vision won't let you shoot accurately beyond 15 yards... buy a SIRT gun and practice ammo instead of a RMR setup. You won't have to expend extra mental cycles worry about acquiring the dot, electronics failure, wandering zeros, parallax, fog, dust, or rain, you can just shoot what you need to shoot.
Quoted:
I understand some people aren't quite as fast on first target with the RMR, but for defensive purposes it would most likely be close range anyway.
View Quote