Its because there are a number of factors at play that balance out performance e.g. pixel pitch, focal length, FOV as well as basic detector resolution for example
(1) The DRI for a 12micron, 1280 detector with 35mm focal length will be 230, 460, 1850m for a human size target - the FOV will be 25 x 19 degrees
and
(2) The DRI for a 12micron, 320 detector with 35mm focal length will be 230, 460 and 1850m for a human sized target - but the field of view will be 7 x 5 degrees
so the real question is how far do you want to see and what size of field of view do you want to look at.
The advantage with the higher resolution detectors is you can push out the detection range a long way e.g. a 1280 paired with 150mm FL will push out the detection range for a human sized target to around 8km. Likewise if you move up to a 1920 detector with a FL of 300mm you will push out the detection range for a human to 16km and the recognition range to 4km - the field of view will be around 4 x 3 (which at those distances is a lot of real estate).
To put it another way - 320 and 640 are more than up to the job for people armed with conventional weapons and not involved in any form of highly specialised surveillance/recce.