Windex won't hurt lenses. I used to think the same until some pro photogs told me that's all they use.
By all means, get any grit & dirt off of the optic, I caution against compressed air, it turns dirt into sandblasting abrasive. Even a makeup brush sweaping grit off the lens can scratch them depending on the type of dirt, here in FL we have silica sand, the same stuff they mine & ship for sandblasting.
I had gotten my Reflex really muddied up, lot of sand in it. I contacted Trijicon about how best to clean it. They said soap it up and run it under water or use a hose. Well, it is water proof so I washed it when I did the dishes, shook it around real well under water and rinsed it, did it a few times until I was certain no grit was left then I put a cloth to it, let it dry and then cleaned the lens.
So, if the Aimpoint is rated for submersion, I'd recommend washing it, contact Aimpoint. HTH