Mine comes off as soon as my gun is pointed in the "stuff needs to break direction". This is waiting until I've rotated it the 90 degrees out of my holster (for the don't shoot yourself in the leg reasons), but well before I extend.
This is because of a technique I picked up when I was at the local Sheriff's Department to accurately squeeze off a round during that extension, safety has to be off for that to happen. If I decide nothing down range needs to break right now, I flick the safety back on and stay in that pressed ready position. As soon as I punch out I flick it off, back on when returning to pressed ready.
That comes from training and practice based on having to draw my sidearm very quickly as my only available weapon, me on my own, and a deadly assault already underway (or extremely imminent).
I ride the safety too. High thumbs grip I can't find a better place for that grip thumb, and I kinda miss the thumb safety as a grip ledge on my guns without it.