While I'm sure that they don't go bragging about it much on internet forums and posting their names, phone number, addresses, bank account number, etc, I'm sure that most aren't exactly hiding. Especially the "normal" SF. If that were the case, then they'd never wear their BDU's with the SF unit patch, the Group flash on the beret, and for the Q course qualified guys, the green berest and the big tab that says Special Forces on it. Especially off post at the restaurants across the freeway from Ft. Lewis.
Move to a military town that has an SF group, or a Navy SEAL team, or an AF pararescue team and you'll see them around. Now the ones that are in teh bars talking about how they are whatever SOF group is nearby are probably just trying to pick up some bar ho, but they aren't some super secret squirell club spy group.