I generally like the Kelty stuff and always thought the MAP and the Peregrine 1800 were good looking packs. I have one of their Falcon 66 packs and have used it for backpacking. It has some nice organizational features and accessibility things. I could do without the 10 yards of Molle webbing on it as I don't use much of it. But I have found occasion to use it and when I'm backpacking I don't care much what I look like.
For every day however, I'm with you, I don't need the dark earth, or Multicam pack that screams 'military' or 'airsofter' so I've tried to use packs that don't stand out at much. My brief time with a Tad Gear EDC pack would be an exception.
I used some bags I found at REI for a while but nothing was blowing my mind. Then I found Goruck. I've been using a Goruck GR0 (what is now just a 21L GR1) for about 3 years now and it's awesome.
I work IT now and so I carry a laptop in it daily, as well as a host of geeky crap, all organized in zippered pouches. The internal pockets are great for organizing stuff. It's also my carry-on when I travel, and if I'm day hiking and need to carry more than just water and a snack it's what I bring. Slide a hydration pouch in there and run the house and I'm set. Or sometimes I just throw a nalgene inside. It has a small amount of molle which I generally use for stuffing pens in, or hooking my keys to depending on the circumstances. But, I could also throw a magpouch on the sides/back or put some type of water bottle caddy on there.
Mine is all black despite the grey being my favorite color, and to be honest I've never had one person ask me about it, or seemingly make assumptions about me because of it.
It's expensive, but it's got a good company behind it and it's made in the USA.
Goruck
Here's mine doing a day hike. All it really held that day was a bladder, some snacks, and a puffy jacket. Sitting next to my at the office right now it weighs about 20lbs and I never notice. It's just as comfortable with nothing in it as it is completely full.