Dont give up without giving your HOA an opportunity to "offiicially" turn you down. I move recently to a neighborhood that has a very strong HOA with many, many rules. The deed covenants say "no part of any property can be used for a business" even though my city's ordinances allow home based businesses. As advised above, I wrote them a letter telling them what i wanted to do (basically told them what an FFL does and why I need a place of business) and my community's manager took it to the HOA board. I was sort of hoping they'd approve but didn't know if they would. I was ready call it quits and just transfer all my inventory into my collection (I'm an SOT) and be done.
Lo and behold, they approved it. No weird conditions or anything. Just have to follow city ordinances (one patron at at time, no signs, no parking issues) and follow all the rules. Give them a chance. You'll never know unless you try.