What you have to worry about is storm surge (if you're near the coast), flooding, falling trees, and crap flying around in the wind. If you live somewhat inland, in a well-constructed house, in an area not prone to flooding, and have no large trees right next to your house, you'll come through with minimal damage.
After the storm, watch out for floodwaters, downed power lines, and the human element.