We live in Southwest GA but we're part-timers in Ellijay. Got a small place that we use on long weekends, holidays, and vacations. It's gotten to be a tourist town. Locals go out during the week and stay home on weekends. Tourists overcrowd the restaurants on the weekends.
The Smokehouse is our go-to for breakfast. Mike's Restaurant is good for country style breakfast or lunch. Charley's is good for Italian. Cajun Depot is good for seafood. Try the stuffed catfish.
Downtown is touristy but we really like Cantaberry's for light lunch and The Roof is good for dinner.
I know Longhorns is a chain, but the one is Ellijay is pretty good.
Biguns is good for BBQ.
Also, if you want to catch a flick while you're there - the Mountain Theatre is modern and clean. Reclining chairs that work. Never crowded. If we want to catch a movie we'll wait until we go up to Ellijay.
Blue Ridge is only 20 miles up the road. A few good places there. Southern Charm is great Southern cooking. Jolly Roger is our go-to for seafood. Sue's Burgers for a hamburger.
There are other places but I'm a cheapskate and those are good bang for the buck places for us.