We, too, are in the house hunt. As a matter of fact, we were with a realtor in Boothbay over the weekend, checking out a couple of homes.
I would move to the Ellsworth area in a freakin heartbeat except I'd be looking just north of there at Gouldsboro and that area. There are a TON of homes that are still reasonably available because it's just that much further north than most people want to move. We still have family in CT and a move that far north would be more like a trip instead of traveling for a visit. With meals and pee breaks it's about 7 hours from our current home here. So, we're looking further south. Over the past 5 years that I've been lurking with real estate sights, the prices of homes from Brunswick and south has exploded by at least 20%. But, during the past year I notice that a large number of them have reduced their prices. They've been on the market for 160 days+ in many cases and that's slowed their sale.
Also, you might want to do yourself a favor and download the mill-rate chart that's available online for all the towns in Maine. Those rates vary wildly! Some downs would cost your $4k a year for taxes while that same basic house in another town would run $1800. We were very much attracted to Brunswick but it has become one of those high-taxed towns. They are building a new school and decided not to take state money so they're paying for it with taxes. Good for them but it's really raised their taxes by about 30% over a couple of years. High property taxes is what's driving us out of Connecticut to be sure. We're paying in excess of $6500 a year and they're going up again next year. Ugh.
Good luck!