Thats asking a lot of 2 acres, isn't it?
If you have 'woods' on the east and south, you're going to have a lot of shade in the AM, and from the south, maybe too much for fruit trees to be able to produce fruit?
How much of a footprint is your infrastructure going to occupy, with driveway access, fencing, and utilities?
"... fruit trees, nut trees, garden area, shop/barn and a pond ..." Doesn't leave a lot of pasture, especially if some of your land is the woods/ravine you mention.
Goats can't eat driveway, and they're capable of cropping pasture right down to the roots and dirt if you don't give them enough supplemental.
You might not want them pasturing between your fruit/nut trees - I've seen them strip the bark off of trees when they run out of roughage, or are just generally bored.
ETA: Get friendly with your local Agricultural Extension agent. There ought be an office for your area, possibly closely tied with a local college, depending on your area of the country, which you don't mention.
Land Grant colleges were specifically set up with Agriculture in their charter. They might be where the Ag agent hangs out if not specifically in another office park.