OP, are you wanting wild berries, or tame hybrids?
Of course the answer is to plant the "backbone" things first...and plant them where you don't mind them spreading and going crazy. If you plant varieties that are native, they will outlast most of the wildlife. If you plant hybrids, maybe not so much.
I will tell you an option that may not be right for you...
There are some "old time" (as the old-timers would say) varieties of apple, pear, cherry and peach that are much, much MUCH tougher than the modern hybrids and grafted trees. I know this because there were some growing on my grandfather's property when I was young, and until it sold when I was in my 30s, they were STILL there.
They were not planted by anyone--they grew from (shhhhh) seed. They never had any pruning and/or tending--they were sort of a mess in that way, if you know what a "tended" apple tree should look like--but they produced some really wonderful tasting little yellow apples.
If I had a homestead the size of yours, were doing what you were doing, and wanted to get started on basic "survival" type foods, I'd plant those kinds of varieties. You will not get a gorgeous apple bigger than your fist from those kinds of trees. But do they bake up into a mighty fine pie? Yes indeedy.
There WAS one about a half mile down the road from me, on the edge of a sink hole, though I don't know how the apples taste. I can find out, though, if it's still there.
So...I can't tell you exactly where to get those kinds of plants right now. If you're interested in that approach, I'll look around as I can (sounds like you have time)
This doesn't appeal to too many people...only oddballs like me who enjoy growing old varieties for the sustainability of it. But I would bet more money on those doing what you're after--and being there, producing, when you move home, than I would on anything you get grafted or hybridized or both.
Now...I won't be offended at all if you're not interested in this.
ETA: As to asparagus, it wouldn't hurt to try it. The asparagus at my mom's house has been growing there for 30 years. It's in grass. She still picks it (or now we pick it for her) every spring. It DOES do better when tended. But it can survive for a good long while without that.