Depends on county, build a house here got to have permits,
i've built sheds, pole barns done electric, plumbing, ran fence, tractor/dirt work etc w/o need of permits.
Only thing i can think other than permit for house building is when i had my septic tank and laterals replaced and perk test.
State epa agent came out done pre and post inspections when contractor filed for permit and near completion,
agent was cool even though it was like 110deg out and he checked the old tank was pumped clean, collapsed/filled, the pit where new tank was set and laid on ground couple times checking gravel & sand bases and lateral lines