Start with correct screwdrivers, files, and stones.
Get a vise for the drill press. Learn how to make screwdriver tips correct for the screw slot.
Buy good quality files. If they don't have a safe edge, then put a safe edge on them. That means you'll need a bench grinder.
Locate the grinder and any disc or belt sanders in their own corner where the dust can be controlled and kept away from the other tools. Near a window is a good idea. In a separate room is a better idea.
Start collecting stones now. Don't be afraid to modify them for the job. Don't get stuck looking just at the stones for sale at Brownell's, although that is a good place to start.
Get familiar with the tools and equipment for sale at MSC Industrial, EMCO, McMaster Carr, Grainger, and Fastenal. For now.
Also, buy the biggest Foredom tool you can find and a box full of burrs, stones, saws, and cutting wheels.