We've had oil heat for many years without issue.
The smell is only a problem with a poorly operating or maintained system. If it is working correctly, you'll never smell the oil. The rupture of the oil tank is very infrequent and is again usually due to poor maintenance or cheap oil (with a lot of contamination or water present in it). This causes the tank to rust out, but takes decades to happen. There are additives that can be added to your tank to absorb it, just like additives for your car.
Dust is always an issue, but not because it is oil but because it was probably a forced hot air system which not only recycles air, but any dust that is present. Changing air filter periodically will help reduce this issue.
Nothing to be scared or hesitant about with oil heat. I'd guess 75% of the homes in the northeast are heated with oil with the fuel tank in the basement. It last longer inside, and it eliminates problems with fuel gelling (requiring higher costing winter-blend heating oil or kerosene), and you have less condensation issues than outdoor tanks have. Once a year, have the system serviced (about $150). They'll change the oil filter, replace the burner nozzle and run tests to ensure it is operating correctly. It probably wouldn't be a bad idea to include an inspection of the homes heating system as part of the overall inspection. Some older homes still use very inefficient systems and it might be economical to update the system.