I suspect that the event you recall when you were a kid was prob when your mom ran out of oil. The system has to be re-primed to get oil to the pump. In your case, you can just flip the switch to off, and back to on later. While there is a chance it might leak (a little) when it goes cold, there is a better chance it will not. Also, if it doesn't leak right away, it is prob not going to later. In the summer, the previous owner of my house turned the boiler off **daily** after his shower to save oil, for many years.
In the end, if you have new HW tank, and you can turn off the boiler, that is the way to save $$. We are talking ~$2/day during the summer, or ~$300+/year in oil. Also, IMO running these boilers at lower temps can also cause problems in the long run (caused by condensation of flue gases), they were designed to be run hot. Just pick a day you will be home, and flip the switch in the AM, and check on it every now and then as it cools off over several hours, and look for a puddle underneath. Once its stone cold, you can also turn off the cold water supply to the boiler (which makes up any circulating water that leaks/evaporates in normal use). This would also limit the pressure/volume/rate of water that did leak out later in the rare case it decided to leak later.
And then in a month or more when you want heat, turn the water back on, restore your original (hot) aquastat settings, and flip the switch to on. 5 minutes later it will be hot and ready to go.