Unlike traditional tank water heaters, tankless systems do not heat a large quantity of water and hold it until you need it. Instead, they heat your water on-demand, when you turn on the tap. A small heating system warms the water as it runs past it in the pipe.