For infants, yes, even in contact with the skin. Not usually for an adult. But just let the water stand in the open container / tub for a few hours and the chlorine will evaporate. Its concentration in water is negligible, although water can smell it.