I would be suspicious not of your hands, but your sensory perception. That is something which can be checked. Perhaps your sniffer is getting a confused reaction to the scent of your soap. Has your water been tested? It might be a good idea to mention this to your doctor.