It's never explicitly said in the books, as far as I can remember, but it's a good question—Muggles can't really hurt them, seeing as they're wizards and all. I always figured it had to do with not wanting to freak the Muggles out, and at this point, they're pretty stuck in their ways.