When I do push ups, my arms come outward also, as well as parallel to the ground. I think keeping your arms in would strain your elbows and perhaps work different arm muscles. I don’t think you are doing it wrong. Yes, I think it would work your neck muscles if you keep your head up, but I usually keep my head down. Good push up form also involves keeping your body straight (no arching of back).