No, I don’t see it as child abuse or neglect. I see it as two brothers playing. From your description, it’s hard to even call it bullying. It’s more like horseplay, with the older kid probably not taking into account the the brother is 7 years younger. If you had butted in, the father would have been well within his rights to tell you to piss off.