answer:No. You’re not over-reacting if people are being told to not have girls interact with him. Tell your parents what is happening, and they might be able to contact the administrators for the Group Home where he resides to see what can be done to keep him away from you. Working in health care, I deal with people from Group Homes pretty regularly, and their abilities and limitations vary greatly. If there are official warnings being given, then there is a reason for them. Better safe than sorry.