This is natural for most people and I think it stems from not wanting to offend people. Honesty is the best policy. If you explain to someone that you need a break from people because you’re an introvert (I know the feeling) and they don’t like it, then tough. People may not particularly like you for your honesty, but neither can they fault you for it. After all, if someone doesn’t like you because of your true nature, then there’s no need to worry about appeasing them.