I remember that scene from the manga. It was when Shinji became from a cheerful bratty half-pint to a total asshole. Plus, I was surprised to see that before he knew why Sakura was in the Matou house, he was nice towards her

Yeah, maybe he was neglected from the beginning, but I still hate him for raping poor Sakura.