Do you need to personally be offended by something to recognise that it's offensive? The people who agree with him either don't realise it's offensive or know full well it is and just don't care. If you hear someone refer to someone else as a "fucking paki" are you going to think "I'm not personally offended by that so it can't be offensive"?