Do you think he suffered at the hands of racists?
I think he suffered at the hands of 'Banterists'
I'm sure there is 'banter' at all sporting clubs (and everywhere else) that is extremely un PC and maybe beyond the pale. However to avoid offending anyone, we all have to stop saying anything at all and if we stop talking we stop being Human.
In other words I don't know what the answer is, but keeping calm and carrying on would be a start.