I used to think that too, until I was playing at a con and some dude started to innocently and sweetly tell me how 4e races mapped to real human ethnicities and cultures...
Yeah...
I was in one of those situations where I was the only black dude in a sea of white geekery trying to figure out how to handle this in a way that was going to set boundaries and not get me put in jail...
And again, what struck me is how dude
A) thought he was empathizing with me
B) had been "educated" about race solely through RPGs.
It is when it dawned on me how big a problem it was.