I recently had an argument with a former classmate about people who have a hard time telling members of other races apart. (Specifically, the subject was whites who don't recognize Asians.) This woman is white but grew up in Japan, and was offended that whites might not recognize individual Japanese.
She seemed to feel that those who had a hard time telling members of other races apart were somehow morally wanting.
Speaking as a half-Asian, I understand why some whites, especially those who've had limited contact with Asians, can't tell them apart. Whites come in a wider variety of obvious physical differences, like hair color, facial shape, nose structure, height, build, etc. Asians exhibit less variety in all those traits, so if you're not used to them, it would only be natural to have difficulty telling them apart.
My mother found it extremely annoying when a local white woman once mistook her for the woman at the dry cleaning shop (decades ago). I certainly understand why my mother was insulted, but I don't really blame the white woman.
A young black woman once told me she had a hard time telling the old white guys at her law firm apart, since they all dressed similarly and sort of looked the same, with their white hair and wrinkles. I can't blame her for that either.
Nor do I blame whites for mistaking one black for another. I've seen this happen on a number of occasions, and it's always embarrassing, especially given the current social climate. But again, it's understandable.
Blaming people for this is basically the same as blaming people for being dumb.
And as the LGBTQ crowd always reminds us, it's unfair to blame people for something they can't help.