Many racists or Nazis use the language of victims. Thus historical German Nazis said (not without reason) that Germany was victim of the monstrous unjust Treaty of Versailles, Germany had lost part of the territories, and German working class had to pay huge reparations to the predatory imperialists of England and France. But Nazis used victim rhetoric to justify ugly expansion and killings of Slavs and Jews. If we use logic of some modern anarchists and leftists then we start to think: to atack nazi is "victimblaming"!
In fact, many modern anarchists, as well as the leftists, are not supporters of the social libertarian revolution and class uprising. They are supporters of different types of racism or separatism directed against white men.
If we look at the real socio-revolutionary movements from Bialystok to Milan, from Baku to Barcelona between 1900 and 1950, we will say that anarcho-communists, members of Autonomous councils or revolutionary communitarian and syndicalist movements believed that the truth is one for all! This is equality, personal freedom, brotherhood of self-governing labor collective, and direct action.
If modern pseudo-syndicalists had called on revolutionaries to file a complaint against the boss at the state court, that anarchists would have simply turned their backs on legalists. If the modern leftists had told them about the sexist and separatist statements of blacks or radical feminists, then old Spanish or American anarchist would have shrugged and sadly said: there are also fascists among blacks and women.
Some leftists are not a social revolutionary, they just help liberals quarrel between black and white working class.
Black racists do exist. "Racism is prejudice, discrimination, or antagonism directed against someone of a different race based on the belief that one's own race is superior" (Oxford dictionary). Racism is not necessarily a system. The leftists and left liberals artificially and wilfully alters the meaning of words to justify black racism, to bring it out of criticism. Also there are thousands of black racists and some are organized.
The notion of "white privilege" is part of a racist discourse invented by left liberals. In the US, Western Europe, and Eastern Europe, there are tens of millions of white poor people whose situation is much worse than that of many rich or midle Blacks or Asians. I do not know the average figures, maybe if you compare the average income in the United States between white and black, then white will be higher. But this figure says little, because it is "the average temperature of patients in the hospital." In US there are millions of poor white workers and unemployed people living in a Rusty belt and in many other places. They have no power, they have no wealth. For me, these people are friends in misfortune, like poor Blacks, Koreans, Jews or Indians.
And one more thing about privileges. I am very funny then a resident of a rich country tell me about my privileges (I live in Russia, i live under U.S. sanctions and my parents are not white, but Jews). However, we did not choose where we were born, and we (most people on the planet) do not control business and government. Therefore, we take no responsibility for the policy of the elite. So we're not responsible for the wage hierarchy.
It would be strange if we accused a black poor man or an African labor migrant who came to live in the US of "having privileges". Meanwhile, his benefits are huge: in comparison with the inhabitants of Africa, his salary in ten times more. But even within Africa itself the residents of a big capital city live better than the inhabitants of the poor provinces. Capitalism is hierarchical. But as long as it exists, it's stupid to accuse one employee of getting paid more than the other.
If you don't have political and economic power, if you don't run a company, if you don't exploit a hired labor, you're not an exploiter.
Actually, whatever awful uses the concept may have been put through since, the origins of the concept lie in W.E.B. DuBois' "psychological wage of whiteness", and the way that thinkers like Noel Ignatiev built on that work. You might find this useful: