What Giving Up Privilege Would Really Mean