Well, imo this is just another point to be added to the list of stuff that is handled wrong in terms of nomads. I mean their story, appearance, lore, etc. have run a downward spiral in quality and especially logic since some time. The current amount of plotholes is massive sadly.
Though, nobody listens to me, so whatever.
@Tenacity However I think it is up to the nomad side to handle this issue and correct the relation between nomads and outcasts.