They almost provoked you, to expel you from the land. In that case, they would not have lasted after you, except briefly.