The ruling party’s head of elections has said the ANC should be worried that members were moving to the new party while the IFP should also be concerned