The EFF leader said Ndlozi was not at the conference and that it was not in the party’s interests to entertain such “nonsense”