But party members say they have had enough of being sidelined for high-profile newcomers who haven’t put in the hours