The outgoing chairman told news editors he was shown the door but praises Pravin Gordhan for ‘amicable’ conclusion of his tenure