(2)No order which punishes or formally censures any such person as aforesaid, or affects adversely his emoluments or rights in respect of pension, or decides adversely to him the subject-matter of any memorial, shall be made except, if he is serving in connection with the affairs of the Federation, by the Governor-General, exercising his individual judgment, or, if he is serving in connection with the affairs of a Province, by the Governor of that Province, exercising his individual judgment.