(3)If any condition on which a person has been pardoned or released on parole or a punishment has been remitted is in the opinion of the authority which granted the pardon, release or remission not fulfilled, such authority may cancel the pardon or release or remission and thereupon the sentence awarded shall be carried into effect as if such pardon, release or remission had not been granted:Provided that in the case of a person sentenced to imprisonment or detention such person shall undergo only the unexpired portion of the sentence.