(4)If the master, owner or agent objects that the sum specified in the notice issued under sub-section (3) or any part thereof is not payable by him, he may, at the time of payment of such sum, give to the pilgrim officer notice of his objection, together with a statement of the grounds thereof, and the pilgrim officer shall thereupon either cancel or modify the aforesaid notice in accordance with the objection and refund the sum held in deposit under sub-section (3), or refer the objection for decision to a [Metropolitan Magistrate or a Judicial Magistrate of the first class] [ Substituted by Act 12 of 1983, Section 17 and Schedule, for " Presidency Magistrate or a Magistrate of the first class" (w.e.f. 18.5.1983).] exercising jurisdiction at the port or place at which the ship is delayed, whose decision on such reference shall be final; and there shall be refunded to the master, owner or agent any amount allowed to him by such decision.