(b)visit every barrack, ward, cell, compartment, and every other part of the jail and the premises thereof, including the hospital; and shall, save as provided in the rules, regulations, directions and orders for the time being in force in that behalf, always remain present within the jail or the premises thereof.