Section 24. Upon the death of a sheriff, the jailer, superintendent or keeper appointed by him shall continue in office and retain the custody and control of the jail or house of correction and of all prisoners therein until a successor to the deceased sheriff has qualified, or until the governor, with the advice and consent of the council, removes him and appoints another. The jailer, superintendent or keeper appointed by the governor shall give bond, with sureties as the governor directs and approves, for the faithful performance of the duties of his office.