The sheriff of each county shall have the custody of the jail of his or her county and the prisoners in the same, and shall appoint the keeper thereof, for whose conduct the sheriff shall be responsible, and whom the sheriff may remove at pleasure.