Upon retiring from office, the sheriff shall pay over to his successor in office all moneys received by such sheriff and remaining in his hands. He shall deliver to his successor all evidences of indebtedness and all books, blanks, and stationery belonging to his office. Each sheriff shall demand and receive such books and papers from his predecessor.