Upon the resignation or removal from office of any county treasurer, all the books and papers belonging to his office, and all moneys in his hands by virtue of his office, shall be delivered to his successor in office, upon the oath of such preceding treasurer, or, in case of his death, upon the oath of his executors or administrators. If any such preceding county treasurer, or, in case of his death, if his executors or administrators, shall neglect or refuse to deliver up such books, papers and moneys, on oath, when lawfully demanded, every such person shall forfeit a sum of not less than one hundred dollars nor more than five hundred dollars, and be also liable upon his official bond for such refusal or neglect.