The bond of every county or township collector shall be held to be security for the payment by the collector to the county treasurer and the taxing districts and proper authorities, of all taxes, special assessments which are collected or received on their behalf, and of all penalties which are recovered against him.