Obligations of the city which shall be purchased by the comptroller shall not be cancelled by the comptroller until the final redemption of the same, and all interest accruing therefrom shall regularly be paid to the appropriate sinking funds.