All state departments, boards, bureaus, commissions or other state agencies charged with the collection of any taxes, licenses, fees, interest or any income to the State shall, with ordinary business promptness, deposit the same when collected with or to the credit of the State Treasurer, either at his office in the State Capitol or in such bank or banking institution within the State as shall be designated by the State Treasurer; provided, that this section and § 11-13-110 shall not apply to the collection of state taxes by county treasurers, who shall collect and remit as required by the Comptroller General.