In consideration of no exchange or collection charges being made on checks or coupons of, or remittance to, the State, any insured banks, insured credit unions, insured savings and loan associations or insured savings banks at the state capital may be relieved by the State Treasurer, with the approval of the State Board of Finance, from the payment of any interest on amounts deposited with them.