The Department of Revenue shall have and maintain its offices at the Capitol in Montgomery and shall be provided with suitable rooms, necessary office furniture, supplies, stationery, books and maps, and all expenses of the department incurred in discharge of its duties, and the administration of its duties and the administration of its functions shall be paid by the Treasurer out of the appropriation made for the annual expenses of the Department of Revenue, upon a warrant drawn by the Comptroller on the certificate or voucher of the department, approved by the Governor; provided, that the Department of Finance may at its discretion provide other or additional offices in the City of Montgomery for the use of the Department of Revenue.