The Governor, Secretary of State, state superintendent of free schools, Auditor, Treasurer, Attorney General and Commissioner of Agriculture, shall reside at the seat of government during their term of office, and keep there the public records, books and papers pertaining to their respective offices. Every judge of a circuit court shall, during his continuance in office, reside in the circuit for which he was chosen. Every county and district officer, except the prosecuting attorney, shall, during his continuance in office, reside in the county or district for which he was elected. And the removal by any such officer from the state, circuit, county or district for which he was elected or chosen shall vacate his office.