The supervising department or its duly authorized representative shall visit and inspect the institutions under its administration and control concerning administration, treatment, or finances of such institutions at any time, but shall make such inspection at least twice each year. If deemed necessary, the supervising department shall examine under oath the officers and attendants, guards, and other employees and make such inquiries as will determine their fitness for their respective duties.