If at any time it shall be made to appear to the governor that any commissioner has willfully neglected to discharge in good faith any duty resting upon him under the provisions of this chapter or is physically unable or otherwise incompetent to properly perform such duties or is seeking in any manner to prevent or defeat a full and fair expression of the wishes of the qualified electors of the county on the question of such removal of the county seat, the governor must remove such commissioner and appoint another in his stead, who shall qualify as provided in sections 11-16-2 and 11-16-4.