The governor may remove members of the board for reasons of inefficiency, neglect of duty, malfeasance in office, commission of a felony or inability to perform the duties of office.