The registrars appointed under this article may be removed for cause by the Secretary of State at any time before the end of their term of office, upon submitting written reasons therefor to the registrar removed and to the members of the state board of appointment. If not so removed, the registrar may hold office for four years from the date of appointment and until a successor is appointed.