In case of the declination of any member of such board of visitors to act under his appointment, or of the occurrence of any other vacancy in the board not caused by expiration of term, the governor shall forthwith appoint some suitable person to fill such vacancy, and the member so appointed shall serve out the term of his predecessor.