When the Governor has reason to believe that any officer or commissioner of the Executive Department who is appointed or nominated by the Governor, with or without confirmation of the General Assembly or either house thereof, or any duly authorized deputy of such officer, is guilty of misconduct, material neglect of duty or incompetence in the conduct of his office, he shall serve upon such officer, commissioner or deputy a notice of the charges preferred against him, of the time, within ten days of the service of such notice, when such officer, commissioner or deputy will be given a hearing by him on such charges and of the place where such hearing will be held. The Governor may suspend any such officer, commissioner or deputy from office pending his decision on such charges upon including in the notice required herein his order of such suspension.