If the challenge is denied, the denial may be oral, and must be entered on the minutes of the court, and the court must proceed to try the question of fact; and upon such trial, the officers, whether judicial or ministerial, whose irregularity is complained of, as well as any other persons, may be examined to prove or disprove the facts alleged as the ground of the challenge.