A challenge to the panel is an objection made to all the jurors returned, and may be taken by either party.