The votes of such former residents shall be subject to challenge for cause to the same extent, and any such challenges shall be determined in the same manner, as provided by law with respect to votes of resident electors.