The oath of office may be administered to the members of the Legislature by any judge of the Supreme Court, Court of Civil Appeals, Court of Criminal Appeals, circuit, district or probate court, the President of the Senate or the Speaker of the House of Representatives. The President of the Senate and the Speaker of the House of Representatives may be sworn in by any member of their respective houses.