The police jury of each parish shall provide a good and sufficient court-house, with rooms for jurors, and a good and sufficient jail, at such place as they may deem most convenient for the parish at large, provided that when the seat of justice is established by law, they shall not have power to remove it.