The register shall keep his office at the place at which the court of which he is register is held.