To have an office at the seat of government, and to keep a record of all matters pertaining to the business of such office.