Each foreign bank which is licensed to establish and maintain a state branch, agency or representative office shall make, keep and preserve at the office all such books, accounts and other records relating to the business of the office in such form, in such manner and for such time as the Commissioner may provide.