Every deputy in any of said offices shall, before entering upon his duties under such appointment, take and subscribe the like oath of office as that required to be taken by the officer appointing him, and shall deposit the same in the office where the bond of such officer is deposited.