In each capital case where a defendant is arrested under a capias in a county other than that in which the case is pending, the sheriff who arrests or to whom the defendant is delivered, shall convey him immediately to the county from which the capias issued and deliver him to the sheriff of such county.