In all civil actions prosecuted in the name of the State by an officer duly authorized for that purpose the State shall be liable for costs in the same cases and to the same extent as private parties. If a private person be joined with the State as plaintiff he shall be liable in the first instance for the defendant‘s costs, which shall not be recovered of the State until after execution issued therefor against such private party shall have been returned unsatisfied.