Pending the hearing and the decision thereon, such rate shall not go into effect; but the period of suspension of such rate shall not extend more than one hundred twenty days beyond the time when such rate would otherwise go into effect.