At any time after the making and entry thereof, the commission may, after notice and hearing, alter, amend, suspend, annul, set aside, or otherwise modify any order made by it. This hearing shall not be required when any prior order made by the commission was made under a provision of law that did not require a hearing and a hearing was, in fact, not held.