If any person engaged in a riot, rout or unlawful assemblage, pull down or destroy, in whole or in part, any dwelling house, courthouse, jail, prison, asylum, hospital, school or college building, or any public building of any character, or assist therein, he shall be guilty of a felony, and, upon conviction, shall be confined in the penitentiary not less than one nor more than ten years; and though no such building be injured, every rioter, and every person unlawfully or tumultuously assembled, shall be guilty of a misdemeanor, and, upon conviction, shall be confined in jail not more than one year and fined not exceeding $500.