No such dam shall be erected or canal constructed to the injury of any mill or canal lawfully existing on the same stream; nor to the injury of any mill site, on which a mill or milldam has been lawfully erected and used, unless the right to maintain a mill thereon has been lost or defeated.