A nonconforming building, or part thereof, that is damaged or destroyed may be restored to a safe and sanitary condition. Any damaged nonconforming land or building that is determined to be unsafe or a hazard to public health or safety shall be subject to all other regulations of the Town related to unsafe buildings.