How do you stop iPhoto from rescanning for faces?

How do you stop iPhoto from rescanning for faces?

Every time I tag a bunch of faces and click "Done", iPhoto starts to rescan all the photos with uncomfirmed faces.