How would you identify and remove duplicate records from a large dataset where no primary key is defined?