What do would partly depend on how much bad records you have - if it's just a handful, then you could go through them individually and delete/merge or markas bogus.
If it's thousands, you'll need to think of something more creative, and the answer will highly depend on the state of the data.
Another things you should definitely do is set up processes to make sure this doesn't happen again.