Hi Cecile, unfortunatetly the only solution I've found for this is to not pre-populate either those fields where 'not specified' is often found, or not pre-populate any fields for a period of time, until many of your known records have updated this information.
If anyone has a better solution, I'd love to know about it!