I think you are able to change it, but I've seen a warning that the data will be deleted. It's a little bit of work, but you could always export a list of the current field values with the user's email address, and then re-upload once you have changed the field over.