Elliott,
You should be able to delete social buttons that are not in use. Unfortunately, the "Used by" info on the summary tab of social apps is refreshed ONLY on full page reload and not automatically as soon as the social asset is placed on a LP. We will be fixing this in a future release.
Raj