Hi Jim,
Two options here -- you can remove from the Campaign Members smart list that's part of any Smart Campaign and delete one by one.
Or, and this is not for the faint of heart, you can set up a batch campaign to make the selections for you... I'd be very careful in making sure you're selecting the right records for removal (the "Email Bounced" filter has some good constraints you could look into).