I'm assuming you have a filter like this for a Smart List of who to exclude:
Email address contains "@xyz.com"
I would add another filter that says:
email address does not contain "joe@xyz.com, bob@xyz.com"
If you have your filters set to "ALL" it should pick up anyone's email address with the domain @xyz.com who is not Joe or Bob.