Search for Contacts That Have Been Marked Inactive
You can mark your contacts that you do not want to include in Group Actions as Inactive. This will exclude them from future mailings, etc.
For information on how to mark a contact as Inactive, click this help article.
Here are the steps to filter all of the contacts that have been marked Inactive.