Any activity criteria you add to each Choice in the Remove from Flow action (e.g. Visited Web Page, Clicked Link, etc.) will apply to all time, not just the time that the lead was in the flow of the smart campaign. You can add additional filters with Date of Activity constraints to the smart list of the smart campaign, but this may exclude others that you want to include in the smart campaign. The other option is to create a separate smart list with those filters and constraints and then your Choice in the Remove from Flow flow action would be "If Member of Smart List is xxxx".