Hey Josh,
I think you have too much in one Flow. You are referencing a certain smart list of folks. When they qualified for the campaign, they had not been delivered the invite, so segmenting your list to change their status wouldn't work I would imagine. Especially because when you send emails, the system will see that behavior right away, but it could take a while to deliver it. By the time it is delivered, the Lead has continued to move through the flow where nothing would happen to them in Step 2, they would wait 6 days, and then nothing would happen to them in Step 4.
I would manually change the status this time around for everyone who was delivered an email, but moving forward, I would break this up into multiple smart campaigns. You might be able to get away with Steps 2-4 within one Flow, but I would recommend making Step 1 it's own smart campaign.