Hey Alex, thanks for your patience here. Was able to confirm that current functionality in the system is that since the "Respond with Yes or No" is a response to the customer's text, that will clear any unreplied messages from the sidebar as well. Changes to this functionality would be a feature request to the product team using that megaphone icon in the bottom left corner of your screen!