Clicking "Back" with Conditional Rules

If I put in a conditional rule "If answer is blah skip to page 3" and they get to page 3 and click back, it takes them to page 2 rather than where they came from, page 1.

Is there any way to avoid that?

Thanks!