That happens if you try to go back to the Concrete World portal(the red bowling ball) or just try to maneuver while too close to it. Because there's a number of events there that probably get triggered if you aren't facing other than up when you get past 'em.