Hmm, interesting. I've just been trying to climb down the bottom ladders, but don't seem able to. There's probably a trick I don't know about.
I was able to recreate the glitch I posted originally, by positioning Mario near the top of the ladder by the time it starts to collapse.