Instead of displaying one image at a time and scrolling through them, images are stacking on top of each other. This only happens after loading the page, then refreshing it - and only if the user is logged in. It only seems to happen for some roles.
The easy solution was to disable block caching in admin/config/performance. I'm curious to hear if anybody else has had this problem with os_slideshow.