To access the full playlist of videos, press the icon in the top right corner of the video window (the one with a fraction and the horizonal lines).