After releasing the 'HTML5 audio with playlist' extension, I have received several requests for a 'video version'. So here it is
This (free) extension adds a playlist to the standard HTML5 video player.