Update: Latest twitter subtitle file for The Virtual Revolution
Update: Revised code to include other timed text/caption formats
On demand television like the BBC iPlayer has changed the TV habits of many users. Instead of waiting to tune into the live broadcast views can download and watch programmes at a time of their choosing and on a range of devices. Another media revolution has been status update/social networking sites like twitter. Ever wanting to engage with the listeners twitter is becoming the new ‘phone-in’ or ‘SMS text your thoughts’ for broadcasters. Whilst in the general populous there is still uncertainty over the benefits of sites like twitter broadcasters are already exploring how this technology can be used. A case in point in the BBC/Open University The Virtual Revolution series which is exploring how 20 years of the web has shaped our lives. Its not surprising that a programme of this ilk is exploring how technology can be used to support the broadcast (including allowing viewers to mash-up and reuse clips from the series), it is also the first programme that I’ve seen broadcast a hashtag within its opening credits. The hashtag is a community driven invention which allows comments and content to be tracked across the web including in comments made as tweets.
I find watching the programme with this backchannel communication is entertaining and for me adds a new dimension. There are perhaps educational uses to be explored such as engaging students in real-time discussion, asking them to critically reflect and evaluate what is being presented in real-time.
But what if you are busy on a Saturday night? Whilst you can rewind the programme via iPlayer and use the twitter search to pull up the tweets, these have become decoupled. This might have been a problem Tony Hirst encountered when he tweeted:
Hmmm, mulling over how to replay a hashtagged feed in real time from, say, a two hour window (bbcrevolution)
— Tony Hirst (@psychemedia) February 14, 2010
Tony has been a valuable source for me in past, providing inspiration for my Twitter voting mash-up (TwEVS). Another of his ideas is a Twitter YouTube subtitle mashup, which extracts tweets to use as subtitles in YouTube videos of live events. Using exactly the concept I’ve come up with a way to allow a user to replay a downloaded iPlayer episode subtitling it with the tweets made during the original broadcast.
In action
So first to see the results in action. The video below shows the iPlayer playing ‘The Virtual Revolution: The cost of free’ displaying the tweets made during the live broadcast as subtitles.
How it was done
When you download a programme to watch using iPlayer as well as the video several other assets including a subtitle file in W3C Timed Text Authoring Format. To see this episode in full with twitter subtitles download The Virtual Revolution: The cost of free here. Once downloaded by default the programme should be saved in [My Documents] > [My Videos] > [BBC iPlayer] > [repository] > [obscure-broadcast-folder-name-like-b00qx4t0] (not sure what this would be for non-PC). To view with tweets open this folder and replace ‘obscure-broadcast-folder-name-like-b00qx4t0_prepared.xml’ file with this one [righ-click save link as], keeping the folder name at the beginning of the file name. When you play the video and turn on subtitles the tweets should be displayed.
To create the XML file for any downloadable BBC broadcast I created a tool using the same concept as Tony’s subtitling YouTube example. Here is the Twitter Powered Subtitles for BBC iPlayer Tool I created.
Whilst the tool was designed for the iPlayer it generates a timed text xml file which might be suitable for other applications. Hopefully the tool is straight forward to use all you have to do if find a programme with an active twitter back-channel (you might be surprised at how many their already are once you start searching). If you have any questions/problems post them in the comments below.
Here is the code used for this tool (it also uses the SimplePie code library for handling the RSS). The code includes comments to describe what is going on. Feel free to edit, modify or build upon again use the comments below to share developments.
Limitations and future directions
One of the limitations of this solution is it only replays tweets for the duration of the programme. Having looked around I haven’t been able to find any other twitter replay tools. A solution I did explore was using another W3C format called Synchronized Multimedia Integration Language (SMIL). This standard also integration of multimedia with text, images and other objects. My plan was to use the smilText JavaScript engine to replay tweets in the browser without linking it to any media. Having played around with the JavaScript engine I couldn’t get it to work. Perhaps the baton needs to be passed back to Tony … 😉
Twitter Powered Subtitles for BBC iPlayer Content c/o the MASHe Blog « OUseful.Info, the blog…
[…] leads to a how to post on Twitter powered subtitles for BBC iPlayer in which Martin “come[s] up with a way to allow a user to replay a downloaded iPlayer episode […]
cyberdoyle
cool idea, one day we could have a live twitterfeed on the live version of the show… would have to be 30second moderated because of numpties putting spam stuff on, but heck it wouldn’t half raise awareness of social media, to people who would otherwise not know what’s going on online…
Until that day an iPlayer one would be fantastic. Keep at it o geeky ones.
chris
chris
Martin Hawksey
@cyberdoyle – something for the future. You can already see manufactures trying to integrate social media into everything from your toaster to your tv. My tv at home has a twitter client http://twitgoo.com/34lcn – it’s rubbish but I like the concept.
@Dan – Interested to hear how you get on; iPlayer on Mac is a bit of a mystery to me. Love the programmes philosophy to encourage mash-ups!
Dan Biddle
Awesome. I am trying this as soon as I get home to my Mac.
Absolutely delighted to see that someone took the #bbcrevolution hashtag and ran with it. You’ve made our day here on the Virtual Revolution team 🙂
Many thanks,
Dan
cyberdoyle
I just think its a great way to get people like me to turn the tv on in the first place. I have enjoyed many programmes on twitter without having tv on, but if I could do both… wow. The only reason I saw #bbcrevolution was because twitter reminded me. think its time the tv bosses got real and did a bit more research into the possibilities of this idea. it would cut both ways, more people would look at twitter, and more tweeters would turn tv on.
chris
Martin Hawksey
@cyberdoyle Looks like this is an area the BBC are exploring:
They talk the talk but will they walk the walk …
cyberdoyle
Martin – I followed the link but the video won’t play. It might be my crap connection but I don’t think so, others play.
Scheduling Content Round the Edges – Supporting OU/BBC Co-Productions « OUseful.Info, the blog…
[…] subtitle based annotations, as demonstrated by Martin Hawksey’s Twitter backchannel as iPlayer subtitles hack. The hack describes how to create an iPlayer subtitle feed (I describe some other ways we […]
Stuff I’ve seen February 20th through to February 23rd | Podnosh
[…] MASHe » Blog Archive » Twitter powered subtitles for BBC iPlayer – "Whilst in the general populous there is still uncertainty over the benefits of sites like twitter broadcasters are already exploring how this technology can be used. A case in point in the BBC/Open University The Virtual Revolution series which is exploring how 20 years of the web has shaped our lives. Its not surprising that a programme of this ilk is exploring how technology can be used to support the broadcast (including allowing viewers to mash-up and reuse clips from the series), it is also the first programme that I’ve seen broadcast a hashtag within its opening credits. The hashtag is a community driven invention which allows comments and content to be tracked across the web including in comments made as tweets." […]
New Toys, Old Thinking – Advertising in a new age « just another developer
[…] The BBC have been great pioneers in the UK for experimenting with online distribution of their content. Most recently they have integrated twitter into their subtitles so that rather than users sending a text message into a show with their thoughts, viewers simply tweet with a hash tag of “bbcrevolution” and their thoughts are displayed as subtitles whilst the show is being broadcast on BBC iPlayer. (via http://www.rsc-ne-scotland.org.uk/mashe/2010/02/twitter-powered-subtitles-for-bbc-iplayer/) […]
Issues In Crowd-sourced Twitter Captioning of Videos « UK Web Focus
[…] by Martin Hawksey of RSC Scotland North and East which describes Martin’s service for Twitter powered subtitles for BBC iPlayer. And yesterday Martin used his software to which provides Gordon Brown’s Building Britain’s […]
BBC iPlayer Gets a New Beta Release, plus Some Thoughts on My Changing TV Habits « OUseful.Info, the blog…
[…] tweets that can be fed into an evolving status updates caption feed (e.g. other Martin’s Twitter powered subtitles for BBC iPlayer, JISC10 Conference Keynotes with Twitter Subtitles or most recently Google I/O 2010 – Keynote Day […]
What influenced me this week… at Scenario Girl
[…] Twitter powered subtitles for the BBC iPlayer […]
An Early Example of a TTML Application « UK Web Focus
[…] used with the BBC iPlayer“. This example was initially used to provide Twitter captioning of the BBC/OU The Virtual Revolution programme followed by Gordon’s Browns talk on Building Britain’s Digital […]
Making ripples in a big pond: Optimising FOTE10 videos with an iTitle Twitter track « FOTE 2010
[…] creating a subtitle file for YouYube. Almost a year later in February 2010 the idea was revived in Twitter powered subtitles for BBC iPlayer which saw the publication of the online Twitter subtitling tool […]
CLIPP Board » JISC 2011 conference
[…] A short report on the JISC 2011 conference, of which you can revisit some of the live streamed sessions and grab the virtual goody bag. The keynote speech by Professor Eric Thomas, Vice-Chancellor of the University of Bristol, contextualised our current shift in HE provision to an unavoidable consumer lead market model. The twitter back channel displayed next to the recorded videos makes for a useful resource, and a glimpse into personal reflections on the day. Maybe they should have used the tool created by Martin Hawksey (JISC) which enables Twitter feeds to by overlaid onto video? […]