Media APIs for the Multi-Platform Web
Stay organized with collections
Save and categorize content based on your preferences.
Along with a proliferation of new devices and platforms on the web, we're seeing huge growth in audio, video and realtime communication. Online media is transforming the way we consume media of all kinds.
A UK government study found that 53% of adults 'media multi-task' while watching TV: using mobile devices to share and consume media. In many countries TV viewing is down and online viewing is up. In China, for example, in 2012 only 30% of households in Beijing watched TV, down from 70% in 2009. According to the W3C Highlights 2013, 'In the past year video-watching on mobile devices has doubled. This year in the US, the average time spent with digital media per day will surpass TV viewing. Viewing is no longer a passive act. In the US, 87% of entertainment consumers say they use at least one second-screen device while watching television.' According to Cisco 'video ... will be in the range of 80 to 90 percent of global consumer traffic by 2017'. That equates to nearly a million minutes of video every second.
So what do we have for web developers? An ecosystem of media APIs for the open Web: standardized, interoperable technologies that work across multiple platforms.
Takeaways
- WebRTC provides realtime communication in the browser, and is now widely supported on mobile and desktop. In total there are already over 1.2 billion WebRTC endpoints.
- Web Audio provides sophisticated tools for audio synthesis and processing.
- Web MIDI, integrated with Web Audio, allows interaction with MIDI devices.
- The audio and video elements are now supported on more than 85% of mobile and desktop browsers.
- Media Source Extensions can be used for adaptive streaming and time shifting.
- EME enables playback of protected content.
- Transcripts, captions and the track element enable subtitles, captions, timed metadata, deep linking and deep search.
Slides: Media APIs for the multi-device Web
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2024-08-06 UTC.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2024-08-06 UTC."],[[["\u003cp\u003eOnline media consumption is rapidly growing, with video predicted to be 80-90% of global consumer traffic by 2017.\u003c/p\u003e\n"],["\u003cp\u003eConsumers are increasingly multitasking while consuming media, often using a second device while watching TV.\u003c/p\u003e\n"],["\u003cp\u003eWeb developers have access to a growing ecosystem of media APIs for the open web, such as WebRTC, Web Audio, and Media Source Extensions.\u003c/p\u003e\n"],["\u003cp\u003eThese APIs offer standardized, interoperable technologies that enable sophisticated audio and video manipulation and playback across multiple platforms.\u003c/p\u003e\n"],["\u003cp\u003eThis shift in media consumption habits presents new opportunities for creating interactive and engaging user experiences on the web.\u003c/p\u003e\n"]]],["Online media consumption is growing, with video-watching on mobile devices doubling recently. TV viewing is declining, while digital media usage surpasses it. Most media consumers multitask with second-screen devices. Video is projected to dominate global consumer traffic. Web developers now have access to standardized media APIs, including WebRTC for real-time communication, Web Audio, Web MIDI, Media Source Extensions for adaptive streaming, EME for protected content, and the track element for enhanced media experiences.\n"],null,["# Media APIs for the Multi-Platform Web\n\nAlong with a proliferation of new devices and platforms on the web, we're seeing huge growth in audio, video and realtime communication. Online media is transforming the way we consume media of all kinds.\n\nA [UK government study](http://media.ofcom.org.uk/2013/08/01/the-reinvention-of-the-1950s-living-room-2/) found that 53% of adults 'media multi-task' while watching TV: using mobile devices to share and consume media. In many countries TV viewing is down and online viewing is up. In China, for example, in 2012 [only 30% of households in Beijing](http://economist.com/news/business/21589434-chinas-online-video-market-largest-and-most-innovative-world-it-also-most) watched TV, down from 70% in 2009. According to the [W3C Highlights 2013](http://www.w3.org/2013/11/w3c-highlights/), 'In the past year [video-watching on mobile devices has doubled](http://www.w3.org/2013/11/w3c-highlights/). This year in the US, the [average time spent with digital media per day will surpass TV viewing](http://www.emarketer.com/Article/Digital-Set-Surpass-TV-Time-Spent-with-US-Media/1010096). Viewing is no longer a passive act. In the US, [87% of entertainment consumers](http://www.eweek.com/mobile/npd-87-percent-of-tv-watchers-view-with-a-second-screen/) say they use at least one second-screen device while watching television.' According to [Cisco](https://goo.gl/RfB73h) 'video ... will be in the range of 80 to 90 percent of global consumer traffic by 2017'. That equates to nearly a million minutes of video every second.\n\nSo what do we have for web developers? An ecosystem of media APIs for the open Web: standardized, interoperable technologies that work across multiple platforms.\n\nTakeaways\n---------\n\n- [WebRTC](https://bit.ly/webrtcwebaudio) provides realtime communication in the browser, and is now widely supported on mobile and desktop. In total there are already over 1.2 billion WebRTC endpoints.\n- [Web Audio](http://html5rocks.com/en/tutorials/webaudio/intro) provides sophisticated tools for audio synthesis and processing.\n- Web MIDI, integrated with Web Audio, allows interaction with MIDI devices.\n- The audio and video elements are now supported on [more than 85% of mobile and desktop browsers](http://www.jwplayer.com/html5/).\n- [Media Source Extensions](http://updates.html5rocks.com/2011/11/Stream-video-using-the-MediaSource-API) can be used for adaptive streaming and time shifting.\n- EME enables playback of protected content.\n- Transcripts, captions and the [track element](http://www.html5rocks.com/en/tutorials/track/basics/) enable subtitles, captions, timed metadata, deep linking and deep search.\n\n**Slides:** [Media APIs for the multi-device Web](http://simpl.info/media/#1)"]]
