• VP8 built into devices - including camera chips
• Systems with dedicated VP8 support
• VP9 v H.264: Google I/O

var constraints = {video: true};

function successCallback(stream) {
  var video = document.querySelector("video");
  video.src = window.URL.createObjectURL(stream);
}

function errorCallback(error) {
  console.log("navigator.getUserMedia error: ", error);
}

navigator.getUserMedia(constraints, successCallback, errorCallback);

Be sure to enable screen capture support in getUserMedia!

var constraints = {
  video: {
    mandatory: {
      chromeMediaSource: 'screen'
    }
  }
};

navigator.getUserMedia(constraints, gotStream);

• Acquiring audio and video
• Establishing a connection between peers (signaling)
• Communicating audio and video
• Communicating arbitrary data

• MediaStreams (aka getUserMedia)
• RTCPeerConnection
• RTCDataChannel

• Same API as WebSockets
• Ultra-low latency
• Optionally unreliable or reliable (UDP)
• Secure

• Precise timing of multiple overlapping sounds
• Audio pipeline/routing for effects and filters
• Visualize and manipulate audio data

• Oscillators
• Sequences/rhythms/loops
• Fade-ins/fade-outs/sweeps
• Time-based event scheduling
• Frequency and waveform analysis
• Acoustic environments: reverb, etc.
• Waveshaping (non-linear distortion)
• Dynamics processing (compression)
• Filtering effects: radio, telephone, etc.
• Distance attenuation and sound directionality
• Doppler shift: changing pitch for moving sources
• 3D spatialization: positioning sound at a particular place

• Chrome desktop and Android — including gUM input
• Safari 6.0+ and iOS6+
• Firefox 25 desktop and Android
• Mic to speaker latency as low as 5ms

// Success callback when requesting audio input stream
function gotStream(stream) {
    var audioContext = new webkitAudioContext();

    // Create an AudioNode from the stream
    var mediaStreamSource = audioContext.createMediaStreamSource(stream);

    // Connect it to the destination or any other node for processing!
    mediaStreamSource.connect(audioContext.destination);
}

navigator.getUserMedia( {audio:true}, gotStream);

Capture microphone input and stream it to a peer with processing applied:

navigator.getUserMedia('audio', gotAudio);
function gotAudio(stream) {
  var microphone = context.createMediaStreamSource(stream);
  var filter = context.createBiquadFilter();
  var peer = context.createMediaStreamDestination();
  microphone.connect(filter);
  filter.connect(peer);
  peerConnection.addStream(peer.stream);
}

More Media Stream integration examples

• New proposed standard
• Standard MIDI files: not just cheesy background music!
• Connect controllers, synthesizers and more
• Implemented in Chrome behind a flag - Mac, Windows, Linux, ChromeOS and Android!