Real Time Periscope Video Manipulation

Access the Perioscope video stream and manipulate it in real time.  Anyone with experience in video encoding, decoding, networking and real time graphics is more then welcome.  One of the examples of what you can do when we can access the video stream of Periscope is adding effects like https://vimeo.com/68188517 

(No idea if the stream is encrypted :) )