Patent 9191616 was granted and assigned to Microsoft on November, 2015 by the United States Patent and Trademark Office.
An event computer receives video in which one or more local participants of a conferencing event are viewable. The event computer receives head detection information of the local participants and assigns contextual data to the head detection information for each of the local participants for which head detection information is received. The event computer then sends the video, the head detection information, and the contextual data to one or more remote participant computer systems by which one or more remote participants can view the local participants and their corresponding contextual data within the video.