An efficient architecture for a virtual desktop system in a Virtual Machine Monitor (VMM) operating environment. In one embodiment, initially, a virtual desktop computer system utilizing one or more host computer systems provides one or more remote display systems with interactive graphics and video capabilities. The host computer system generally manages windows and frames that correspond to remote display systems and manages updating the remote display systems over a network connection. Preferred embodiments include a multi-display processor that is enhanced for VMM operating environments.