|Publication number||US8082517 B2|
|Application number||US 11/869,792|
|Publication date||20 Dec 2011|
|Filing date||10 Oct 2007|
|Priority date||22 May 2002|
|Also published as||US7293243, US20080034320|
|Publication number||11869792, 869792, US 8082517 B2, US 8082517B2, US-B2-8082517, US8082517 B2, US8082517B2|
|Inventors||Ido M. Ben-Shachar, Deana Rae Fuller, Ivan J. Leichtling, Robert W. Schmieder|
|Original Assignee||Microsoft Corporation|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (143), Non-Patent Citations (13), Referenced by (21), Classifications (13), Legal Events (2)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This application is a continuation of U.S. patent application Ser. No. 10/153,501 entitled “APPLICATION SHARING VIEWER PRESENTATION,” filed on May 22, 2002, which application is hereby incorporated by reference in its entirety.
This invention relates generally to the technology of application sharing and, more particularly, relates to a system and method for improving a viewer's experience during application sharing.
As computers and computer networks become more pervasive in the home and workplace, many old methods for performing everyday tasks are being replaced or streamlined through the use of computer networking technology. For example, many employees are now able to have a virtual presence in their workplace by logging into a computer network maintained by their employer. One of the most striking developments in computer networking technology has been the advent of remote collaboration.
One of the oldest forms of processing data is the meeting or conference, whereby multiple individuals focus their attention on common subject matter to arrive at a joint decision, consensus, or product. Increasingly, such meetings are now taking place in a virtual manner over computer networks through the use of application sharing technologies. Such technologies enable a sharing user to share an application with various viewing users. The display produced by the application running on the sharer's computer is made available via a computer network to the viewers' computers. In some cases, the sharer may pass control of the application to a viewer, whereby the viewer's control inputs are then communicated back to the sharer's computer, where the actions associated with the inputs are executed, and the resulting changed display is shared back out to the viewers.
Although application sharing can play a critical role in maintaining or increasing productivity and cooperation, certain problems with current application sharing systems sometimes create a confusing user experience. For example, computer displays are available in a wide variety of sizes, making it likely that an application sharing sharer and an application sharing viewer will have screens of different sizes. That means that in some instances, a viewer may see on his screen less of an item than is being displayed on a sharing machine display. In such situations, typical application sharing technologies have provided a scrolling facility to the viewer to enable them to access all of the displayed material. However, scrolling in this manner may be distracting or cumbersome to the user and may hinder the success or effectiveness of the application sharing session. While some application sharing technologies have allowed scaling of the entire desktop of the sharer, this technique is extremely CPU intensive, scaling the desktop based on a simple ratio of desktop-sizes from sharer to viewer, often introducing more scaling than is required, and thus making small items difficult to read. Furthermore, no such technologies have enabled a substantially continuous scaling to provide better matching between disparate screen sizes.
A related problem pertains to the sharer's ability to keep the viewer's attention focused on a current document of interest, i.e. the document that the sharer is working in or focusing on. Unfortunately, typical application sharing technologies do not always effectively focus the viewer's attention on the current document of interest to the sharer. Accordingly, while the sharer focuses on one document, the viewer may actually be focused on another.
A system and method are needed whereby the viewer experience of application sharing is improved over prior systems when application sharing participants use different screen sizes, or when the application sharing session involves numerous items, only one of which is currently of interest.
A novel system and method are described for increasing the effectiveness and simplicity of application sharing. In an embodiment of the invention, a viewing display is modified to increase the likelihood that a viewing user is able to see, without scrolling, the entirety of a window of interest displayed by a sharing user on a sharing machine. The scale of the viewer representation of the window of interest may be substantially continuously varied so as to best account for the particular size of the available display area at the viewing machine. In a further embodiment of the invention, the viewer's attention is focused by filtering of the shared display material to visually emphasize the current item of interest by excluding other windows from the display. In this way, the viewer's current focus will generally coincide with the sharer's current focus as is generally desirable during application sharing. Other features and advantages of various embodiments of the invention will become apparent from the detailed description set forth hereinafter.
While the appended claims set forth the features of the present invention with particularity, the invention, together with its objects and advantages, may be best understood from the following detailed description taken in conjunction with the accompanying drawings of which:
Turning to the drawings, wherein like reference numerals refer to like elements, the invention is illustrated as being implemented in a suitable computing environment. Although not required, the invention will be described in the general context of computer-executable instructions, such as program modules, being executed by a personal computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that the invention may be practiced with other computer system configurations, including hand-held devices, multi-processor systems, microprocessor based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, and the like. The invention is primarily for use in a networked environment and may further be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
The invention is operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that are suitable for use with the invention include, but are not limited to, personal computers, server computers, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
An exemplary system for implementing the invention includes a general-purpose computing device in the form of a computer 110. Components of the computer 110 generally include, but are not limited to, a processing unit 120, a system memory 130, and a system bus 121 that couples various system components including the system memory to the processing unit 120. The system bus 121 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. By way of example only, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Associate (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus.
Computer 110 typically includes a variety of computer readable media. Computer readable media can be any available media that can be accessed by computer 110 and includes both volatile and nonvolatile media, removable and non-removable media. By way of example only, and not limitation, computer readable media may comprise computer storage media and communication media.
Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computer 110.
Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics (such as, for example, voltage or current level, voltage or current pulse existence or nonexistence, voltage or current pulse width, voltage or current pulse spacing, etc.) set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of any of the above are also included within the scope of computer readable media.
The system memory 130 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 131 and random access memory (RAM) 132. A basic input/output system 133 (BIOS), containing the basic routines that help to transfer information between elements within computer 110, such as during start-up, is typically stored in ROM 131. RAM 132 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 120. By way of example, and not limitation,
The computer 110 may also include other removable/non-removable, volatile/nonvolatile computer storage media. By way of example only,
The drives and their associated computer storage media, discussed above and illustrated in
In the implementation of an embodiment of the invention, the computer 110 operates in a networked environment using logical connections to one or more remote computers, such as a remote computer 180. The remote computer 180 may be a personal computer, a router, a network PC, a peer device or other common network node, and in any case the remote computer or computers typically include many or all of the elements described above relative to the personal computer 110, although only a memory storage device 181 has been illustrated in
The computer 110 should include facilities for accessing the networks to which it is attachable. For example, when used in a LAN networking environment, the personal computer 110 is connected to the LAN 171 through a network interface or adapter 170. Another node on the LAN, such as a proxy server, may be further connected to a WAN such as the Internet. When used in a WAN networking environment, the computer 110 typically includes a modem 172 or other means for establishing communications directly or indirectly over the WAN 173, such as the Internet. The modem 172, which may be internal or external, may be connected to the system bus 121 via the user input interface 160, or other appropriate mechanism. In a networked environment, program modules depicted relative to the personal computer 110, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation,
Herein, the invention is described with reference to acts and symbolic representations of operations that are performed by one or more computers, unless indicated otherwise. As such, it will be understood that such acts and operations, which are at times referred to as being computer-executed, include the manipulation by the processing unit of the computer of electrical signals representing data in a structured form. This manipulation transforms the data or maintains it at locations in the memory system of the computer, which reconfigures or otherwise alters the operation of the computer in a manner well understood by those skilled in the art. The data structures where data is maintained are physical locations of the memory that have particular properties defined by the format of the data. However, while the invention is being described in the foregoing context, it is not meant to be limiting as those of skill in the art will appreciate that various of the acts and operation described hereinafter may also be implemented in hardware.
Specific exemplary architectures of the sharer computer 207 and a viewer computer 201 are illustrated in greater detail schematically in
One or more user mode processes of interest 321 are running on sharer computer 307. Such processes include processes, such as programs, from which information is being shared to one or more viewers such as viewer 307. The processes of interest 321 will be referred to hereinafter as shared processes, with the understanding that the information generated by the processes 321 need not be shared completely. That is, the information shared may consist of a subset of the information generated by such a process 321. Many shared process can also be used in a non-shared manner. For example, a word processing program may be used by the sharer for non-collaborative document production, and may then be used in a shared manner for group editing of the same or another document. In either mode, the processes 321 and the operating system of the sharer computer 307 perform certain steps. For example, whether or not the process 321 is shared, the output of the process 321 will still generally be output to the graphics display driver of the sharer computer 307.
If the application sharing program 323 is active, such as during a sharing session, then other processes unique to the collaborative setting also take place. In particular, the application sharing program 323, which is communicably linked to the process 321, receives information from the process 321 and transfers information to the process 321. Although the bi-directional flow of information between the process 321 and application sharing program is illustrated by a double arrow, note that the mechanisms for transfer may vary depending upon direction. For example, the process 321 need not even be aware of the presence or operation of the application sharing program 323 for the application sharing program 323 to receive information from the process 321.
Typically, the application sharing program 323 is communicably linked to an interceptor filter placed in the display path for the process 321. Such a filter may be placed just before the graphics device interface (GDI) or similar interface in such a manner as to read, in a non-intrusive manner, all information sent to the screen, such as monitor 191, of computer 307 by a shared process. In the WINDOWS operating system produced by MICROSOFT of Redmond, Wash., when an application is to display an object, it calls a GDI function and sends the various parameters for the object. In turn, the GDI sends commands to the screen, such as monitor 191, to cause it to display the object. In contrast, the mechanism for transferring information from the application sharing program 323 to the process 321 need not involve the display path at all, and may instead involve a direct transfer of information.
Regardless, the application sharing program 323 is also communicably linked to the networking facilities 325 of the sharer computer 307. Such facilities 325 may include any networking communications stack or other protocol arrangement as well as the hardware required for accessing the network connection 319, as discussed above with respect to
The general operation of the architecture and components illustrated in
The application sharing program 327 resident on the viewer machine 329 should be running before sharing of documents occurs, and may be run in the same manner as described above. At this point, document sharing may occur. That is, of all the documents selected as shared by the user of sharer machine 307, data corresponding to all or some shared windows is transmitted to the viewer computer 301 for display on the screen or display device of that computer 301 in an embodiment of the invention.
Having described the physical architecture of an application sharing system according to an embodiment of the invention, the interoperation of the various components to accomplish automatic screen size accommodation will now be described by way of an overview followed by a more detailed discussion of various functionalities within embodiments of the invention. A viewing computer such as computer 301 has a finite display size, such as on a monitor 191, for displaying a shared document. This finite display size typically will correspond to an application sharing window, which may cover substantially the entire viewer display when maximized. Some viewers will occupy much less than all of the computer's screen, even when maximized, due to other collaboration-related user-interface elements such as a chat application or general controls on the screen for application sharing (e.g., buttons, status displays such as a user roster, etc.) When the available viewing computer display area is less than the area that the sharer computer uses to display the shared document, it is desirable to automatically modify the scale of the shared document to ensure that in most cases the viewing user can see the entirety of the shared document without scrolling or otherwise scanning the viewing display. However, when such scaling would yield a viewer representation of the shared document that is unacceptably small, the viewer application sharing program no longer reduces the document size in an embodiment of the invention but instead provides scrolling functionality to allow at least some access to the entire document. In an embodiment of the invention, child windows of the shared document window are included in the document size prior to scaling such that the reduced representation of the shared document on the viewer display includes the entirety of the child window within the available viewing computer display area on the viewer machine.
The screen views of
At step 703, the viewing computer 301 parses the received windows list to identify windows to be displayed to the viewing user. Although in some embodiments of the invention more than one shared window will be displayed to the viewing user,
The viewing computer 301 compares the size of the shared window to be displayed with the size of the available viewing area in step 705. Although the available viewing area will generally be a subset of the entire viewing computer viewing area, in the case where the application viewing window or area is maximized, its size may approximate the size of the entire viewing computer display area. If it is determined at step 707 that the size of the shared window does not exceed the available viewing area, then the process moves to step 709, whereat the shared window is displayed unscaled in its entirety within the available application sharing viewing area on the viewing computer 301.
If instead it is determined at step 707 that the size of the shared window exceeds the available viewing area at the viewing computer 301, then the process flows to step 711, at which point a scaling factor is calculated such that scaling of the shared window by the scaling factor would enable the entirety of the shared window to be displayed within the available viewing area. Subsequently at step 713, it is determined whether the scaling factor calculated in step 711 falls below 60%, that is, whether the scaled image resulting from application of the scaling factor to the shared window would be smaller than 60% of the size of the shared window. If the scaled image would be smaller than 60% of the size of the shared window, then the process moves to step 715, and displays the shared window in the available application sharing viewing area on the viewing computer 301 at 60% scale, with scroll bars provided for accessing portions of the document that are not currently visible.
Note that if the viewer has scrollbars up, and the viewing user scrolls over manually to a particular portion of the relevant material, such as at the right-most and lowermost position of the scrollbars, and then the sharer modifies the size of the shared application, the viewer's scrollbars may disappear if they are no longer needed. If the sharer then resizes the shared application again and causes the viewer to have scrollbars again, the scrolled position at the viewer is preferably, although not necessarily, set to the prior position, i.e. the rightmost and lowermost scrolled position. Alternatively, the newly scrollable display may be set to the leftmost and topmost position, as is often the default for scrollable displays, or any other suitable position.
The scroll bars 409 complicate the user interface somewhat, and raise the possibility that the portion of the document that is of interest to the sharer may not always be visible to the viewer without performing further actions. However, the benefit derived is that an image having English characters and scaled to 60% will still retain a great deal of readability. If scaling of the shared window to a very small size were permitted, the window contents may become unreadable or indecipherable. The invention does not require in every embodiment that scaling beyond a certain level be precluded, nor does it require that the threshold level for introducing scroll bars be 60%. Rather, it is contemplated that in some embodiments, scaling of any degree may be permitted, and that in embodiments where scaling is halted at a certain threshold percentage, that percentage may be any desirable percentage and need not be 60%. For example, language and font size may affect document readability and hence may affect the choice of the threshold percentage. Furthermore, certain types of materials, such as images, may retain their basic visual character under most commonly encountered scaling degrees, and as such there will be situations when scaling of any degree is permitted.
If it is instead determined at step 713 that the scaled image would still be equal to or larger than 60% of the size of the shared window, then at step 717 the process displays the shared window in the available application sharing viewing area on the viewing computer 301 at the scale calculated in step 711. In this case, the scroll bars are not needed by the viewing user since the entirety of the shared window is displayed.
It will be understood that the process of
Some users will want to turn off scaling, especially users that have difficulty reading smaller fonts. Furthermore, tools such as WINDOW's brand “Magnifier” tool by MICROSOFT do not work as well on scaled bitmaps, so people who use such tools to read already small fonts should generally turn off scaling in order to achieve the best readability.
In some cases, the shared window as discussed in
The same principles discussed above with respect to
Within the WINDOWS brand operating system by MICROSOFT, the StretchBlt( ) API is preferably used to move the image from the viewing machine's off screen bitmap to the scaled on-screen representation discussed above with respect to the drawing figures. In particular, to ensure the best quality in the scaled image, the SetStretchBltMode(HALFTONE) API may be used, although this API is computationally complex and thus utilizes greater system resources to execute. According to the SetStretchBltMode(HALFTONE) API, each pixel in the off screen bitmap is color-interpolated with the pixels around it, resulting in a more readable reduced on screen image.
In the past, application sharing programs have not provided a continuously variable scaling ability due to difficulty in avoiding cursor drift and other anomalies often associated with scaling. Thus, such systems typically supported only a finites set of scales. In an embodiment of the invention, a substantially continuous scaling ability is provided by utilizing a micro offset to avoid problems in scaling. As an example of the difficulty encountered, when control of a shared application is passed to the viewing user, and their view is scaled to something other than 100%, such as 70%, and they move their cursor in the shared application to a particular coordinate set, one of the application sharing programs, preferably the viewer's, must scale that coordinate set by 70% to know exactly which pixel should be associated with the cursor in the sharer's (100%) view. However, each pixel in the viewer's view corresponds to several pixels in the sharer's view due to the scaling. This means that the cursor will generally not be exactly positionable in the viewer's view in this situation. Within the WINDOWS brand operating system by MICROSOFT, this is not a very significant problem since WINDOWS typically provides matters that are larger than 1×1 pixel. Otherwise, cursor drift can happen because of the coordinate-translation. Thus, if the viewer moves their cursor over a particular point, then they are scaling that point to the sharer's coordinate system, and instructing the sharer machine to move the real mouse cursor to that point. If the sharer machine sends a message back to the viewer to synchronize the cursor position, the sharer machine may round that point to a slightly different point in the viewer's coordinate system. This may cause the viewer's cursor to be moved a pixel over, at which time the cycle begins again. The end result is that the viewer's cursor is seen to wander or drift across each screen. Accordingly, cursor coordinate translations should avoid this cycle, such as through the use of tolerances or offsets.
In an embodiment of the invention, the viewer is shown only a single document of interest at a time, in order to focus the viewer's attention on the same subject matter as that of the sharer. In particular, the viewer sees different documents appear in the same way that different channels produce different images on a TV, as opposed to the more traditional viewer experience of scanning and exploring a desktop to locate a current window of interest. Often in the traditional experience, out of band communications, such as by way of email or telephone are required to coordinate the attention of the share and the viewer. However, this can be distracting as well as wasteful of resources.
The window processing and display according to this embodiment will be described by reference to the illustration of
The processing of the displayed windows to facilitate application sharing begins at step 901 of
Using the displayed windows of
From the received windows list, the application sharing program at the viewer computer 301 is able to construct a single window user model of the sharer's desktop. In particular, at step 911, the application sharing program at the viewing machine 301 reproduces the shared area in an off screen bitmap, and then in step 913 generates an on screen image 810 of the shared area, either by direct transfer or by scaling as discussed above. The on screen image includes representations 812, 814 of the shared windows 802 and 804, as obscured by window 806, represented by obscured area 815. The scaling may be accomplished by identifying a bounding box for the union of the shared window area less any obscured areas. The GetRgnBox( ) API may be used within the WINDOWS brand operating system to obtain such a bounding box. Note that the portions of the shared area that are obscured will not convey current window content, but the obscuration may be mitigated if desired, either by traditional means such as overlaid hatch marks, or by replicating an image subset to display in the obscured area.
In an embodiment of the invention, a visual indicator provides the sharing user with a prominent annotation highlighting the material that is currently visible to the viewing user. To this end, a visible highlight box surrounding the current top-level shared window and its related shared areas is created by the application sharing program on the sharing machine 307. The box is preferably a distinctly visible color such as a bright red, yellow or orange, of a thickness sufficient to be visible, but preferably not so thick as to substantially obscure other information on the sharing computer display or to overly distract the user. A thickness approximately the same as the thickness of a window frame on the display has been observed to be adequate.
The highlight box preferably lies just outside the bounds of the relevant shared window or windows, and is preferably not itself shared with the viewing user. It will be appreciated by those of skill in the art that there are a number of techniques available for creating the highlight box. For example, conglomerating four elongate windows, one for each side of the box, will create a highlight box that does not obscure the highlighted window or windows. These four windows should generally be higher in z-order than the shared window, regardless of whether or not they are transparent. Alternatively, the box may be created in an overlaid transparent window, although this method is computationally more expensive, and hence generally less desirable.
The automatic zoom display methodology discussed with respect to
All of the references cited herein, including patents, patent applications, and publications, are hereby incorporated in their entireties by reference. That is, each and every part of every such reference is considered to be part of this disclosure, and therefore no part of any such reference is excluded by this statement or by any other statement in this disclosure from being a part of this disclosure.
In view of the many possible embodiments to which the principles of this invention may be applied, it should be recognized that the embodiments described herein with respect to the drawing figures are meant to be illustrative only and should not be taken as limiting the scope of invention. For example, those of skill in the art will recognize that the elements of the illustrated embodiment shown in software may be implemented in hardware and vice versa or that the illustrated embodiment can be modified in arrangement and detail without departing from the spirit of the invention. Furthermore, although network connections are illustrated herein as lines, no limitation should thereby be imparted to the invention. Network connections may be circuit-switched, packet-switched, or otherwise, and may be transient or permanent, hard-wired or wireless, operating via any suitable protocol. Also note that although embodiments of the invention have been described largely by reference to a sharing program that is separate from the shared process, the sharing program may not be a stand alone program, but may instead be an integral part of the shared process itself, or may be a DLL or other in-process entity.
Moreover, the exact values and percentages given in the above description are exemplary only, and may be varied without departing from the scope of the invention. It will understood that although the examples of
Furthermore, references herein to application sharing are not meant to require that all windows or material displayed on a sharer display and associated with a particular application are shared or unshared. Rather, one or more windows associated with an application running on the sharer machine are preferably sharable without requiring the sharing of all windows associated with that instance of that application. Moreover, although the steps employed to construct a viewer display are discussed herein with reference to the application sharing program of the viewer computer, such steps may alternatively be executed in whole or in part at the sharer computer.
Therefore, the invention as described herein contemplates all such embodiments as may come within the scope of the following claims and equivalents thereof.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4386416 *||2 Jun 1980||31 May 1983||Mostek Corporation||Data compression, encryption, and in-line transmission system|
|US4631521 *||31 Dec 1984||23 Dec 1986||Wang Laboratories, Inc.||Method and apparatus for differential run-length coding|
|US4672459 *||7 Jul 1986||9 Jun 1987||Ricoh Company, Ltd.||Communication terminal apparatus with data format conversion capability|
|US4677649 *||18 Apr 1984||30 Jun 1987||Canon Kabushiki Kaisha||Data receiving apparatus|
|US4783834 *||20 Feb 1987||8 Nov 1988||International Business Machines Corporation||System for creating transposed image data from a run end or run length representation of an image|
|US4814987 *||19 May 1986||21 Mar 1989||Sharp Kabushiki Kaisha||Translation system|
|US4823122 *||24 Aug 1987||18 Apr 1989||Digital Equipment Corporation||Local area network for digital data processing system|
|US4882687 *||31 Mar 1986||21 Nov 1989||Schlumberger Technology Corporation||Pixel processor|
|US4897799 *||15 Sep 1987||30 Jan 1990||Bell Communications Research, Inc.||Format independent visual communications|
|US4965677 *||1 Feb 1989||23 Oct 1990||International Business Machines Corporation||Compression of binary halftones|
|US4974173 *||22 Feb 1990||27 Nov 1990||Xerox Corporation||Small-scale workspace representations indicating activities by other users|
|US5008853||2 Dec 1987||16 Apr 1991||Xerox Corporation||Representation of collaborative multi-user activities relative to shared structured data objects in a networked workstation environment|
|US5057916 *||16 Nov 1990||15 Oct 1991||General Instrument Corporation||Method and apparatus for refreshing motion compensated sequential video images|
|US5077732 *||24 Jul 1990||31 Dec 1991||Datapoint Corporation||LAN with dynamically selectable multiple operational capabilities|
|US5172103||4 Sep 1991||15 Dec 1992||Kabushiki Kaisha Toshiba||Image display apparatus|
|US5177622 *||27 Jul 1990||5 Jan 1993||Fujitsu Limited||Method and apparatus for detecting run length of two successive pixels and subjecting run length to universal coding|
|US5179711 *||26 Dec 1989||12 Jan 1993||International Business Machines Corporation||Minimum identical consecutive run length data units compression method by searching consecutive data pair comparison results stored in a string|
|US5206934 *||15 Aug 1989||27 Apr 1993||Group Technologies, Inc.||Method and apparatus for interactive computer conferencing|
|US5210825 *||26 Apr 1990||11 May 1993||Teknekron Communications Systems, Inc.||Method and an apparatus for displaying graphical data received from a remote computer by a local computer|
|US5241625 *||27 Nov 1990||31 Aug 1993||Farallon Computing, Inc.||Screen image sharing among heterogeneous computers|
|US5241653 *||12 Apr 1990||31 Aug 1993||Adobe Systems Incorporated||Apparatus and method for adjusting and displaying scaled, rasterized characters|
|US5255361 *||4 Apr 1991||19 Oct 1993||International Business Machines Corporation||Method of and system for updating a display unit|
|US5287203 *||15 Jan 1993||15 Feb 1994||Ricoh Company, Ltd.||Apparatus for encoding and decoding information on recording medium|
|US5298992 *||8 Oct 1992||29 Mar 1994||International Business Machines Corporation||System and method for frame-differencing based video compression/decompression with forward and reverse playback capability|
|US5319463 *||19 Mar 1992||7 Jun 1994||Nec Corporation||Arrangement and method of preprocessing binary picture data prior to run-length encoding|
|US5390262 *||3 Oct 1991||14 Feb 1995||Ncr Corporation||Method for splitting and configuring a multi-channel image processing system|
|US5404436 *||27 Nov 1991||4 Apr 1995||Digital Equipment Corporation||Computer method and apparatus for converting compressed characters for display in full size|
|US5408600 *||6 Jul 1994||18 Apr 1995||Hewlett-Packard Company||System for dynamic sharing of local and remote displays by maintaining a list of best-match resources|
|US5485559 *||10 Jun 1991||16 Jan 1996||Hitachi, Ltd.||Parallel graphics processor with graphics command distributor and command sequencing method|
|US5491780 *||25 Aug 1994||13 Feb 1996||International Business Machines Corporation||System and method for efficient computer workstation screen updates|
|US5550968 *||12 Apr 1994||27 Aug 1996||International Business Machines Corporation||Method and system for providing access security to controls in a graphical user interface|
|US5565886 *||1 Nov 1993||15 Oct 1996||Microsoft Corporation||Method and system for rapidly transmitting multicolor or gray scale display data having multiple bits per pixel to a display device|
|US5608872 *||19 Mar 1993||4 Mar 1997||Ncr Corporation||System for allowing all remote computers to perform annotation on an image and replicating the annotated image on the respective displays of other comuters|
|US5625809||22 Apr 1994||29 Apr 1997||Hewlett-Packard Company||Method for constructing a data structure which allows data to be shared between programs|
|US5649104 *||19 Mar 1993||15 Jul 1997||Ncr Corporation||System for allowing user of any computer to draw image over that generated by the host computer and replicating the drawn image to other computers|
|US5655152 *||9 Dec 1993||5 Aug 1997||Matsushita Electric Industrial Co.||System for allocating data output requests to output units having different output formats in accordance with data output format compatibility and priority characteristic|
|US5673371 *||19 Mar 1996||30 Sep 1997||Oce-Nederland B.V.||Method of modifying the fatness of characters to be output on a raster output device|
|US5699524 *||17 Mar 1995||16 Dec 1997||Fujitsu Limited||System for transferring character information between two processing systems having different coding schemes by building a conversion table of corresponding character code addresses|
|US5717856 *||2 Dec 1996||10 Feb 1998||Ncr Corporation||Method of operating multiple computers by identical software running on every computer with the exception of the host computer which runs shared program in addition|
|US5727155||29 Jan 1997||10 Mar 1998||Intel Corporation||Method and apparatus for dynamically controlling a remote system's access to shared applications on a host system|
|US5754873 *||1 Jun 1995||19 May 1998||Adobe Systems, Inc.||Method and apparatus for scaling a selected block of text to a preferred absolute text height and scaling the remainder of the text proportionately|
|US5758110 *||30 Apr 1997||26 May 1998||Intel Corporation||Apparatus and method for application sharing in a graphic user interface|
|US5760769 *||22 Dec 1995||2 Jun 1998||Intel Corporation||Apparatus and method for identifying a shared application program in a computer during teleconferencing|
|US5781732 *||20 Jun 1996||14 Jul 1998||Object Technology Licensing Corp.||Framework for constructing shared documents that can be collaboratively accessed by multiple users|
|US5815151||2 Jan 1997||29 Sep 1998||International Business Machines Corp.||Graphical user interface|
|US5826051||27 Dec 1995||20 Oct 1998||Intel Corporation||Method and apparatus for simplifying active window selection, application activation, and shared command execution in a multi-application environment|
|US5831872 *||27 Jun 1995||3 Nov 1998||Motorola, Inc.||Method and system for compressing a video signal using dynamic frame recovery|
|US5835713 *||19 Mar 1993||10 Nov 1998||Ncr Corporation||Remote collaboration system for selectively locking the display at remote computers to prevent annotation of the display by users of the remote computers|
|US5841420||18 Aug 1995||24 Nov 1998||International Business Machines Corporation||Method and system in a data processing system windowing environment for displaying previously obscured information|
|US5847706 *||30 Nov 1995||8 Dec 1998||Hewlett Packard Company||Sizeable window for tabular and graphical representation of data|
|US5864711 *||5 Jul 1995||26 Jan 1999||Microsoft Corporation||System for determining more accurate translation between first and second translator, and providing translated data to second computer if first translator is more accurate|
|US5874960 *||5 Jul 1995||23 Feb 1999||Microsoft Corporation||Method and system for sharing applications between computer systems|
|US5933597||4 Apr 1996||3 Aug 1999||Vtel Corporation||Method and system for sharing objects between local and remote terminals|
|US5938724 *||2 Apr 1997||17 Aug 1999||Ncr Corporation||Remote collaboration system that stores annotations to the image at a separate location from the image|
|US5949435 *||10 Jun 1997||7 Sep 1999||Adobe Systems Incorporated||Digital type font providing typographic feature transformation capability|
|US5986655 *||28 Oct 1997||16 Nov 1999||Xerox Corporation||Method and system for indexing and controlling the playback of multimedia documents|
|US5995096||18 Dec 1997||30 Nov 1999||Hitachi, Ltd.||Conference display control method and apparatus for an electronic conference for displaying either shared or local data and transferring local data|
|US6008804 *||2 Apr 1997||28 Dec 1999||Ncr Corporation||Remote collaboration system with selective annotation|
|US6025871||31 Dec 1998||15 Feb 2000||Intel Corporation||User interface for a video conferencing system|
|US6057835 *||23 Sep 1997||2 May 2000||Canon Kabushiki Kaisha||Window management system with recording status display|
|US6167433||31 Jul 1998||26 Dec 2000||Muse Technologies, Inc.||Shared multi-user interface for multi-dimensional synthetic environments|
|US6212547 *||5 May 1998||3 Apr 2001||Collaboration Properties, Inc.||UTP based video and data conferencing|
|US6216177 *||1 Jul 1998||10 Apr 2001||Microsoft Corporation||Method for transmitting text data for shared application between first and second computer asynchronously upon initiation of a session without solicitation from first computer|
|US6219044 *||13 Feb 1995||17 Apr 2001||International Business Machines Corporation||Method for managing top-level windows within a conferencing network system|
|US6230171 *||29 Aug 1998||8 May 2001||International Business Machines Corporation||Markup system for shared HTML documents|
|US6271839||2 Jul 1998||7 Aug 2001||Microsoft Corporation||Method and system for sharing applications between computer systems|
|US6275223||8 Jul 1998||14 Aug 2001||Nortel Networks Limited||Interactive on line code inspection process and tool|
|US6285363 *||10 Aug 1998||4 Sep 2001||Microsoft Corporation||Method and system for sharing applications between computer systems|
|US6292166||24 Oct 1997||18 Sep 2001||Compaq Computer Corporation||System and method for sharing diverse display types in a bit map sharing collaborative tool|
|US6304928 *||1 Jul 1998||16 Oct 2001||Microsoft Corporation||Compressing/decompressing bitmap by performing exclusive- or operation setting differential encoding of first and previous row therewith outputting run-length encoding of row|
|US6308199||7 Aug 1998||23 Oct 2001||Fuji Xerox Co., Ltd.||Cooperative work support system for managing a window display|
|US6317777 *||26 Apr 1999||13 Nov 2001||Intel Corporation||Method for web based storage and retrieval of documents|
|US6329984||26 Nov 1997||11 Dec 2001||Intel Corporation||User input routing with remote control application sharing|
|US6342906 *||2 Feb 1999||29 Jan 2002||International Business Machines Corporation||Annotation layer for synchronous collaboration|
|US6343313 *||25 Mar 1997||29 Jan 2002||Pixion, Inc.||Computer conferencing system with real-time multipoint, multi-speed, multi-stream scalability|
|US6343316||10 Feb 1999||29 Jan 2002||Nec Corporation||Cooperative work support system|
|US6456305||18 Mar 1999||24 Sep 2002||Microsoft Corporation||Method and system for automatically fitting a graphical display of objects to the dimensions of a display window|
|US6460126||13 Nov 1998||1 Oct 2002||Networks Associates Technology, Inc.||Computer resource management system|
|US6564246||2 Feb 1999||13 May 2003||International Business Machines Corporation||Shared and independent views of shared workspace for real-time collaboration|
|US6570590 *||6 Oct 1999||27 May 2003||Microsoft Corporation||Application sharing in a frame|
|US6577330||10 Aug 1998||10 Jun 2003||Matsushita Electric Industrial Co., Ltd.||Window display device with a three-dimensional orientation of windows|
|US6584493||14 Sep 1999||24 Jun 2003||Microsoft Corporation||Multiparty conferencing and collaboration system utilizing a per-host model command, control and communication structure|
|US6601087||17 Nov 1999||29 Jul 2003||Webex Communications, Inc.||Instant document sharing|
|US6654032||23 Dec 1999||25 Nov 2003||Webex Communications, Inc.||Instant sharing of documents on a remote server|
|US6687878||15 Mar 1999||3 Feb 2004||Real Time Image Ltd.||Synchronizing/updating local client notes with annotations previously made by other clients in a notes database|
|US6697846||20 Mar 1998||24 Feb 2004||Dataplow, Inc.||Shared file system|
|US6760048||15 Jun 1999||6 Jul 2004||International Business Machines Corporation||Display of occluded display elements on a computer display|
|US6823514||14 Nov 2000||23 Nov 2004||International Business Machines Corporation||Method and system for caching across multiple contexts|
|US6825860||29 Sep 2000||30 Nov 2004||Rockwell Automation Technologies, Inc.||Autoscaling/autosizing user interface window|
|US6826595||5 Jul 2000||30 Nov 2004||Sap Portals Israel, Ltd.||Internet collaboration system and method|
|US6833844 *||13 Dec 1999||21 Dec 2004||Kabushiki Kaisha Toshiba||System display apparatus and storing medium|
|US6859928||5 Mar 2001||22 Feb 2005||Trepton Research, Inc.||Shared virtual desktop collaborative application system|
|US6910188||27 Jun 2001||21 Jun 2005||International Business Machines Corporation||Viewing changes to a shared document in one object|
|US6911987 *||8 May 2000||28 Jun 2005||Microsoft Corporation||Method and system for transmitting data for a shared application|
|US6925645||29 Dec 2000||2 Aug 2005||Webex Communications, Inc.||Fault tolerant server architecture for collaborative computing|
|US6973627||22 Dec 2000||6 Dec 2005||Automated Logic Corporation||Website display emulating a display of an application program|
|US6982729||19 Apr 2000||3 Jan 2006||Hewlett-Packard Development Company, Lp.||Constant size image display independent of screen resolution|
|US7003728||3 Jul 2001||21 Feb 2006||David Berque||System for knowledge transfer in a group setting|
|US7028266||5 Apr 2002||11 Apr 2006||Microsoft Corporation||Processing occluded windows during application sharing|
|US7046253||24 Jun 2002||16 May 2006||Canon Kabushiki Kaisha||Processing graphic objects for fast rasterised rendering|
|US7088871||3 Jun 2004||8 Aug 2006||Microsoft Corporation||Method and system for transmitting data for a shared application|
|US7127460||16 Aug 2002||24 Oct 2006||Fisher-Rosemount Systems, Inc.||Accessing and updating a configuration database from distributed physical locations within a process control system|
|US7293243||22 May 2002||6 Nov 2007||Microsoft Corporation||Application sharing viewer presentation|
|US7356563||6 Jun 2002||8 Apr 2008||Microsoft Corporation||Methods of annotating a collaborative application display|
|US7404014||3 Jun 2004||22 Jul 2008||Microsoft Corporation||Method and system for transmitting and determining the effects of display orders from shared application between a host and shadow computer|
|US7414638||22 Jul 2005||19 Aug 2008||Microsoft Corporation||Application sharing user interface improvements|
|US7418664||3 Apr 2002||26 Aug 2008||Microsoft Corporation||Application sharing single document sharing|
|US7451181||15 Apr 2003||11 Nov 2008||Fujitsu Limited||Apparatus for controlling a shared screen|
|US7487457||30 Jan 2006||3 Feb 2009||Microsoft Corporation||Application sharing single document sharing|
|US7530022||30 Jan 2006||5 May 2009||Microsoft Corporation||Application sharing single document sharing|
|US7595798||22 Jul 2005||29 Sep 2009||Microsoft Corporation||Application sharing user interface improvements|
|US7721223||11 Apr 2006||18 May 2010||Microsoft Corporation||Application sharing user interface improvements|
|US20010000811 *||21 Dec 2000||3 May 2001||May Phillip J.||Method and system for managing data while sharing application programs|
|US20010004746||5 Mar 2001||21 Jun 2001||Wright Daniel W.||Shared virtual desktop collaborative application system|
|US20020010713||13 Feb 2001||24 Jan 2002||Egilsson Agust Sverrir||Graphical environment for managing and developing applications|
|US20020026323 *||10 Aug 2001||28 Feb 2002||International Business Machines Corporation||Method and system for annotating a window shared by remote hosts|
|US20020065919||30 Nov 2000||30 May 2002||Taylor Ian Lance||Peer-to-peer caching network for user data|
|US20020075304 *||18 Dec 2000||20 Jun 2002||Nortel Networks Limited||Method and system for supporting communications within a virtual team environment|
|US20020078088||19 Dec 2000||20 Jun 2002||Xerox Corporation||Method and apparatus for collaborative annotation of a document|
|US20020095399 *||4 May 2001||18 Jul 2002||Devine Robert L.S.||System and methods providing automatic distributed data retrieval, analysis and reporting services|
|US20020174181 *||13 Apr 2001||21 Nov 2002||Songxiang Wei||Sharing OpenGL applications using application based screen sampling|
|US20020184310 *||22 Jan 2002||5 Dec 2002||Traversat Bernard A.||Providing peer groups in a peer-to-peer environment|
|US20030028610 *||3 Aug 2001||6 Feb 2003||Pearson Christopher Joel||Peer-to-peer file sharing system and method using user datagram protocol|
|US20030085922 *||13 Apr 2001||8 May 2003||Songxiang Wei||Sharing DirectDraw applications using application based screen sampling|
|US20030103088 *||6 Nov 2002||5 Jun 2003||Universal Electronics Inc.||User interface for a remote control application|
|US20030137522||14 Mar 2003||24 Jul 2003||Kaasila Sampo J.||Innovations for the display of web pages|
|US20030167339 *||29 Dec 2000||4 Sep 2003||Min Zhu||Distributed application sharing|
|US20030189599 *||5 Apr 2002||9 Oct 2003||Microsoft Corporation||Application sharing user interface improvements|
|US20030189601 *||3 Apr 2002||9 Oct 2003||Microsoft Corporation||Application sharing single document sharing|
|US20040024819 *||15 Apr 2003||5 Feb 2004||Fujitsu Limited||Apparatus for controlling a shared screen|
|US20040066408||27 Jun 2003||8 Apr 2004||Microsoft Corporation||Intelligent windows bumping method and system|
|US20050024389 *||3 Jun 2004||3 Feb 2005||Microsoft Corporation||Method and system for transmitting data for a shared application|
|US20050027896 *||3 Jun 2004||3 Feb 2005||Microsoft Corporation||Method and system for transmitting data for a shared application|
|US20050033817 *||8 Sep 2004||10 Feb 2005||Songxiang Wei||Sharing OpenGL applications using application based screen sampling|
|US20050055306 *||20 Oct 2004||10 Mar 2005||Science Applications International Corporation||User-defined dynamic collaborative environments|
|US20050216847 *||28 Jan 2005||29 Sep 2005||Min Zhu||Distributed document sharing|
|US20060136366||30 Jan 2006||22 Jun 2006||Microsoft Corporation||Application sharing single document sharing|
|US20060136837||30 Jan 2006||22 Jun 2006||Microsoft Corporation||Application sharing single document sharing|
|US20060190839||11 Apr 2006||24 Aug 2006||Microsoft Corporation||Application sharing user interface improvements|
|US20060288389||28 Aug 2006||21 Dec 2006||Microsoft Corporation||Interactive presentation viewing system employing multi-media components|
|US20080183817 *||4 Sep 2007||31 Jul 2008||Microsoft Corporation||Application sharing security|
|USRE33894 *||21 Aug 1989||21 Apr 1992||International Business Machines Corporation||Apparatus and method for reading and writing text characters in a graphics display|
|WO1999026153A2||18 Nov 1998||27 May 1999||Stellar Computing||Method for establishing a communication connection between two or more users via a network of interconnected computers|
|1||"A Primer on the T.120 Series Standard," DataBeam Corporation, pp. 1-13, 1995.|
|2||Gutekunst, Thomas et al., "A Distributed and Policy-Free General-Purpose Shared Window System," Oct. 6, 1994, Feb. 1995 IEEE/ACM Transactions on Networking, 13 pages.|
|3||Hao, Ming, C. et al., "Collaborative Computing: A Multi-Client Multi-Server Environment," Hewlett-Packard Laboratories, ACM, Inc. 1995, pp. 206-213.|
|5||*||IBM, IBM Technical Disclosure Bulletin Automatic Window Management Mode, vol. 35 No. 4B Sep. 1992.|
|6||Intel Corporation, "Intel ProShare Personal Conferencing Software, Getting Started Guide," Intel Corporation, 1994, pp. 25-31.|
|7||Schroeder, Erica, "PictureTel Plans Low-Cost Video App Sharing," PC Week, vol. 11, No. 25, Jun. 27, 1994, pp. 1 & 171.|
|8||Schroeder, Erica, "Videoconferencing-Creative brings Mac package to Windows," Networking, PC Week, vol. 11, No. 25, Jun. 27, 1994, pp. 83 & 88.|
|9||Schroeder, Erica, "Videoconferencing—Creative brings Mac package to Windows," Networking, PC Week, vol. 11, No. 25, Jun. 27, 1994, pp. 83 & 88.|
|10||Screen Dumps of Microsoft Word 2000, Jun. 10, 1999 (8 pages).|
|11||*||U.S. Appl. No. 10/127,951, filed Apr. 23, 2002, Schmieder et al.|
|12||*||U.S. Appl. No. 10/164,686, filed Jun. 6, 2002, Leichtling et al.|
|13||*||U.S. Appl. No. 10/859,640, filed Jun. 3, 2004, Mairs et al.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US8413074 *||12 Feb 2010||2 Apr 2013||Oracle America, Inc.||Mechanism for collaboratively exchanging navigation information in a distributed document review|
|US8627217 *||15 Apr 2005||7 Jan 2014||Yanase Takatoshi||Window display system, window display method, program development support device, and server device|
|US8756513||23 Apr 2002||17 Jun 2014||Microsoft Corporation||Document viewing mechanism for document sharing environment|
|US8843848 *||26 Aug 2010||23 Sep 2014||Canon Kabushiki Kaisha||Information processing system, information processing apparatus, terminal device, and control methods thereof|
|US8887059 *||27 Jul 2011||11 Nov 2014||Kaseya Limited||Method and apparatus of locally controlling display content of a remote system|
|US9143881 *||25 Oct 2010||22 Sep 2015||At&T Intellectual Property I, L.P.||Providing interactive services to enhance information presentation experiences using wireless technologies|
|US9235452 *||5 Feb 2010||12 Jan 2016||Microsoft Technology Licensing, Llc||Graphics remoting using augmentation data|
|US9269072 *||23 Dec 2010||23 Feb 2016||Citrix Systems, Inc.||Systems, methods, and devices for facilitating navigation of previously presented screen data in an ongoing online meeting|
|US9658836||2 Jul 2015||23 May 2017||Microsoft Technology Licensing, Llc||Automated generation of transformation chain compatible class|
|US9712472||2 Jul 2015||18 Jul 2017||Microsoft Technology Licensing, Llc||Application spawning responsive to communication|
|US9733915||2 Jul 2015||15 Aug 2017||Microsoft Technology Licensing, Llc||Building of compound application chain applications|
|US9733993||2 Jul 2015||15 Aug 2017||Microsoft Technology Licensing, Llc||Application sharing using endpoint interface entities|
|US9785484||2 Jul 2015||10 Oct 2017||Microsoft Technology Licensing, Llc||Distributed application interfacing across different hardware|
|US20060259552 *||17 Apr 2006||16 Nov 2006||Mock Wayne E||Live video icons for signal selection in a videoconferencing system|
|US20080126955 *||15 Apr 2005||29 May 2008||Yanase Takatoshi||Window Display System, Window Display Method, Program Development Support Device, and Server Device|
|US20090096810 *||11 Oct 2007||16 Apr 2009||Green Brian D||Method for selectively remoting windows|
|US20100146403 *||12 Feb 2010||10 Jun 2010||Sun Microsystems, Inc.||Mechanism for collaboratively exchanging navigation information in a distributed document review|
|US20110083102 *||26 Aug 2010||7 Apr 2011||Canon Kabushiki Kaisha||Information processing system, information processing apparatus, terminal device, and control methods thereof|
|US20110197151 *||5 Feb 2010||11 Aug 2011||Microsoft Corporation||Graphics remoting using augmentation data|
|US20120166952 *||23 Dec 2010||28 Jun 2012||Albert Alexandrov||Systems, methods, and devices for facilitating navigation of previously presented screen data in an ongoing online meeting|
|US20130031481 *||27 Jul 2011||31 Jan 2013||Kaseya International Limited||Method and apparatus of locally controlling display content of a remote system|
|U.S. Classification||715/781, 715/800, 715/803, 715/751|
|Cooperative Classification||G06F3/1454, G09G2340/0407, G06F9/4443, G09G5/14, G09G5/34|
|European Classification||G09G5/14, G06F3/14T, G06F9/44W|
|9 Dec 2014||AS||Assignment|
Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034542/0001
Effective date: 20141014
|26 May 2015||FPAY||Fee payment|
Year of fee payment: 4