US20100321382A1 - System and method for injection of mapping functions - Google Patents
System and method for injection of mapping functions Download PDFInfo
- Publication number
- US20100321382A1 US20100321382A1 US12/818,102 US81810210A US2010321382A1 US 20100321382 A1 US20100321382 A1 US 20100321382A1 US 81810210 A US81810210 A US 81810210A US 2010321382 A1 US2010321382 A1 US 2010321382A1
- Authority
- US
- United States
- Prior art keywords
- digital image
- computer
- mapping function
- display
- computer code
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/3147—Multi-projection systems
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
- G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3138—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM] using arrays of modulated light sources
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Computer Graphics (AREA)
- Controls And Circuits For Display Device (AREA)
- Transforming Electric Information Into Light Information (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Liquid Crystal Display Device Control (AREA)
- Image Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
A method and system for improving display quality by injecting a portion of computer code into an existing compositor, using the portion of computer code to apply a mapping function to a first digital image, and forming a second digital image based upon the first digital image as adapted by applying the applied mapping function in the compositor. The second digital image may then be displayed to a viewer via one or more displays where each display forms a part of the displayed digital image. The result may be used for creation of blended or stereoscopic images. The mapping function may be also adapted for modification of geometry or correction of a characteristic (such as color, intensity, etc.) of the display system where such characteristic may be sensed using a detector. The portion of code may be injected into a graphics driver controlling hardware composition for a displayed digital image.
Description
- This application claims the benefit of U.S. Provisional Application Ser. No. 61/218,397, filed Jun. 18, 2009, entitled SYSTEM AND METHOD FOR INJECTION OF MAPPING FUNCTIONS, the entire disclosure of which is herein incorporated by reference.
- This invention relates to digital video display systems, and more particularly to operating systems for large-scale displays composed of a plurality of individual display devices.
- Digital imaging systems display visual information utilizing a control source and a display. The control source, such as a computer system, may utilize mapping functions to enable applications such as combining multiple projected images into one image to make a super resolution display. Displays include any devices that are capable of visually showing information, still pictures, or video (moving pictures). A display generally consists of one of more light sources, and a method of spatially modulating the light can be divided into (1) direct view displays, and (2) projection displays. Direct view displays include flat panels such as liquid crystal displays (LCDs) and plasma display panels (PDPs). Projection displays include technologies that use microdisplay panels such as (1) digital light processing (DLP) which are based on digital micromirror devices (DMDs), (2) transmissive LCD panels, and (3) liquid crystal on silicon (LCOS). The quality of a digital imaging system is determined by the expectations of the viewer. Quality factors include resolution, contrast, geometric accuracy, color accuracy, freedom from distracting artifacts and other performance properties which contribute to the generally pleasing nature of the image or allow the displayed digital image to accurately represent the original digital image or an image found in nature. It is desired to correct for certain inaccuracies in the image produced by a display by applying corrective measures to image information.
- Three-dimensional imaging may refer to an image in the plane of the display that is rendered to appear with perspective. Three-dimensional imaging is also used to refer to stereoscopic digital imaging where the image comes out of the plane of the display to fill three-dimensional space. Stereoscopic digital imaging presents a different image to the left eye and the right eye in order to simulate the effect of viewing natural images in three-dimensional space. Stereoscopic imaging may contribute to the perceived quality of digital imaging systems if the three-dimensional images are properly presented to each eye without causing eyestrain. It is generally desired to provide a mechanism to support such image creation within a display system and improve overall display quality.
- The present invention is a method and system for improving display quality by injecting a portion of computer code into an existing compositor operatively arranged and configured on a computing system, using the portion of computer code to apply a mapping function to a first digital image, and forming a second digital image based upon the first digital image as adapted by applying the applied mapping function. The second digital image is then displayed to a viewer via one or more displays wherein each display forms a part of the displayed digital image. The contribution of each display can be such that there is varying overlap, from partial overlap to substantially complete overlap. Substantially complete overlap enables the display of stereoscopic images. The mapping function can be used for modification of geometry, creation of blended images or correction of a characteristic (such as color, intensity, etc.) of the display system. The characteristic can be sensed using a detector such as a camera directed at the displayed image, or by internal sensing of the image. The portion of code can be injected into a graphics driver controlling hardware generating a portion of a displayed digital image. The overall display system may be based upon one or more computer systems each with one or more graphics cards connected to one or more display devices such projector.
- The invention description below refers to the accompanying drawings, of which:
-
FIG. 1 is a schematic view of a digital imaging system with external mapping according to an exemplary implementation; -
FIG. 2 is a flowchart of mapping function injection according to an illustrative embodiment; -
FIG. 3 is a schematic view of a digital imaging system with injection into a compositor according to an illustrative embodiment; and -
FIG. 4 is a schematic view of a digital imaging system with injection into a graphics driver according to an illustrative embodiment. - A detailed description of super resolution displays, in which the teachings of illustrative embodiments here can be based, may be found in U.S. Pat. No. 6,456,339, the teachings of which are entirely incorporated herein by reference as useful background information. Digital imaging systems may achieve high-resolution displays by combining more than one display such that the displays add their pixels together into one displayed digital image composed of multiple parts. Each part of the displayed digital image is composed primarily of pixels from an individual projector, but also has overlap regions from the adjacent displays. The parts of the displayed digital image are partially overlapping in order to perform gradual blending between the parts. The partial overlap regions can extend over approximately 10% to 30% of the area of the displayed digital image. A mapping function can be applied to the original digital image to split it into parts and to reassemble the parts for display. The mapping function is defined as a mathematical transformation which modifies a digital image to produce a second digital image which is changed in some way. A correction function is a specific type of mapping function which applies a desired correction to a digital image. The mapping function can include such transformations as warping, color matching, lateral color correction, or any other desired changes to the digital image. In some cases, the mapping function may degrade the image quality as measured in the traditional sense in order to achieve a specific desired effect.
- An alternate embodiment of the system configuration makes use of substantially complete overlap of digital images from multiple displays (the displays often being arranged as a “multiplicity” of two or more, and at least a “plurality” of two or more in various embodiments). Substantially complete overlap is overlap of at least 90%. In one embodiment, the substantially complete overlap is aligned so that the parts from multiple displays are exactly aligned with accuracy down to the pixel or sub-pixel level. This configuration can be used to increase the amount of light by stacking multiple displays. In another embodiment, the system provides substantially complete overlap, but the parts consist of left eye and right eye images to enable stereoscopic display of three-dimensional images. Exact pixel alignment may not necessary in the case of stereoscopic projection.
- A special case of stacking occurs when there is only a single projector. In this case, a lens can be used to wrap the image in such as way that one side wraps to meet the other side of the image.
- Another alternate embodiment of the system configuration makes use of digital images that do not overlap. In this case, the parts may be joined at the edges or may have a gap region between the edges. In the case of gap between the edges, the image can be shifted so that important features of the displayed digital image do not fall in the gap region.
- Another alternate embodiment of the system configuration employs a third and fourth display that partially overlaps when the first and second display have substantially complete overlap as a stereoscopic image.
- Reference is now made to
FIG. 1 , which shows a digital imaging system with external mapping generally by way of background. In this implementation the mapping function is created by hardware and software that is external to the computer. A digital image is created byapplication software 110 and sent tocompositor software 104. The digital image can be created from various sources, such as being stored on the computer hardware memory, or can be generated based on a predetermined algorithm.Compositor software 104 is part ofoperating system software 102 which runs oncomputer hardware 100.Compositor software 104 sends the digital image tographics driver software 130 which runs ongraphics hardware 106.Graphics driver software 130 divides the digital image into multiple parts and sends the parts toprojectors - Illustratively, the
compositor 104 is the part of thecomputer operating system 102 that arranges various parts of the digital image that will be shown by the computer. In conventional computer operation, the compositor combines the windows displayed from various applications and the operating system. It also handles translucency of windows in certain operating systems, such as Microsoft's Windows Vista® operating system, which include a translucency capability. - The digital image can comprise a still image or a series of still images that make a moving image (also called video). The digital image may be generated in the computer or it may be generated externally from the computer. The digital image may be captured by the computer with an image capture card in the computer.
-
Projectors light beams digital image 150 onscreen 126.Sensor 112 senses the parameters of projecteddigital image 150 and sends the parameters tomapping software 160 which runs onmapping hardware 108.Mapping software 160 uses a mapping function to calculate mapping signals and sends the mapping signals toprojectors Projectors graphics driver 130.Mapping hardware 108 can be computer hardware, such as a computer card that runs on a conventional computer, ormapping hardware 108 can be specialized hardware that is custom designed to perform mapping calculations. In an embodiment wheremapping hardware 108 is computer hardware, it can comprise a card that is installed intocomputer 100, or it can be installed into a separate computer dedicated to performing the mapping calculations. In another embodiment wheremapping hardware 108 is a computer hardware, it can comprise a processing unit and a digital communication link configured to receive an image data stream from a sensor. The compositor software is shown as being part of the operating system inFIG. 1 , but in some systems, the compositor can reside outside of the operating system. The mapping hardware and software is shown as residing outside of the computer hardware inFIG. 1 , but in some systems, the mapping hardware and software can be part of the computer hardware. -
FIG. 2 shows aprocedure 200 for performing mapping function injection. The mapping function is injected into the computer that is displaying the digital image. Instep 202, a digital image is created. This can occur by any appropriate mechanism, such as retrieving pixel information from a media data file in a predetermined format such as MPEG, AVI, etc. The procedure of decompression, scaling, or formatting is further contemplated as part of retrieving the pixel information. Indecision step 204, a decision is made depending on the whether the digital image will be projected as a full-screen image. The full-screen image can be determined by any appropriate mechanisms depending on the configuration of the digital imaging system, such as through a user interface, through a user API, from a stored memory located internal to, or external of, the computer hardware, and should be apparent to those skilled in the art to be incorporated therein. If it will be a full-screen image, a portion of computer code with the mapping function is injected into the compositor or graphics driver instep 206. The compositor consists of compositing software and the graphics driver consists of graphics driver software. If the digital image will not be projected as a full-screen image, the digital image with mapping function is injected into the appropriate application instep 208. Instep 210, the projected digital image is formed from the digital image with mapping function. Inoptional step 212, the parameters of the projected digital image are sensed and a signal based on those parameters is sent back to the portion of computer code with the mapping function instep -
FIG. 3 shows a digital imaging system with injection into a compositor. The digital imaging system shown inFIG. 3 uses theprocedure 200 of mapping function injection that is shown inFIG. 2 . A digital image is created byapplication software 310 and sent tocompositor software 304.Mapping software 308 acts internally (within the computer) to inject a portion of computer code intocompositor software 304. The injection step is shown byarrows 340.Mapping software 308 intercepts the flow of execution ofcompositor software 304 using conventional techniques described below, redirects the execution to apply the mapping function, and then returns operation tocompositor software 304.Compositor software 304 is part ofoperating system software 302 which runs oncomputer hardware 300.Compositor software 304 sends the digital image with mapping function tographics driver software 330 which runs ongraphics hardware 306.Graphics driver software 330 divides the digital image into multiple parts and sends the parts toprojectors Projectors light beams digital image 350 onscreen 326.Sensor 312 senses the parameters of projecteddigital image 350 and sends the parameters tomapping software 308 as represented by the return arrow from thesensor 312. The parameters are organized in a manner that the mapping software can employ them to modify its data, and thereby provide the compositor with the updated mapping function. - More particularly, in an illustrative embodiment, the interface to software such as a driver or operating system is accomplished via an application programming interface (API) 360, 362, or equivalent mechanism know to those ordinarily skilled in software development.
APIs 360, 362 can respectively reside within thecompositor software 304, thegraphics driver software 330 and/or within another application as appropriate. The API provides a communications mechanism between software modules (where such modules can be developed by different sources or entities at different time) in order to support the building of applications. Illustratively, calls through the API by another program or process cause the execution of code that depends upon the information in the call. It is contemplated to modify a stream of execution by intercepting calls to the API, inserting replacement and/or different code to execute, and then either (a) continuing the call as normal or (b) returning to the caller. This is typically accomplished by modifying the existing API interface by copying one or more of the existing API pointers to the existing application code and replacing them with new pointers (depicted in API blocks 360, 362) pointing to new code for execution. That new code can then either (a) return to the code that called the API, or (b) continue the call through the old code via the copied API pointers which then return as needed. In an illustrative embodiment, thegraphics driver 330 provides anAPI 362 that allows programs (for example the operating system 302) to make calls that cause code at the in thegraphics driver 330 to be executed (for instance, to paint a pattern at a particular location). The present invention can intercept the API calls to thegraphics driver 330 by copying the original API pointer and inserting a new pointer to point to the mapping code (308). Thus, during execution, if a particular API call is made, the mapping code can modify the data in the API call and then pass the stream of code execution to the pre-existing API code via the copied API pointer. - By way of operational example, if data is initially formatted for display on a certain type/model of display, such as a flat screen, then the mapping code can be adapted to intercept the data at the graphics driver level so as to modify for display on a different type/model of display, such as a screen with a different geometry. The mapping code can then be passed along for display via the original graphics driver. While not shown, the depicted API and pointer arrangement, or an appropriate variation thereof, is applicable to the embodiments of
FIG. 1 andFIG. 4 . -
FIG. 4 shows a digital imaging system with injection into a graphics driver that can be conventional or custom-designed. The digital imaging system shown inFIG. 4 uses theprocedure 200 for mapping function injection that is shown inFIG. 2 . A digital image is created byapplication software 410 and sent tocompositor software 404.Compositor software 404 is part ofoperating system software 402 which runs oncomputer hardware 400.Compositor software 404 sends the digital image tographics driver software 430 which runs ongraphics hardware 406.Mapping software 408 injects a portion of computer code intographics driver software 430. The injection step is shown byarrows 440.Mapping software 408 intercepts the flow of execution ofgraphics driver software 430, redirects the execution to apply the mapping function, and then returns operation tographics driver software 430.Graphics driver software 430 divides the digital image into multiple parts and sends the parts toprojectors Projectors light beams digital image 450 onscreen 426.Sensor 412 senses the parameters of projecteddigital image 450 and sends the parameters tomapping software 408. - In the arrangements of
FIGS. 1 , 3, and 4, projectors are shown as the display devices. In alternate embodiments, projectors can be substituted with other display devices that form a displayed image other than a projected image. For example, such other display devices can comprise direct-view displays such as flat-panel liquid crystal displays or plasma display panels. - Projectors can be embedded in a variety of electronic devices such as cell phones, handheld game systems, laptop computers and/or other personal electronic devices. In an illustrative implementation personal electronic device with a single projector can employ a mapping function in accordance with the embodiments herein for such purposes as warping menus or combining images with other personal electronic devices.
- Also, in the exemplary arrangements of
FIGS. 1 , 3, and 4, three projectors are shown, but there may one, two, three, or more projectors depending on the desired resolution, brightness, and other parameters of the projected digital image. The digital image may alternately be created by a source external to the computer and sent into the application software or directly into the compositor. - It should be apparent that one advantage of injection-based digital imaging systems such as those shown in
FIGS. 3 and 4 is that they are typically free of any separate mapping hardware and software in contrast to the illustrative digital imaging system shown inFIG. 1 . The injection process allows the digital imaging system to be inexpensive, simple, and compact compared to the digital imaging system without injection. - Another advantage of injection-based digital imaging systems is that they may be used with conventional off-the-shelf (COTS) projectors and COTS graphics cards. The digital imaging system shown in
FIG. 1 requires specialized projectors that have the capability to accept mapping signals from the mapping software. The specialized projectors are generally used with specialized warping hardware. COTS projectors and graphics cards are inexpensive, commonly available, and more readily interchangeable between projectors and computers of different models or types. Interchangeability can enable improved optimization of the projectors and graphics cards for the projection environment and easy replacement in case of malfunction. - Yet another advantage of injection-based digital imaging systems is that they can make use of the inherent hardware acceleration in various commercially available computer graphics hardware. A system with separate hardware and software for mapping would generally be unable to utilize this hardware acceleration.
- Illustratively, the use of mapping functions can be divided into two types: (1) application-dependent and (2) application-independent. Injection enables application-independent mapping with COTS graphics cards without the need for specialized hardware.
- Some further considerations with respect to the mapping functions and alternate embodiments of the system and method are now described.
- In an illustrative embodiment, the calculation of the mapping function generally includes sampling pixels in the digital image, calculating a new position for each pixel, and then assembling a mapped digital image with the pixels in the new position, also called re-sampling. The mapping function can also include other transformations of the pixels such as intensity or color changes. Intensity mapping of pixels is also referred to as shading. Interpolation between pixels is desired during the re-sampling. The interpolation can be performed using closest neighbor, linear, or nonlinear calculations according to conventional algorithms thereof. It is contemplated that a spatially varying filter can be included in the mapping function in order to change white level (contrast), black level (brightness), or other image parameters dependent on the spatial position and content in the digital image. The spatially varying filter can be used to control blooming or other secondary effects introduced by the display.
- A variety of mapping functions can be performed depending on the requirements of the digital imaging system. The mapping functions can include warping, blending, and color matching. Warping is used, for example, to compensate for different angles of projection from multiple projectors, or to make digital images fit onto curved screens so that minimal distortion is apparent when viewing the projected digital image. Twisting and zooming may be considered two types of warping used to align multiple parts of an image to fit together when forming one projected digital image from multiple parts. Blending makes the edges of the multiple parts fit together when forming one projected digital image from multiple parts. Color matching is used to make multiple parts of the projected digital image match each other so that they appear to come from one projector. Color matching is particularly desirable when multiple projectors exhibit differing color output. The least expensive COTS projectors frequently benefit from color matching because loose manufacturing tolerances can result in large color differences between projectors of the same model. The mapping functions allow multiple projectors to be placed in position with only approximate alignment. The mapping function is then calculated to stitch together the parts of the image in order to form one digital projected image out of the multiple parts projected by each projector.
- The mapping function can be a fixed transformation or it may be a temporally-varying transformation. In the temporally-varying case, the transformation may be calculated from sensor feedback or it may be calculated based on other external parameters. The calculation may take place in real time or in near real time.
- The mapping function can be entirely determined by computer calculation (automatically), or it can be partially or completely supplied by user input (manually). By way of example, the user may wish to directly control the position of certain elements in the digital image with means to manipulate the image directly such as a computer mouse or other user input device.
- Injection-based digital imaging systems can also be used to provide visual information such as messages to viewers. The visual information may consist of elements generated by the digital imaging system, such as menu information, device control information, notifications, or system status information. Visual information may further be created by other software operatively running on the computer hardware system, such as, but not limited to, presentation application, gaming applications, or various application GUI widgets. The visual information may further consist of content external to the digital imaging system that is operatively communicated to the digital imaging system through a communication or network link. By way of example, external content information can be communicated from a server housing a database of information, or a server hosting website information. The information can be in the form of video, image, or other data forms. By way of further example, the communication system employed can be, but not limited to, digital system such as, Wi-fi, Wimax, cellular system, and other various digital communication system. The communication system can further be configured to receive analog signal from cable operator, from analog antennae, etc. Video content can further be streamed using conventional mechanisms apparent to those skilled in the art. The information contained in the message may be inserted by the application software or at any other point in the software chain prior to and including the point of injection. The visual information may allow the user to control parameters of the projected digital image or the equipment used for projection. These parameters may include the color of the white point or other image characteristics. A graphical user interface associated with, for example the above-described computer and operating system can be utilized for toggling the injection on and off.
- The injection can be toggled on or off automatically under software control. For example, if an application circumvents the compositor, the injection may be turned off to prevent unwanted changes to the image. Alternately, the injection can add a portion of computer code to an application rather than the compositor.
- In an embodiment, the portion of computer code injected into the compositor can be constructed and arranged to communicate with another portion of mapping software which is located outside of the computer, such as in external mapping hardware.
- The operating system can also be adapted to accept the injection of the portion of computer code used for mapping. For example, the operating system may be designed to make the injection work smoothly by passing variables to the portion of computer code.
- According to an embodiment, patterns can be injected into the projected digital images for test, alignment, and/or feedback purposes. Watermarking patterns with invisibly small changes or other invisible test patterns such as individual frames may be used. The sensor can be synchronized to the individual frames. A three-dimensional user interface can be injected into the projected digital image for purposes (that should be apparent to those of skill in the art) such as controlling the computer, manipulating data, interacting with the environment in the immediate proximity to the user, or interacting with an environment remotely located from the user.
- Head tracking, eye tracking, or other external parameters can be used to change the injected mapping function according to the viewer's field of view or other conditions of the viewer. In the example of warping, head tracking can be used to position the projected digital image with proper warping on a dome or other immersive screen for simulation purposes. The appropriate geometric parameters to accomplish the exemplary warp are understood by those of skill in the art.
- Injection-based digital imaging systems can also be used to modify the projected digital images as a function of time. For example, if the projector alignment is only acceptable for a certain period of time (because of possible physical misalignment over time, etc.), a visible warning can be injected after the time period has expired. Alternately, the mapping function can be automatically changed after a certain period of time to compensate for a predetermined pattern of alignment drift such as thermal warming effects. In another embodiment, the mapping can be changed based on the time of day to compensate for increased ambient light during day hours of operation, awhile the compensation is removed during night hours of operation. In another embodiment, the mapping can depend on external factors such room temperature or humidity. The mapping can be predetermined in a look-up table, or can be calculated in real time or near-real time.
- Sensors used for feedback in various implementations of the system can include still cameras, video cameras illustratively operating at 30 frames per second or another frame rate, ambient light sensors, or any other device that senses a characteristic of the projected digital image or the surrounding environment. In the example of still cameras, the computer may be used to trigger the camera to take pictures as required. Sensors may also be used to determine operational characteristics of the projectors such as their temperature or operation mode.
- US published patent application No. 20080/246781 A1, entitled SYSTEM AND METHOD FOR PROVIDING IMPROVED DISPLAY QUALITY BY DISPLAY ADJUSTMENT AND IMAGE PROCESSING USING OPTICAL FEEDBACK, by Rajeev J. Surati, et al., the teachings of which are expressly incorporated herein by reference as useful background information, describes the optical mechanical thermal and electronic (OMTE) parameters of a display. The OMTE parameters may be modified under computer or manual control and then the mapping function may make transformations to the image that work together with the OMTE changes.
- A specific example of mapping function injection for a digital imaging system is based on the following three conditions: (1) There is a mapping function generated that will be injected into the digital imaging system; (2) the operating system has compositing software such as that instantiated in Microsoft Windows Vista®, wherein this compositing software can include or comprise the Desktop Window Manager (dwm.exe) in Microsoft Windows®, the equivalent windows manager in the Apple Leopard® operating system, or Compiz™ in the Linux operating system; and (3) the compositing software is enacted by a common library such as DirectX®, OpenGL™, or DDraw™. Also, in order to enable the mapping function injection, the functions that are called that display to the screen such as Present in DirectX or GLSwap in OpenGL (or a lower level functionality in an underlying library) should be known by the process. In an embodiment, the portion of computer code that performs the injection overwrites the functions used by the compositing software that are relevant for initializing. The portion of computer code further detects certain relevant states with functions that call from the original function. Prior to those calls, the portion of computer code initializes, inspects or sets states, or enacts the mapping as appropriate. In the example of Direct3D, this can occur during the operation of CreateDevice for initialization or during the operation of Present. The enactment usually initializes and utilizes a set of shaders upon a mesh, or shaders on vertices of the image. In OpenGL that would include the operation of GLSwap. In an embodiment, the portion of computer code can be injected whenever the compositing software or application software is started or restarted.
- Note also that specific hardware used for implementing injection into a digital imaging system can desirably make use of commercially available computer graphics boards such as the Quadro™ series of graphics cards made by NVIDIA (Santa Clara, Calif.) in various embodiments.
- In various embodiments, other implementations of injection of a mapping function include corrections for dithering, corrections for dithering before a warping correction, correction of mura defects, shading correction for transmissive LCD projectors, mapping for cell phones with embedded projectors and cameras, warping of multiplayer simulations such as Microsoft Flight Simulator X (Microsoft Corporation, Redmond, Wash.), warping the menus of the Microsoft Windows CE operating system running on projector, radial distortion correction of a single display, adjusting for display motion of a single display, showing only a portion of a larger display such as showing a circular portion of a rectangular display, and projecting on a corner of a room and correcting for the condition where one wall or the ceiling has a different color or other surface property. The specific parameters to be injected are computed in a conventional manner that should be apparent to those of skill in the art.
- In various embodiments, a multiple computer platform is employed. By way of example, a first and a second computer system is configured with a first and a second compositor, respectively. The first and second computers are configured to communicate between each other over a conventional communication link in a manner that should be apparent to those skilled in the art. Computer codes are injected into the first and second computer, respectively. During operation, the first computer applies a first mapping function to output display signals to a first display which forms a displayed digital image. The display signals are based partially on the information communicated with the second computer. Similarly, the second computer applies a second mapping function to output display signals to a second display which forms a displayed digital image. The display signals are based partially on the information communicated with the first computer.
- In various alternate embodiments, the mapping function is stored on a computer-readable medium. The computer code is operatively configured to control the computer hardware upon reading of the computer-readable medium by the computer, as apparent to those of ordinary skill in the art. Upon initialization by the computer system, the computer code would function as operatively described in the specification herein.
- The foregoing has been a detailed description of illustrative embodiments of the invention. Various modifications and additions can be made without departing from the spirit and scope of this invention. Each of the various embodiments described above may be combined with other described embodiments in order to provide multiple features. Furthermore, while the foregoing describes a number of separate embodiments of the apparatus and method of the present invention, what has been described herein is merely illustrative of the application of the principles of the present invention. For example, there may be provided one computer in the image display system as shown in
FIGS. 1 , 3, and 4, or there may be provided more than one computer in the image display system. The compositor can be distributed across multiple computers or multiple central processing units (CPUs). The multiple computers or CPUs can reside on an extended local bus, or can be connected by a network arrangement such as Ethernet. Also, there can be provided one sensor in the image display system as shown inFIGS. 1 , 3, and 4, or there can be provided a plurality of sensors in the image display system. In the example of a predetermined mapping function made without sensed parameters from the projected digital image, the digital imaging system can be free of any sensors. Also, in the case of a system adapted to allow manual adjustment of parameters, geometry, etc, the system can be free of any sensors. Furthermore, it is expressly contemplated that the teachings herein can be accomplished using electronic hardware, software, consisting of computer-readable program instructions, or a combination of hardware and software. Accordingly, this description is meant to be taken only by way of example, and not to otherwise limit the scope of this invention.
Claims (39)
1. A method of improving display quality comprising the steps of:
injecting a portion of computer code into a compositor operatively arranged and configured on a computer system;
using the portion of computer code to apply a mapping function to a first digital image; and
forming a second digital image of the first digital image with the applied mapping function.
2. The method of claim 1 further comprising the step of displaying the second digital image to form a displayed digital image on a display.
3. The method of claim 2 wherein the forming of the displayed digital image is performed by a multiplicity of displays wherein each display forms a part of the displayed digital image.
4. The method of claim 3 wherein the multiplicity of displays are projectors.
5. The method of claim 3 wherein at least two of the displays are arranged so that the parts of the displayed digital image from the two displays have partial overlap.
6. The method of claim 3 wherein at least two of the displays are arranged so that the parts of the displayed digital image from the two displays have substantially complete overlap.
7. The method of claim 6 wherein the parts of the displayed digital image from the two displays form a stereoscopic image.
8. The method of claim 6 wherein a third display and a fourth display are arranged so that the parts of the displayed digital image from the third display and fourth display have partial overlap.
9. The method of claim 3 wherein at least two of the displays are arranged so that the parts of the displayed digital image from the two displays are edge joined with no overlap.
10. The method of claim 3 wherein at least two of the displays are arranged so that the parts of the displayed digital image from the two displays have a gap region.
11. The method of claim 3 wherein the gap region is smaller than one of the multitude of displays.
12. The method of claim 10 wherein parts of the displayed digital image are shifted so that a feature of the displayed digital image does not display in the gap region.
13. The method of claim 2 further comprising:
sensing a characteristic of the displayed digital image from a sensor; and
using the characteristic of the displayed digital image to control the mapping function.
14. The method of claim 13 wherein the characteristic is a position of a pixel.
15. The method of claim 1 wherein the mapping function is a warping function.
16. The method of claim 1 wherein the mapping function is a color mapping function.
17. The method of claim 1 wherein the mapping function is a spatially varying filter.
18. The method of claim 1 wherein the mapping function is a temporally varying filter.
19. The method of claim 1 wherein the mapping function is an intensity mapping function.
20. The method of claim 1 further comprising the steps of:
determining whether the first digital image is a full screen image; and
injecting the portion of computer code into the compositor if the digital image is a full screen image.
21. The method of claim 20 further comprising the steps of:
injecting the portion of computer code into an application if the digital image is not a full screen image.
22. The method of claim 1 further comprising:
adding visual information to the first digital image prior to injecting the first digital image with the mapping function into the compositor.
23. The method of claim 22 wherein the visual information forms a three-dimensional user interface.
24. The method of claim 1 wherein the step of injecting a portion of computer code is automatically turned on or off.
25. The method of claim 1 wherein the mapping function is adapted to fit a capability of the graphics driver software and display.
26. A method of improving display quality comprising the steps of:
injecting a portion of computer code into a graphics driver;
using the portion of computer code to apply a mapping function to a digital image; and
forming a displayed digital image of the digital image with the applied mapping function.
27. The method of claim 26 further comprising the steps of:
determining whether the digital image is a full screen image; and
injecting the portion of computer code into the graphics driver if the digital image is a full screen image.
28. The method of claim 27 further comprising the steps of:
injecting the portion of computer code into an application if the digital image is not a full screen image.
29. A digital imaging system comprising:
a first computer;
a first compositor which runs on the first computer;
a first portion of computer code injected into the first compositor; and
a first display which forms a displayed digital image from an output of the first computer;
wherein the first portion of computer code applies a first mapping function to a first digital image in the first computer.
30. The system of claim 29 further comprising a second display wherein the first display forms a first part of the displayed digital image and the second display forms a second part of the displayed digital image.
31. The system of claim 30 further comprising:
a second computer;
a second compositor which runs on the second computer,
wherein and
a communication link between the first computer and the second computer to receive signals between first computer and the second computer to enable the first display to form a displayed digital image from an output of the first computer and an output of the second computer.
32. The system of claim 31 further comprising a second display wherein the first display forms a first part of the displayed digital image and the second display forms a second part of the displayed digital image.
33. The system of claim 31 wherein a second portion of computer code is injected into the second compositor.
34. The system of claim 31 wherein a second portion of computer code is injected into an application which runs on the second computer.
35. The system of claim 29 wherein the first portion of computer code communicates with a portion of mapping software outside of the computer.
36. A computer-readable medium containing a computer code configured to operatively control a computer system to improve display quality by steps comprising of:
using a portion of computer code to apply a mapping function to a digital image;
forming a displayed digital image of the digital image with the applied mapping function;
sensing a characteristic of the displayed digital image; and
using the characteristic to control the mapping function.
37. The method of claim 36 wherein the characteristic is a position of a pixel.
38. The method of claim 37 wherein the mapping function is a warping function.
39. A method of improving display quality comprising:
adapting a computer operating system to accept injection of a portion of computer code;
injecting the portion of computer code into the computer operating system;
using the portion of computer code to apply a mapping function to a digital image; and
forming a displayed digital image of the digital image with the applied mapping function.
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/818,102 US20100321382A1 (en) | 2009-06-18 | 2010-06-17 | System and method for injection of mapping functions |
KR1020127001340A KR101752017B1 (en) | 2009-06-18 | 2010-06-18 | Applying mapping functions to image display |
EP10732775A EP2443823A2 (en) | 2009-06-18 | 2010-06-18 | System and method for injection of mapping functions |
JP2012516334A JP2012530941A (en) | 2009-06-18 | 2010-06-18 | System and method for injection of mapping function |
PCT/US2010/039167 WO2010148303A2 (en) | 2009-06-18 | 2010-06-18 | System and method for injection of mapping functions |
JP2015051695A JP6145123B2 (en) | 2009-06-18 | 2015-03-16 | System and method for injection of mapping function |
US14/863,216 US10319137B2 (en) | 2009-06-18 | 2015-09-23 | System and method for injection of mapping functions |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US21839709P | 2009-06-18 | 2009-06-18 | |
US12/818,102 US20100321382A1 (en) | 2009-06-18 | 2010-06-17 | System and method for injection of mapping functions |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/863,216 Continuation US10319137B2 (en) | 2009-06-18 | 2015-09-23 | System and method for injection of mapping functions |
Publications (1)
Publication Number | Publication Date |
---|---|
US20100321382A1 true US20100321382A1 (en) | 2010-12-23 |
Family
ID=43353913
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/818,102 Abandoned US20100321382A1 (en) | 2009-06-18 | 2010-06-17 | System and method for injection of mapping functions |
US14/863,216 Active US10319137B2 (en) | 2009-06-18 | 2015-09-23 | System and method for injection of mapping functions |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/863,216 Active US10319137B2 (en) | 2009-06-18 | 2015-09-23 | System and method for injection of mapping functions |
Country Status (5)
Country | Link |
---|---|
US (2) | US20100321382A1 (en) |
EP (1) | EP2443823A2 (en) |
JP (2) | JP2012530941A (en) |
KR (1) | KR101752017B1 (en) |
WO (1) | WO2010148303A2 (en) |
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013011491A1 (en) | 2011-07-21 | 2013-01-24 | Imax Corporation | Generalized normalization for image display |
US20130307877A1 (en) * | 2012-05-16 | 2013-11-21 | Nokia Corporation | Controlling One or More Displays |
US20150029217A1 (en) * | 2013-07-25 | 2015-01-29 | Empire Technology Developement, LLC | Composite display with multiple imaging properties |
US20150093016A1 (en) * | 2013-09-29 | 2015-04-02 | Ningbo University | Digital watermarking based method for objectively evaluating quality of stereo image |
US20150324054A1 (en) * | 2012-09-18 | 2015-11-12 | Seiko Epson Corporation | Interactive system, control method for interactive system, and projector |
US9265458B2 (en) | 2012-12-04 | 2016-02-23 | Sync-Think, Inc. | Application of smooth pursuit cognitive testing paradigms to clinical drug development |
US20160088275A1 (en) * | 2014-02-18 | 2016-03-24 | Panasonic Intellectual Property Corporation Of America | Projection system and semiconductor integrated circuit |
US9384535B2 (en) | 2008-06-13 | 2016-07-05 | Imax Corporation | Methods and systems for reducing or eliminating perceived ghosting in displayed stereoscopic images |
US9380976B2 (en) | 2013-03-11 | 2016-07-05 | Sync-Think, Inc. | Optical neuroinformatics |
US20160212396A1 (en) * | 2013-08-16 | 2016-07-21 | Lg Electronics Inc. | Display apparatus capable of seamlessly displaying a plurality of projection images on screen |
US9497447B2 (en) | 2011-06-15 | 2016-11-15 | Scalable Display Technologies, Inc. | System and method for color and intensity calibrating of a display system for practical usage |
US9542011B2 (en) | 2014-04-08 | 2017-01-10 | Eon Reality, Inc. | Interactive virtual reality systems and methods |
US9560343B2 (en) | 2012-11-23 | 2017-01-31 | Samsung Electronics Co., Ltd. | Apparatus and method for calibrating multi-layer three-dimensional (3D) display |
CN106469039A (en) * | 2016-09-28 | 2017-03-01 | 华为技术有限公司 | Method for displaying image and system |
US20170091305A1 (en) * | 2015-09-30 | 2017-03-30 | International Business Machines Corporation | Smart tuple dynamic grouping of tuples |
WO2017054334A1 (en) * | 2015-09-28 | 2017-04-06 | 中兴通讯股份有限公司 | Projection method, device, terminal, and computer storage medium |
US9684369B2 (en) | 2014-04-08 | 2017-06-20 | Eon Reality, Inc. | Interactive virtual reality systems and methods |
US9860494B2 (en) | 2013-03-15 | 2018-01-02 | Scalable Display Technologies, Inc. | System and method for calibrating a display system using a short throw camera |
US10002561B1 (en) | 2012-12-12 | 2018-06-19 | Christopher Ralph Tridico | Perceptually configured array of addressable electromagnetic emitter elements |
US10657135B2 (en) | 2015-09-30 | 2020-05-19 | International Business Machines Corporation | Smart tuple resource estimation |
US11062383B2 (en) * | 2016-05-10 | 2021-07-13 | Lowe's Companies, Inc. | Systems and methods for displaying a simulated room and portions thereof |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102067759B1 (en) * | 2013-02-15 | 2020-01-17 | 삼성전자주식회사 | Fiber scanning projector |
CN107861311A (en) * | 2017-10-10 | 2018-03-30 | 神画科技(深圳)有限公司 | A kind of optical projection system with supervising device |
KR102314478B1 (en) * | 2017-10-18 | 2021-10-19 | 한국전자통신연구원 | Method and apparatus for monitoring moving picture using omni-directional multi-camera |
Citations (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5381349A (en) * | 1993-06-29 | 1995-01-10 | Hewlett-Packard Company | System for calibrating a color display to enable color-matching |
US5574473A (en) * | 1993-08-26 | 1996-11-12 | Olympus Optical Co., Ltd. | Image display apparatus |
US5617259A (en) * | 1994-03-07 | 1997-04-01 | Sony Corporation | Projection TV set apparatus |
US6018629A (en) * | 1996-07-05 | 2000-01-25 | Nec Corporation | Multitasking computer system having a boot process rewrite program |
US20020109655A1 (en) * | 2000-12-28 | 2002-08-15 | Yer Jung Taeck | Driving circuit of a liquid crystal display device |
US6456339B1 (en) * | 1998-07-31 | 2002-09-24 | Massachusetts Institute Of Technology | Super-resolution display |
US6695451B1 (en) * | 1997-12-12 | 2004-02-24 | Hitachi, Ltd. | Multi-projection image display device |
US6779187B1 (en) * | 1999-04-08 | 2004-08-17 | Novadigm, Inc. | Method and system for dynamic interception of function calls to dynamic link libraries into a windowed operating system |
US20050062678A1 (en) * | 2001-08-02 | 2005-03-24 | Mark Resources, Llc | Autostereoscopic display system |
US20050117126A1 (en) * | 2003-12-01 | 2005-06-02 | Seiko Epson Corporation | Front projection type multi-projection display |
US6919900B2 (en) * | 2001-03-23 | 2005-07-19 | Microsoft Corporation | Methods and systems for preparing graphics for display on a computing device |
US20050280605A1 (en) * | 2004-06-21 | 2005-12-22 | Che-Chih Tsao | Error correction schemes for volumetric 3D displays |
US20070097113A1 (en) * | 2005-10-21 | 2007-05-03 | Samsung Electronics Co., Ltd. | Three-dimensional graphic user interface, and apparatus and method of providing the same |
US20070171380A1 (en) * | 2006-01-26 | 2007-07-26 | Christie Digital Systems Inc. | Calibration of a super-resolution display |
US20080143964A1 (en) * | 2006-10-18 | 2008-06-19 | Real D | Dual ZScreen® projection |
US20080246781A1 (en) * | 2007-03-15 | 2008-10-09 | Scalable Display Technologies, Inc. | System and method for providing improved display quality by display adjustment and image processing using optical feedback |
Family Cites Families (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB9611939D0 (en) * | 1996-06-07 | 1996-08-07 | Philips Electronics Nv | Stereoscopic image display driver apparatus |
US6141698A (en) * | 1997-01-29 | 2000-10-31 | Network Commerce Inc. | Method and system for injecting new code into existing application code |
EP0936738A1 (en) | 1998-02-13 | 1999-08-18 | Optosys SA | Inductive proximity switch with one-piece housing |
JP3720590B2 (en) * | 1998-08-21 | 2005-11-30 | キヤノン株式会社 | Image processing system and apparatus and methods thereof |
JP3395832B2 (en) | 1998-08-28 | 2003-04-14 | ソニー株式会社 | Image display correction system, image display correction apparatus and method, and image display apparatus and method |
JP4052357B2 (en) * | 1999-02-23 | 2008-02-27 | 松下電工株式会社 | Virtual environment experience display device |
JP2001230991A (en) * | 2000-02-15 | 2001-08-24 | Seiko Epson Corp | Projector and image processor used therefor |
US6520647B2 (en) | 2000-08-17 | 2003-02-18 | Mitsubishi Electric Research Laboratories Inc. | Automatic keystone correction for projectors with arbitrary orientation |
US6677956B2 (en) | 2001-08-15 | 2004-01-13 | Mitsubishi Electric Research Laboratories, Inc. | Method for cross-fading intensities of multiple images of a scene for seamless reconstruction |
US6733138B2 (en) | 2001-08-15 | 2004-05-11 | Mitsubishi Electric Research Laboratories, Inc. | Multi-projector mosaic with automatic registration |
US6781591B2 (en) | 2001-08-15 | 2004-08-24 | Mitsubishi Electric Research Laboratories, Inc. | Blending multiple images using local and global information |
US6527395B1 (en) | 2001-12-10 | 2003-03-04 | Mitsubishi Electric Research Laboratories, Inc. | Method for calibrating a projector with a camera |
KR100384974B1 (en) | 2002-06-28 | 2003-05-22 | Seung Hyun Oh | Display color correction pattern and display color correction method using the same |
JP2004072553A (en) * | 2002-08-08 | 2004-03-04 | Digital Zuu:Kk | Image distortion correction method, and program for the same |
US7242818B2 (en) | 2003-01-17 | 2007-07-10 | Mitsubishi Electric Research Laboratories, Inc. | Position and orientation sensing with a projector |
US6811264B2 (en) | 2003-03-21 | 2004-11-02 | Mitsubishi Electric Research Laboratories, Inc. | Geometrically aware projector |
US6715888B1 (en) | 2003-03-21 | 2004-04-06 | Mitsubishi Electric Research Labs, Inc | Method and system for displaying images on curved surfaces |
US6729733B1 (en) | 2003-03-21 | 2004-05-04 | Mitsubishi Electric Research Laboratories, Inc. | Method for determining a largest inscribed rectangular image within a union of projected quadrilateral images |
US6834965B2 (en) | 2003-03-21 | 2004-12-28 | Mitsubishi Electric Research Laboratories, Inc. | Self-configurable ad-hoc projector cluster |
US6709116B1 (en) | 2003-03-21 | 2004-03-23 | Mitsubishi Electric Research Laboratories, Inc. | Shape-adaptive projector system |
US6755537B1 (en) | 2003-03-21 | 2004-06-29 | Mitsubishi Electric Research Laboratories, Inc. | Method for globally aligning multiple projected images |
ES2312985T3 (en) | 2003-03-26 | 2009-03-01 | Matsushita Electric Works, Ltd. | PROCEDURE TO CREATE A BRIGHTNESS FILTER AND VIRTUAL SPACE CREATION SYSTEM. |
US7292269B2 (en) | 2003-04-11 | 2007-11-06 | Mitsubishi Electric Research Laboratories | Context aware projector |
US7001023B2 (en) | 2003-08-06 | 2006-02-21 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for calibrating projectors to arbitrarily shaped surfaces with discrete optical sensors mounted at the surfaces |
US6764185B1 (en) | 2003-08-07 | 2004-07-20 | Mitsubishi Electric Research Laboratories, Inc. | Projector as an input and output device |
JP2005077892A (en) | 2003-09-02 | 2005-03-24 | Omron Corp | Electronic equipment, temperature controller, display inspection device, and display correction method |
US7012606B2 (en) | 2003-10-23 | 2006-03-14 | Microsoft Corporation | System and method for a unified composition engine in a graphics processing system |
US7421111B2 (en) | 2003-11-07 | 2008-09-02 | Mitsubishi Electric Research Laboratories, Inc. | Light pen system for pixel-based displays |
US7137707B2 (en) | 2004-07-01 | 2006-11-21 | Mitsubishi Electric Research Laboratories, Inc | Projector-camera system with laser pointers |
US7154395B2 (en) | 2004-07-01 | 2006-12-26 | Mitsubishi Electric Research Laboratories, Inc. | Interactive wireless tag location and identification system |
US7355583B2 (en) | 2004-08-10 | 2008-04-08 | Mitsubishi Electric Research Laboretories, Inc. | Motion-based text input |
JP2006058608A (en) * | 2004-08-20 | 2006-03-02 | Victor Co Of Japan Ltd | Display device for presentation, and display method |
US7252387B2 (en) | 2005-03-21 | 2007-08-07 | Mitsubishi Electric Research Laboratories, Inc. | System and method for mechanically adjusting projector pose with six degrees of freedom for image alignment |
JP2007093702A (en) * | 2005-09-27 | 2007-04-12 | Sony Corp | Image display apparatus and image display method |
CN101406042A (en) * | 2006-03-28 | 2009-04-08 | 汤姆森许可贸易公司 | Method and apparatus for executing edge blending by using generation switching device |
JP5535431B2 (en) * | 2006-08-11 | 2014-07-02 | ジーイーオー セミコンダクター インコーポレイテッド | System and method for automatic calibration and correction of display shape and color |
US7449287B1 (en) | 2008-01-30 | 2008-11-11 | Eastman Kodak Company | Pearlescent textured imaging supports |
-
2010
- 2010-06-17 US US12/818,102 patent/US20100321382A1/en not_active Abandoned
- 2010-06-18 JP JP2012516334A patent/JP2012530941A/en active Pending
- 2010-06-18 WO PCT/US2010/039167 patent/WO2010148303A2/en active Application Filing
- 2010-06-18 EP EP10732775A patent/EP2443823A2/en not_active Ceased
- 2010-06-18 KR KR1020127001340A patent/KR101752017B1/en active IP Right Grant
-
2015
- 2015-03-16 JP JP2015051695A patent/JP6145123B2/en active Active
- 2015-09-23 US US14/863,216 patent/US10319137B2/en active Active
Patent Citations (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5381349A (en) * | 1993-06-29 | 1995-01-10 | Hewlett-Packard Company | System for calibrating a color display to enable color-matching |
US5574473A (en) * | 1993-08-26 | 1996-11-12 | Olympus Optical Co., Ltd. | Image display apparatus |
US5617259A (en) * | 1994-03-07 | 1997-04-01 | Sony Corporation | Projection TV set apparatus |
US6018629A (en) * | 1996-07-05 | 2000-01-25 | Nec Corporation | Multitasking computer system having a boot process rewrite program |
US6695451B1 (en) * | 1997-12-12 | 2004-02-24 | Hitachi, Ltd. | Multi-projection image display device |
US6456339B1 (en) * | 1998-07-31 | 2002-09-24 | Massachusetts Institute Of Technology | Super-resolution display |
US6779187B1 (en) * | 1999-04-08 | 2004-08-17 | Novadigm, Inc. | Method and system for dynamic interception of function calls to dynamic link libraries into a windowed operating system |
US20020109655A1 (en) * | 2000-12-28 | 2002-08-15 | Yer Jung Taeck | Driving circuit of a liquid crystal display device |
US6919900B2 (en) * | 2001-03-23 | 2005-07-19 | Microsoft Corporation | Methods and systems for preparing graphics for display on a computing device |
US20050062678A1 (en) * | 2001-08-02 | 2005-03-24 | Mark Resources, Llc | Autostereoscopic display system |
US20050117126A1 (en) * | 2003-12-01 | 2005-06-02 | Seiko Epson Corporation | Front projection type multi-projection display |
US20050280605A1 (en) * | 2004-06-21 | 2005-12-22 | Che-Chih Tsao | Error correction schemes for volumetric 3D displays |
US20070097113A1 (en) * | 2005-10-21 | 2007-05-03 | Samsung Electronics Co., Ltd. | Three-dimensional graphic user interface, and apparatus and method of providing the same |
US20070171380A1 (en) * | 2006-01-26 | 2007-07-26 | Christie Digital Systems Inc. | Calibration of a super-resolution display |
US20080143964A1 (en) * | 2006-10-18 | 2008-06-19 | Real D | Dual ZScreen® projection |
US20080246781A1 (en) * | 2007-03-15 | 2008-10-09 | Scalable Display Technologies, Inc. | System and method for providing improved display quality by display adjustment and image processing using optical feedback |
Non-Patent Citations (1)
Title |
---|
Humphreys et al., Chromium: a stream-processing framework for interactive rendering on clusters, July 2002, ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH 2002, Volume 21 Issue 3, 1-10 * |
Cited By (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9384535B2 (en) | 2008-06-13 | 2016-07-05 | Imax Corporation | Methods and systems for reducing or eliminating perceived ghosting in displayed stereoscopic images |
US9497447B2 (en) | 2011-06-15 | 2016-11-15 | Scalable Display Technologies, Inc. | System and method for color and intensity calibrating of a display system for practical usage |
US9106811B2 (en) | 2011-07-21 | 2015-08-11 | Imax Corporation | Generalized normalization for image display |
EP2734976A4 (en) * | 2011-07-21 | 2015-03-18 | Imax Corp | Generalized normalization for image display |
WO2013011491A1 (en) | 2011-07-21 | 2013-01-24 | Imax Corporation | Generalized normalization for image display |
US20130307877A1 (en) * | 2012-05-16 | 2013-11-21 | Nokia Corporation | Controlling One or More Displays |
US9007279B2 (en) * | 2012-05-16 | 2015-04-14 | Nokia Corporation | Controlling one or more displays |
US20150324054A1 (en) * | 2012-09-18 | 2015-11-12 | Seiko Epson Corporation | Interactive system, control method for interactive system, and projector |
US9632616B2 (en) * | 2012-09-18 | 2017-04-25 | Seiko Epson Corporation | Interactive system, control method for interactive system, and projector |
US9560343B2 (en) | 2012-11-23 | 2017-01-31 | Samsung Electronics Co., Ltd. | Apparatus and method for calibrating multi-layer three-dimensional (3D) display |
US9265458B2 (en) | 2012-12-04 | 2016-02-23 | Sync-Think, Inc. | Application of smooth pursuit cognitive testing paradigms to clinical drug development |
US10002561B1 (en) | 2012-12-12 | 2018-06-19 | Christopher Ralph Tridico | Perceptually configured array of addressable electromagnetic emitter elements |
US9380976B2 (en) | 2013-03-11 | 2016-07-05 | Sync-Think, Inc. | Optical neuroinformatics |
US9860494B2 (en) | 2013-03-15 | 2018-01-02 | Scalable Display Technologies, Inc. | System and method for calibrating a display system using a short throw camera |
US20150029217A1 (en) * | 2013-07-25 | 2015-01-29 | Empire Technology Developement, LLC | Composite display with multiple imaging properties |
US9817626B2 (en) * | 2013-07-25 | 2017-11-14 | Empire Technology Development Llc | Composite display with multiple imaging properties |
US9686522B2 (en) * | 2013-08-16 | 2017-06-20 | Lg Electronics Inc. | Display apparatus capable of seamlessly displaying a plurality of projection images on screen |
US20160212396A1 (en) * | 2013-08-16 | 2016-07-21 | Lg Electronics Inc. | Display apparatus capable of seamlessly displaying a plurality of projection images on screen |
US9094665B2 (en) * | 2013-09-29 | 2015-07-28 | Ningbo University | Digital watermarking based method for objectively evaluating quality of stereo image |
US20150093016A1 (en) * | 2013-09-29 | 2015-04-02 | Ningbo University | Digital watermarking based method for objectively evaluating quality of stereo image |
US20160088275A1 (en) * | 2014-02-18 | 2016-03-24 | Panasonic Intellectual Property Corporation Of America | Projection system and semiconductor integrated circuit |
US9554104B2 (en) * | 2014-02-18 | 2017-01-24 | Panasonic Intellectual Property Corporation Of America | Projection system and semiconductor integrated circuit |
US9684369B2 (en) | 2014-04-08 | 2017-06-20 | Eon Reality, Inc. | Interactive virtual reality systems and methods |
US9542011B2 (en) | 2014-04-08 | 2017-01-10 | Eon Reality, Inc. | Interactive virtual reality systems and methods |
WO2017054334A1 (en) * | 2015-09-28 | 2017-04-06 | 中兴通讯股份有限公司 | Projection method, device, terminal, and computer storage medium |
US20170091305A1 (en) * | 2015-09-30 | 2017-03-30 | International Business Machines Corporation | Smart tuple dynamic grouping of tuples |
US10657135B2 (en) | 2015-09-30 | 2020-05-19 | International Business Machines Corporation | Smart tuple resource estimation |
US10733209B2 (en) * | 2015-09-30 | 2020-08-04 | International Business Machines Corporation | Smart tuple dynamic grouping of tuples |
US11062383B2 (en) * | 2016-05-10 | 2021-07-13 | Lowe's Companies, Inc. | Systems and methods for displaying a simulated room and portions thereof |
US11875396B2 (en) | 2016-05-10 | 2024-01-16 | Lowe's Companies, Inc. | Systems and methods for displaying a simulated room and portions thereof |
CN106469039A (en) * | 2016-09-28 | 2017-03-01 | 华为技术有限公司 | Method for displaying image and system |
Also Published As
Publication number | Publication date |
---|---|
JP6145123B2 (en) | 2017-06-07 |
WO2010148303A3 (en) | 2011-02-10 |
KR101752017B1 (en) | 2017-07-11 |
KR20120092090A (en) | 2012-08-20 |
US10319137B2 (en) | 2019-06-11 |
EP2443823A2 (en) | 2012-04-25 |
JP2015148809A (en) | 2015-08-20 |
JP2012530941A (en) | 2012-12-06 |
WO2010148303A2 (en) | 2010-12-23 |
US20160086370A1 (en) | 2016-03-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10319137B2 (en) | System and method for injection of mapping functions | |
US8102332B2 (en) | Intensity scaling for multi-projector displays | |
US9035969B2 (en) | Method for multiple projector display using a GPU frame buffer | |
US7133083B2 (en) | Dynamic shadow removal from front projection displays | |
Jaynes et al. | Dynamic shadow removal from front projection displays | |
JP2020074014A (en) | System and method of calibrating display system free of variation in system input resolution | |
JP2010134396A (en) | Multi-display system, information processor, and image data processing method in multi-display system | |
US8152309B2 (en) | Image display apparatus, image display system, and image display method | |
CN104424538A (en) | Theater parameter management apparatus and method | |
CN104702929A (en) | Method of correcting distortion of image overlap area, recording medium, and execution apparatus | |
JP2001067015A (en) | Projection-type display device, projection-type display system, and its display method | |
JP2012234072A (en) | Projection type image display system | |
US8514234B2 (en) | Method of displaying an operating system's graphical user interface on a large multi-projector display | |
JP2001343962A (en) | System and method for image projection and computer readable recording medium on which program for making computer execute the method is recorded | |
JP5205828B2 (en) | Multi-projection system | |
US20230403379A1 (en) | Image processing method, storage medium storing program, and projector | |
JP5369392B2 (en) | Multi-projection system | |
KR20160109927A (en) | Method and apparatus for geometric correction using hidden points | |
CN117806578A (en) | Multi-screen linkage control method, system, equipment and storage medium for exhibition | |
CN117492622A (en) | Progress bar display method and device, electronic equipment and computer readable medium | |
JP2022091477A (en) | Image projection device, method for controlling image projection device, and program | |
WO2014077415A1 (en) | Image projection method using a plurality of video projectors | |
Zoido et al. | Tiled projector displays correction for dark scenes in railway simulators | |
JP2020034808A (en) | Projection type display device | |
JP2008116871A (en) | Image display system and image display method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SCALABLE DISPLAY TECHNOLOGIES, INC., MASSACHUSETTS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:AMARATUNGA, KEVIN;TIMONER, SAMSON;SURATI, RAJEEV J.;REEL/FRAME:024932/0807 Effective date: 20100901 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |