US8194074B2 - Systems and methods for photogrammetric rendering - Google Patents
Systems and methods for photogrammetric rendering Download PDFInfo
- Publication number
- US8194074B2 US8194074B2 US11/800,159 US80015907A US8194074B2 US 8194074 B2 US8194074 B2 US 8194074B2 US 80015907 A US80015907 A US 80015907A US 8194074 B2 US8194074 B2 US 8194074B2
- Authority
- US
- United States
- Prior art keywords
- image
- photogrammetric
- graphic arts
- balance
- rendering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 238000000034 method Methods 0.000 title claims abstract description 297
- 238000009877 rendering Methods 0.000 title claims abstract description 167
- 230000008569 process Effects 0.000 claims abstract description 188
- 238000012545 processing Methods 0.000 claims description 80
- 239000004575 stone Substances 0.000 claims description 21
- 230000000694 effects Effects 0.000 claims description 18
- 238000004519 manufacturing process Methods 0.000 claims description 16
- 230000008859 change Effects 0.000 claims description 13
- 230000000873 masking effect Effects 0.000 claims description 9
- 239000004570 mortar (masonry) Substances 0.000 claims description 9
- 238000005304 joining Methods 0.000 claims description 7
- 238000000926 separation method Methods 0.000 claims description 6
- 238000010422 painting Methods 0.000 claims description 5
- 230000002708 enhancing effect Effects 0.000 claims description 3
- 230000003287 optical effect Effects 0.000 claims 6
- 239000000284 extract Substances 0.000 claims 4
- 238000010276 construction Methods 0.000 abstract description 3
- 238000004321 preservation Methods 0.000 abstract description 2
- 238000012937 correction Methods 0.000 description 21
- 230000008901 benefit Effects 0.000 description 12
- 239000003086 colorant Substances 0.000 description 10
- 238000005259 measurement Methods 0.000 description 10
- 238000007639 printing Methods 0.000 description 9
- 230000007547 defect Effects 0.000 description 8
- 230000000717 retained effect Effects 0.000 description 7
- 239000003973 paint Substances 0.000 description 6
- 230000009467 reduction Effects 0.000 description 5
- 239000002023 wood Substances 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000002950 deficient Effects 0.000 description 4
- 241000226585 Antennaria plantaginifolia Species 0.000 description 3
- 230000014759 maintenance of location Effects 0.000 description 3
- 238000009431 timber framing Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000005520 cutting process Methods 0.000 description 2
- 230000008030 elimination Effects 0.000 description 2
- 238000003379 elimination reaction Methods 0.000 description 2
- 238000012432 intermediate storage Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 239000000654 additive Substances 0.000 description 1
- 230000000996 additive effect Effects 0.000 description 1
- 238000010420 art technique Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000000875 corresponding effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 238000007641 inkjet printing Methods 0.000 description 1
- 238000007648 laser printing Methods 0.000 description 1
- 238000001459 lithography Methods 0.000 description 1
- 238000000053 physical method Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/02—Non-photorealistic rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/001—Texturing; Colouring; Generation of texture or colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/04—Texture mapping
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/06—Ray-tracing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2215/00—Indexing scheme for image rendering
- G06T2215/12—Shadow map, environment map
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Processing Or Creating Images (AREA)
- Image Processing (AREA)
Abstract
Systems and methods are provided for producing a rendered drawing or rendering from a detailed image of an object (e.g. photograph) resulting in a rendering that is photogrammetric and that preserves detail in the said image of said object. The combination of the metric nature and image detail preservation in a rendering resulting from the process enhances the usefulness of the rendering to users. The invention is useful in particular for large format renderings such as wire frame style drawings used for blueprints in the architecture, engineering and construction industry (AEC industry) when used for existing structures. The processes combine graphic arts techniques with photogrammetric techniques to preserve, fully or partially, information about an object as captured in image detail of said object and to present said information in photogrammetrically correct rendering, which rendering may be incorporated into drawings useful to and/or familiar to end users of said drawings.
Description
This application claims the benefit of Provisional Patent Application No. 60/797,511, filed on May 4, 2006, titled “Method of Production of Photogrammetric Renderings,” which is hereby incorporated by reference herein in its entirety.
Traditional 3D computer models, color laser printing, and photogrammetric based maps and images have provided photographic and other forms of representations of buildings, terrain, objects, and artifacts.
Traditional drawings used in the architecture, engineering and construction industry (AEC industry) take the form of blueprints. Traditional blueprints are one-color print documents of an object. Traditional blueprints provide one-color line drawings that use a wire frame representation of an object and are also sometimes referred to as “line art” or “spot color” in the graphics art industry. Such traditional drawings may be adequate in the AEC industry for new constructions as the object of the drawing may not yet exist (i.e., may not yet be constructed). Such traditional blueprints and line art drawings, however, are deficient as such traditional drawings only provide minimal information in the wire frame about the object. It is therefore desirable to provide line drawings with enhanced detail.
Traditional photogrammetric techniques for the AEC industry produce rectified and orthogonally corrected images (“orthophotos” or “orthoimages”), partially rectified, or unrectified images that may be converted into two Dimensional (2D) wire frame models primarily through manual processes on a drafting board or partially manual processes with the aid of a computer assisted drafting board or computer tableau (e.g., CAD/CAM).
Additionally, traditional photogrammetric techniques can be used with CAD/CAM to produce three dimensional (3D) models in either wire frame or textured surface models. Such models can be used for buildings and other objects. End-user blueprints in some cases cannot be created from these techniques, however. As a result, these techniques are deficient. For example, 3D models are difficult to depict in a visually useful way on a 2D surface (e.g., paper) and textured surface models are in a continuous, black and white tone that does not reproduce well by blueprint, fax, and photo copy commonly used in the AEC industry.
Traditional models and images also tend to be relatively large in file size and consume large amounts of storage space and transmission bandwidth. 2D wire frame models, while easy to reproduce as blueprints, have eliminated much useful information from original photographic or other images. Accordingly, blueprints that provide only line art in one color are widely used due to the deficiencies of such 2D and 3D models but are yet still deficient in their own right.
As discussed above, traditional drawings used in the AEC industry of existing structures are wire frame style line art drawings produced as blueprints. After a structure is built, drawings are traditionally redrafted to reflect the structure in its “as-built” condition. Large format photocopiers are used in the AEC industry to produce “record drawings” of newly completed structures when hand written notations on “working drawings” of completed projects must be preserved in multiple copies for architects, owners, and contractors.
Redrafting projects using CAD/CAM to as-built conditions, however, is labor intensive and costly. Detailed features (e.g., stone masonry joints or facade surface detail) is not included in “as-built” drawings because of the difficulty of creating accurate images by traditional CAD/CAM methods, difficulty or impossibility of displaying information in blueprint form, costs, and other factors.
A prior art processed image is shown in image 1100 of FIG. 11 , which is absent of detail of stone texture 1012 of FIG. 10 (loss of detail 1112) and paint drops 1014 of FIG. 10 (loss of detail 1114). Also it is difficult to determine if area 1118 on FIG. 11 is masonry or wood. One skilled in the art would likely determine that area 1112 in FIG. 11 is the wood sill of the window and based on its proximity and the form factor of the abutment to 1118, that 1118 is probably wood trim exterior framing. Such a non-definite determination, however, is disadvantageous.
Systems and methods are provided for producing a rendered drawing, or rendering, of an object that is reproducible in one color. The rendered drawing, or rendering, may be generated from a detailed image of an object (e.g. a color photograph). The rendered drawing, or rendering, may be photogrammetric and reproducible in one color (e.g. blueprint, monochrome laser print), yet still preserve a large amount of the detail with respect to the amount of detail in image (e.g., a photograph).
The metric nature and amount of image-detail preservation provided in such a rendering may significantly enhance the functionality of the rendering to users. Accordingly, such renderings may be utilized in very large-scale formats, such as wire frame style drawings used in the AEC industry for existing structures.
Presenting an object in greater detail in a drawing provides a user of the drawing with an enhanced interpretation of pre-existing conditions, with respect to said object, in “as-built” or “as is” environments. Such an increase in detail allow for an improved determination, by a user (or computer), of particular locations on the object when compared to traditional less-detailed wire frame style drawing. Such improved detail may find particular benefit with respect to the industry of repairing masonry facades as it is beneficial to show greater detail in order to enhance a mason's understanding of the structure of an object that needs repair or the structure of an object that was recently repaired.
Particular graphic arts techniques are realized along with photogrammetric techniques to preserve, fully or partially, information about an object that was captured in image such as a photograph. Such techniques allow for the information to be presented in a photogrammetrically correct rendering. Such a rendering may be utilized to fabricate a particular type of drawing—such as a drawing useful and/or familiar to mason or AEC user.
A photogrammetric rendering is provided that includes a digital image rectified photogrammetrically and rendered using particular graphic arts techniques. Such a photogrammetric rendering may be utilized to fabricate a particular type of drawing and may be combined with other types of information (e.g., additional images, legends, type or other indicia) to form the particular type of drawing (e.g. a blueprint).
In producing photogrammetric renderings by combining particular graphic art techniques and photogrammetry to produce rectified images or orthoimages incorporating “as-built” object detail many advantages may be realized. For example, nonmetric photographs and images may be utilized to prepare photogrammetric renderings, such as historical documents for objects that may no longer exist. As per another example, particular types of drawings, such as blueprints, may be economically produced. As yet another example, detailed digital renderings may be quickly rendered, stored, and printed. As yet another example, detail of existing objects not previously expressed in a rendering may now be expressed and incorporated into a rendering. Non-contact photographic means may also be utilized in fabricating detailed renderings. As per yet another example, the quantity of verification by field measurement needed may be reduced or eliminated. As per yet another example, economical production of end-use drawings containing photogrammetric renderings may be realized as compared to CAD/CAM preparation from photo or field measurements.
A detailed photogrammetric rendering may be produced to scale or out-of-scale. Additional information such as written notes may be added to the renderings.
Particular graphic arts techniques may be utilized with photogrammetry techniques to produce drawings incorporating photogrammetric renderings derived from the processing of non-metric images. Such drawings may be produced either as actual blueprints or in a format directly and/or closely analogous to blueprint paper drawings familiar in the AEC industry (e.g. laser print).
The above and other objects and advantages of the present invention will be apparent upon consideration of the following detailed description, taken in conjunction with accompanying drawings, in which like reference characters refer to like parts
A photogrammetric rendering may be provided, for example, by processing a non-metric digital image (e.g. digital color photograph) to be fully or partially rectified according to a photogrammetric technique. Such processing may create an orthoimage that results in a digital photogrammetric image. Such a digital photogrammetric image may then be further processed by a graphic arts rendering process that results in a photogrammetric rendering.
All such processes may be performed by a computer autonomously. Once one sub-process completes, the next process may be automatically initiated and performed by the computer. Alternatively, for example, a process may be performed by a computer and the computer may request manual instructions at each processing step or at only particular processing steps. For example, a computer may request confirmation that a particularly processed image is satisfactory and that the next processing step should be initiated. The computer may allow a user to reject a particular image and enter in, or modify, parameters for the processing step that produced the image such that a more desirable image may be obtained. A user may instruct the computer to perform any processing step at any time. A user may setup processing packages that include multiple steps such that the user may initiate the package so the computer can autonomously perform all of the steps in the package. The user may add, remove, or modify steps from a package. Such packages may be initiated over the internet such that a customer may upload an image/images for a desired object/objects, select a particular package, and then have the opportunity to download the results of those packages. Different packages may have different prices associated with the packages. Accordingly, a customer may upload an image that the user desires to have a blueprint for, start the process over internet (e.g., by pressing a START button) and then be presented with a blueprint that the customer can download over the internet. Accordingly, an autonomous process may be performed on a remote computer that can be fed an image/images over the internet (or an intranet) and deliver processed images over the internet (or an intranet). A customer/user may be provided with the ability to add, remove, modify process steps to a package. Licenses may be sold that allow a user to use a package, multiple packages, or all packages for a period of time (e.g., a year) or for a set number of images (e.g., 5000 or less). Some licenses may, for example, allow a user/customer to add/modify/remove process steps from packages. The library of process steps available to a user/customer may, for example, change depending on the license.
Graphic arts rendering processes may include a variety of graphic arts processing techniques. Any number of graphic arts processing techniques (e.g., one, two, three, four, or more) may be performed in a graphic arts rendering process. For example, a graphic arts rendering technique may find contrast or texture transition zones (e.g., finding edges), reduce color images to grayscale, adjust the tonal balance (e.g. highlight, midtone and shadow balance adjustment), reduce continuous tones to a limited number of tones or levels (e.g. four-level grayscale), and equalize all tone levels to one level. Such techniques may similarly occur in any order or a particular order (e.g., the order described above).
A digital photogrammetric image resulting from a graphic art rendering process is a photogrammetric rendering. The photogrammetric rendering may be provided, for example, in one color, such as a line drawing or wire frame style drawing. For example, the photogrammetric rendering may be provided as a blueprint tailored to the AEC industry. Accordingly, a photogrammetric rendering may be, for example, one color and capable of reproduction as a blueprint.
Persons skilled in the art will appreciate that a multiplicity of graphic arts processes, in addition to or without the processes described above, may be performed in order to provide a final photogrammetric rendering suitable to a particular user. Persons skilled in the art will appreciate that the graphic arts processing techniques may be ordered in any way (e.g., as described above) and reordered for a particular image. Similarly, the order of the photogrammetric process and graphic arts processes may be performed in any order (e.g., graphics art processes before photogrammetric processes and vice versa). Particular processes may be performed in the middle of other processes. For example, graphic arts processes may be performed between photogrammetric processes (and vice versa). Additionally, particular graphic arts processes may be applied to the original, non-metric digital photograph prior to, and after, any photogrammetric correction.
An initial image used to start process 200 may, for example, include any number of objects and any portion of any objects. Additionally, images may be removed (e.g., cut) from images such that images of particular objects may be separated and processed individually. Similarly, component parts of interest may be separated from an object of interest. All such objects and component parts may be reassembled after processing (e.g., after photogrammetric and graphic arts processing).
Additionally, an initial image may be digital or analog. For example, the starting image could be of a variety of types such as an original hand drawing, a photograph that has been printed or otherwise reproduced as a halftone image, an intermediate image such as photographic continuous tone negative, a photographic continuous tone separation, a halftone separation film, a printing plate, a painting, an original artwork, or any type of image.
Regardless of the form of the starting image, an image may be, for example, converted to a digital image the image may be stored as a file on a computer. Persons skilled in the art will appreciate that any raw unprocessed, preprocessed, beginning, intermediate or final image, rendering or file may be stored temporarily or permanently on a variety of media for further archival or further processing. Such images may be stored as a .JPG, .PICT, .TIFF, .BMP, or any other type of image file. Digital images may be, for example, be captured by way of a camera or scanner.
Non-metric digital image 222 may be processed through photogrammetric correction step 225 to provide digital photogrammetric image 230. Graphics art rendering step 235 may process digital photogrammetric image 230 to provide photogrammetric rendering 245. Process 200 may complete at, for example, step 249, albeit additional processing steps may occur anywhere in process 200 (e.g., after photogrammetric rendering 245 is obtained).
Persons skilled in the art will appreciate that if reproduction of the photogrammetric rendering requires printing as single spot color of ink, monochromatic 1 bit color, processes 200 and 250 may be, for example, suitable. However, if grayscale reproduction would reproduce greater detail, for example, the graphic arts rendering process (e.g., step 235 or 265) may stop short of including indexing, equalization, or other processing to a two-level scale (e.g., in digital images, one bit color).
The image being processing may, for example, be metrically scaled to a known scale at any point after a digital photogrammetric image is achieved (e.g., digital photogrammetric images 240 and 260). Furthering this example, a scaled photogrammetric rendering may be processed into a document of a format suitable for end-use (e.g., a blueprint), which may contain additional information (e.g., a description of the object, its location, the date, compass orientation, a project name, drawing number, version number of the drawing). A final formatted document may then printed or otherwise pre-produced for end-use. Final printing may be in the form of, for example, a blueprint if the image is 1 bit color depth. Grayscale photocopy or printing, for example, may be utilized if the image is greater than 1 bit color depth.
Those familiar with the graphic arts will also note that many additional processes to enhance contrast, feature definition, color balance, hue, color saturation and other aspects of the image may be accomplished prior or during the preferred embodiment.
Additionally, for example, the use of colors may be utilized. Colors may be referred to as, for example, color channels in digital image processing, RGB (Red, Green, and Blue) used in video displays of multi-color images, or CYMK (Cyan, Magenta, Yellow, and Black) in print production. Such schemes may be utilized in processing images to achieve colorized results. For example, color channels may be processed mathematically whether in positive, negative, or inverted form and whether singlely or in combination through additive, subtractive, multiplicative, or differential formula to improve and/or enhance final image results.
Images may be pre-processed in a variety of ways. For example, image ownership processing such as adding copyright information, security concerning image content, or segmenting processing may occur in order to retain intermediate images, increase productivity, impact economics, or affect security. Such pre-processing may include, for example, the production of orthoimages from single or stereo images, joining or “stitching” multiple images together into a single image, or converting images from color to black and white (and vise-versa).
Each image may, for example, be processed individually in order to create separate digital photogrammetric image. Such digital photogrammetric images may be stored temporarily or permanently as they are processed. The multiple digital photogrammetric images may then be joined together (“stitched”) to form a single image of the object of interest. The resulting single image may be photogrammetric in character and may be further processed by graphic arts rendering in order to yield the desired photogrammetric rendering.
Persons skilled in the art will appreciate that additional graphic arts techniques of cutting, pasting, overlapping, erasing, and others may be necessary to result in an image of the whole object of interest found in the multiple images.
In process 300, non-metric digital images may be obtained in step 340. An image may be chosen from the remaining to-be-processed images in step 342. For the chosen image, photogrammetric correction may occur in step 325 to form digital photogrammetric image 330, which may be stored in step 332. Step 344 may then determine if there is any image that is to-be-processed that has not yet been processed. If so, another image may be chosen and processed. Step 346 may determine if more than one digital photogrammetric image was obtained and, if so, the digital photogrammetric images may be joined into a single digital photogrammetric image in step 348. Graphics art rendering may occur in step 335 to provide photogrammetric rendering 385. Process 300 may complete, for example, in step 399.
A post-process graphic arts process on a photogrammetric rendering may be, for example, the adjustment of tonal balance (e.g. highlight, midtone, shadow) in order to accentuate the edges of contrast change or to eliminate unwanted detail to allow a post-processed photogrammetric rendering to be reproduced as blueprint in one bit color.
The result of a graphic arts pre-process of removing objects not of interest of image 500 may be image 600 of FIG. 6 . Persons skilled in the art will appreciate that image 600 has not undergone photogrammetric correction processing. In this case, for example, the graphic arts process of removing objects not of interest was accomplished in a pre-processing step prior to photogrammetric correction.
A pre-processed non-metric digital image is then processed to produce a photogrammetricly corrected, rectified or orthogonally correct image, an “orthophoto” or “orthoimage”. Image 700 of FIG. 7 shows a digital photogrammetric image resulting from the photogrammetric correction process on a pre-processed image, in which backgrounds and other objects not of interest have been removed to form the pre-processed image.
Thus, FIGS. 9C through 9G show rendering at threshold cut-off levels for deep shadow, shadow, low midtone, high midtone, and highlight respectively for 9C, 9D, 9E, 9F, and 9G.
A graphic arts process, in this case, a rendering is performed separately on all or some of the tonal ranges. Such a rendering may occur, for example, by finding particular edges (e.g., as occurs in steps 1520, 1540, and 1560). Thresholds may be set for such processes and may merely be turned ON or OFF by the user. Alternatively, for example, a user may set any threshold. Each of the steps 1510, 1530, and 1550 as well as 1520, 1540, and 1560 may vary for each tonal range to extract the most beneficial result for the users.
After the trace rending process, the resulting rendered trace images are then merged back into a single image 1590. In digital image photo editing this process may be accomplished using layers. A result of such a process may be, for example, merged Photogrammetric Rendering 1599.
The results of a process similar to process 1500 can be seen in images 9C through 9H as follows. Here, five tonal ranges have been used and separated into separate images. In each case, the rendering process used is finding edges or highlighting the areas of contrast change or shift. The result of the process of merging the separate tonal ranges can be seen in image 980 of FIG. 9H .
Persons skilled in the art will appreciate that any number of channels, or layers, to tonal ranges may be separated for individual processing using the same or differing techniques on individual layers. Additionally, all or only some of the individual layers may be merged into a final merged photogrammetric rendering.
Persons skilled in the art will appreciate that end documents or images may be produced in more that one color of ink for the purpose for further enhancing the benefits of or use of the end documents to end users (e.g., highlighting areas of interest or special need or attention). In one example, with respect to FIGS. 9C through 9G , it may be beneficial to produce the combined image in various colors using the various images for each color in order to accentuate certain features (e.g. mortar joints) in combined image. In another example, rectified images of objects that exist in more than one plane may be produced by displaying the objects in different planes, such as those not perpendicular to the orthogonal view presented, in different colors.
In the case of the AEC industry, projections from the orthogonal plane of a building that are sloped, slanted, curved or otherwise not orthogonally viewed from the same position may be represented in alternate colors to indicate that in the view presented they are not presented orthogonally, cannot be measured photgrammetrically, or the area as shown is different from the true area as viewed or field measured. Display or printing in multiple line art colors is possible, for example, by either copying the image to a different color channel or by changing the color channel prior to display or by using graphic arts films or printing plates with different ink colors than the original.
The advantages of the invention are clearly understood by viewing the differences between FIG. 10 , prior art FIG. 11 , and FIG. 12 , while FIG. 13 shows processing to retain more or less detail in the image of an object when preparing a photogrammetric rendering.
Persons skilled in the art will appreciate that color reproduction, particularly in the case of low color saturation, is also possible so that printed documents will appear “washed out,” and may be more clearly and noticeably marked and written on in the field by users.
A process for creating image 1220 of FIG. 12A can be traced in process 250 of FIG. 2B . Here, image 500 of FIG. 5 may corresponds to non-metric digital image 252. Graphic arts process 256 may be to digitally mask the extraneous content so that result is image 600 of FIG. 6 . The result is a pre-processed non-metric digital image 258 that is ready for further graphic arts processing, not shown in 250, or photogrammetric processing. Image 258 is then corrected for perspective and skew 259 resulting in a digital photogrammetric image 260 shown as image 700 shown in FIG. 7 . Perspective correction can either be accomplished manually using cameras with nonparallel image display and image receptor film planes or using digital photo editing processes of perspective correction.
An example of perspective and skew which are demonstrated in 1460 of 14F and 1450 of 14E, respectively with the correction resulting as 1410 of FIG. 14A can be seen in image 600 of FIG. 6 prior to correction and image 700 of FIG. 7 after correction. Less noticeable is in image 500 of FIG. 5 is horizon misalignment demonstrated in 1440 of FIG. 14D which may also be corrected to 1410 of FIG. 14A as shown in 600 of FIG. 6 . In this case, image 500 of FIG. 5 is more analogous to 1470 of FIG. 14G undergoing multiple serial graphic arts processes to result in image 700 of FIG. 7 .
Person skilled in the art will appreciate that the multiplicity of effects shown in FIGS. 14B through 14G , take either individually or as a whole, as may be corrected for serially or in any order such that corrected image 1410 of FIG. 14A is achieved. For example, 1470 of FIG. 14G may be corrected. It may be desirable, depending upon manual or computer-aided processes, to proceed in a particular order, and correct defects in a particular sequence depending upon both the original image and the desired end-use image.
Not shown in process 250 is a graphic arts process of extracting, clipping, or cutting a portion of image 700, and then scaling and cropping the extraction so that the resulting image portion corresponds to 1000 in FIG. 10 . Image 1000 which, is still a continuous tone image is then reduced by process 265, in this case multiple processes, namely discarding color information, finding edges of contrast change, and then reducing the image to eight levels of grey, the results being photogrammetric rendering 285 shown as image 1220 in FIG. 12A .
Persons skilled in the art will appreciate that there are differing needs for retention or discard of information contained in an image depending upon the end users and intended uses of the image, e.g. an architect's or artist's stylistic presentation has different requirements from a masonry consultant's or mason's requirements. The flexible iterative system and process described in 400 becomes important to the invention.
Perspective and skew defects which are demonstrated in 1460 of FIGS. 14F and 1450 of FIG. 14E respectively with the correction resulting as 1410 of FIG. 14A can be seen in image 600 of FIG. 6 prior to correction and image 700 of FIG. 7 after correction. Perspective and skew defects can occur, for example, where a face of an object such as a building wall being photographed and an image receptor plane are not parallel to each other, and in another example where the object of interest is not centered in the image receptor of a camera.
Less noticeable in image 500 of FIG. 5 is horizon misalignment where, for example, the object of interest and the camera image receptor plane are on differing horizontal horizons as demonstrated in 1440 of FIG. 14D . Horizon alignment defects 1440 of FIG. 14D may also be corrected to 1410 of FIG. 14A as shown in image 600 of FIG. 6 .
Other defects in images may be introduced by the method of image capture such as photography when, for example, the camera itself, through the optics of the camera lens and image receptor system, introduces distortion into the image captured. Two common examples of camera induced distortion are barrel lens distortion (e.g., 1420 of FIG. 14B ) and pin cushion distortion (e.g., 1430 of FIG. 14C ). In both cases, increased distortion may exist further away from the center of the camera optics, at the outer edges of the image.
Camera induced defects can be partially mitigated, for example, by keeping the areas of interest of a photograph in the center and away from the edges of the image receptor, as can be seen in 1420 of FIG. 14B . It is an advantage of the invention to photogrammetrically correct such distortion so that a resulting renderings is analogous to the architectural elevation of 1410 of FIG. 14A .
Persons skilled in the art will appreciate that distortions in images to be photogrammetrically rendered are rarely found signally in original images to be processed as demonstrated in FIGS. 14B through 14F . In fact, image 500 is more analogous to 1470 showing a multiplicity of effects, and undergoing multiple serial processes to result in image 700 which is analogous to 1410. In fact, image 500 after being processed to image 600 was corrected for pin cushion effect 1430 prior to removal of perspective 1460 and skew 1450.
Persons familiar with the art will understand that the multiplicity of effects shown in FIGS. 14B through 14G , either individually or multiply (present as in the case of 1470 of FIG. 14G ) may be corrected serially in any order to achieve the corrected image 1410 of FIG. 14A . Depending upon manual or computer aided processes, it may be desirable to proceed differently, and correct defects in a particular sequence depending upon both the original image and the desired end use image.
The consequent advantage of the various techniques described herein may include, for example: (a) use on non metric images for creation of scale rendering s for the AEC industry, (b) conversion of non metric photographs to photogrammetric renderings (c) elimination of the need for specialize metric cameras and equipment, (d) retention of photographic or other original image detail in the photogrammetric rendering, (e) reduction of unnecessary detail in photographs to useful levels for the end user, (f) renderings reproducible by a variety of print production methods, (g) reduction of photographs to renderings capable of being reproduced using blueprint production methods, (h) Economic non contact quick non-labor intensive gathering of field information, (i) reduction of the need for or quantity of field measurements, (j) economic reproduction of photogrammetric renderings as blueprints, photo copies or laser prints instead of photographs or large format ink jet printing, and/or (k) rapid production of photogrammetric renderings.
Accordingly, the invention permits the delivery of photogrammetric renderings and/or documents containing photogrammetric images and other information to end users which said images and/or documents contain more information and are of greater user to end users than images and documents currently produced and provided in the AEC industry. In fact, information contained in photographs and images of object of interest to be processed may be fully or partially retained in a way to that the invention may achieve, for example: (a) it permits more information to be displayed visually to end users, (b) it allows end users to more easily locate on an object an area of interest in a document image and vice versa, (c) it allows end users with greater certainty to locate on an object areas of interest in a document image and vice versa, (d) it allows for more cost effective, less labor intensive, automated or semi-automated production of end user documents, and/or (e) it provides economic benefits to end users manifested through greater ease of use, greater certainty, and cost of production,
The scope of the invention extends beyond the AEC industry to cartography and other areas where the incorporation of additional visual information may enhance ease of use, certainty of the user about object attributes, user location, the environment or other issues of importance.
Inasmuch as the present invention is subject to many variations, modifications and changes in detail, it is intended that all subject matter discussed above or shown in the accompanying drawings be interpreted as illustrative only and not be taken as limiting in any sense.
From the foregoing description, persons skilled in the art will recognize that this invention provides photogrammetric rendering. In addition, persons skilled in the art will appreciate that the various configurations described herein may be combined without departing from the present invention. It will also be recognized that the invention may take many forms other than those disclosed in this specification. Accordingly, it is emphasized that the invention is not limited to the disclosed methods, systems and apparatuses, but is intended to include variations to and modifications thereof which are within the spirit of the following claims.
Claims (62)
1. A method performed on a computer for the production of photogrammetric renderings of an object from an image of the object, the method comprising:
processing the image by a photogrammetric process to produce a photogrammetric image; and
processing the photogrammetric image by a graphic arts rendering process to provide a processed two-dimensional image that comprises a version in which texture detail related to mortar joints on the object has been selectively removed while selectively enhancing texture detail related to stone surfaces on the object, wherein the graphic arts rendering process:
processes original texture data of the object from the photogrammetric image to generate processed texture data that enhances one or more features of the stone surfaces on the object; and
generates the processed two-dimensional image by fabricating a rendering of the object that portrays the processed texture data and is based entirely on the original texture data.
2. The method of claim 1 , wherein the image comprises at least one of a photograph, stereo photograph, metric photograph, orthophotograph, rectified image, drawing, painting, print, film, color separation negative, and positive.
3. The method of claim 1 , wherein the photogrammetric processing comprises a rectification of the image for at least one of a camera lens distortion, image receptor plane effect, optical effect, distortion due to image receptor plane variance, distortion of the image, and damage of the image.
4. The method of claim 1 , wherein the image includes multiple planar faces of the object that are processed separately to achieve separate rectified images of more than one plane of the object.
5. The method of claim 1 , wherein a plurality of images are used during the photogrammetric process and the processing comprises:
separately correcting each individual image of the plurality of images to form a plurality of photogrammetrically-corrected images; and
joining the plurality of photogrammetrically-corrected images together into the photogrammetric image.
6. The method of claim 1 , wherein the graphic arts rendering process comprises at least one of changing contrast, changing hue, changing saturation, changing color balance, converting to grayscale, finding edges (regions of change in texture or contrast or color), and tracing.
7. The method of claim 1 , wherein the photogrammetric process produces the photogrammetric image by generating an orthogonal version of the image.
8. The method of claim 1 , wherein the graphic arts rendering process:
determines at least one of a midtone balance tonal threshold of the image and a highlight balance tonal threshold of the image; and
processes the original texture data by isolating the at least one midtone balance tonal threshold and highlight balance tonal threshold.
9. The method of claim 1 , wherein the processed texture data comprises texture detail that is reproducible as one color art while still visually indicating the original texture detail.
10. The method of claim 1 , wherein the graphic arts rendering process:
extracts the original texture data of the object from the photogrammetric image.
11. The method of claim 1 , wherein the graphic arts rendering process:
determines a shadow balance tonal threshold of the image; and
processes the original texture data by isolating the at least one shadow balance tonal threshold.
12. The method of claim 1 , wherein the processing the image by the photogrammetric process and the processing the photogrammetric image by the graphic arts rendering process are performed autonomously by a computer.
13. The method of claim 1 , wherein the graphic arts rendering process comprises at least one of masking, separating to color channels, and applying mathematical actions on color channels including adding, subtracting, equalizing, indexing, multiplying, and inverting.
14. A method comprising:
processing a first image by a photogrammetric process, wherein the first image partially depicts an object, and wherein the photogrammetric process produces a first orthogonal image of the object;
processing one or more additional images by the photogrammetric process, wherein the one or more additional images depicts at least part of the object not depicted by the first image, and wherein the photogrammetric process produces one or more additional orthogonal images of the object; and
processing the first orthogonal image and the one or more additional orthogonal images by a graphic arts rendering process to produce a processed orthogonal two-dimensional image, wherein the graphic arts rendering process is operable to:
insert, for an area of the object not depicted by the first image, an indication of original texture of that area taken from the one or more additional orthogonal images, such that the indication is correctly located on the object and the object is more fully depicted; and
preserve at least a portion of detail related to stone surfaces of the object while partially or fully eliminating at least a portion of detail related to mortar joints of the object.
15. The method of claim 14 , wherein the processing the first image by the photogrammetric process and the processing the first orthogonal image by the graphic arts rendering process are performed autonomously by a computer.
16. The method of claim 14 , wherein the first image partially depicts an object because of an obstruction obscuring the object.
17. The method of claim 14 , wherein the first image comprises at least one of a photograph, stereo photograph, metric photograph, orthophotograph, rectified image, drawing, painting, print, film, color separation negative, and positive.
18. The method of claim 14 , wherein the photogrammetric processing comprises a rectification of the first image for at least one of a camera lens distortion, image receptor plane effect, optical effect, distortion due to image receptor plane variance, distortion of the first image, and damage of the first image.
19. The method of claim 14 , wherein the first image includes multiple planar faces of the object that are processed separately to achieve separate rectified images of more than one plane of the object.
20. The method of claim 14 , wherein the graphic arts rendering process comprises at least one of changing contrast, changing hue, changing saturation, changing color balance, converting to grayscale, finding edges (regions of change in texture or contrast or color), tracing, masking, separating to color channels, and applying mathematical actions on color channels including adding, subtracting, equalizing, indexing, multiplying, and inverting.
21. The method of claim 14 , wherein the graphic arts rendering process is operable to:
determine at least one of a midtone balance tonal threshold of the first image and a highlight balance tonal threshold of the first image; and
process original texture data by isolating the at least one midtone balance tonal threshold and highlight balance tonal threshold.
22. The method of claim 14 , wherein the graphic arts rendering process is operable to:
extract original texture data of the object from the first orthogonal image.
23. The method of claim 14 , wherein the graphic arts rendering process is operable to:
determine a shadow balance tonal threshold of the first image; and
process original texture data by isolating the at least one shadow balance tonal threshold.
24. A method performed on a computer for the production of photogrammetric renderings of an object from an image of the object, the method comprising:
processing the image by a photogrammetric process to produce a photogrammetric image; and
processing the photogrammetric image by a graphic arts rendering process to provide a processed two-dimensional image comprises a version in which texture detail related to stone surfaces on the object has been selectively removed while selectively enhancing texture detail related to mortar joints on the object, wherein the graphic arts rendering process:
processes original texture data of the object from the photogrammetric image to generate processed texture data that enhances one or more features of the stone surfaces on the object; and
generates the processed two-dimensional image by fabricating a rendering of the object that portrays the processed texture data and is based entirely on the original texture data.
25. The method of claim 24 , wherein the image comprises at least one of a photograph, stereo photograph, metric photograph, orthophotograph, rectified image, drawing, painting, print, film, color separation negative, and positive.
26. The method of claim 24 , wherein the photogrammetric processing comprises a rectification of the image for at least one of a camera lens distortion, image receptor plane effect, optical effect, distortion due to image receptor plane variance, distortion of the image, and damage of the image.
27. The method of claim 24 , wherein the image includes multiple planar faces of the object that are processed separately to achieve separate rectified images of more than one plane of the object.
28. The method of claim 24 , wherein a plurality of images are used during the photogrammetric process and the processing comprises:
separately correcting each individual image of the plurality of images to form a plurality of photogrammetrically-corrected images; and
joining the plurality of photogrammetrically-corrected images together into the photogrammetric image.
29. The method of claim 24 , wherein the graphic arts rendering process comprises at least one of changing contrast, changing hue, changing saturation, changing color balance, converting to grayscale, finding edges (regions of change in texture or contrast or color), and tracing.
30. The method of claim 24 , wherein the graphic arts rendering process comprises at least one of masking, separating to color channels, and applying mathematical actions on color channels including adding, subtracting, equalizing, indexing, multiplying, and inverting.
31. The method of claim 24 , wherein the photogrammetric process produces the photogrammetric image by generating an orthogonal version of the image.
32. The method of claim 24 , wherein the graphic arts rendering process:
determines at least one of a midtone balance tonal threshold of the image and a highlight balance tonal threshold of the image; and
processes the original texture data by isolating the at least one midtone balance tonal threshold and highlight balance tonal threshold.
33. The method of claim 24 , wherein the processed texture data comprises texture detail that is reproducible as one color art while still visually indicating the original texture detail.
34. The method of claim 24 , wherein the graphic arts rendering process:
extracts the original texture data of the object from the photogrammetric image.
35. The method of claim 24 , wherein the graphic arts rendering process:
determines a shadow balance tonal threshold of the image; and
processes the original texture data by isolating the at least one shadow balance tonal threshold.
36. The method of claim 24 , wherein the processing the image by the photogrammetric process and the processing the photogrammetric image by the graphic arts rendering process are performed autonomously by a computer.
37. A method comprising:
processing a first image by a photogrammetric process, wherein the first image partially depicts an object, and wherein the photogrammetric process produces a first orthogonal image of the object;
processing one or more additional images by the photogrammetric process, wherein the one or more additional images depicts at least part of the object not depicted by the first image, and wherein the photogrammetric process produces one or more additional orthogonal images of the object; and
processing the first orthogonal image and the one or more additional orthogonal images by a graphic arts rendering process to produce a processed orthogonal two-dimensional image, wherein the graphic arts rendering process is operable to:
insert, for an area of the object not depicted by the first image, an indication of original texture of that area taken from the one or more additional orthogonal images, such that the indication is correctly located on the object and the object is more fully depicted; and
preserve at least a portion of detail related to mortar joints of the object while partially or fully eliminating at least a portion of detail related to stone surfaces of the object.
38. The method of claim 37 , wherein the processing the first image by the photogrammetric process and the processing the first orthogonal image by the graphic arts rendering process are performed autonomously by a computer.
39. The method of claim 37 , wherein the first image partially depicts an object because of an obstruction obscuring the object.
40. The method of claim 37 , wherein the first image comprises at least one of a photograph, stereo photograph, metric photograph, orthophotograph, rectified image, drawing, painting, print, film, color separation negative, and positive.
41. The method of claim 37 , wherein the photogrammetric processing comprises a rectification of the first image for at least one of a camera lens distortion, image receptor plane effect, optical effect, distortion due to image receptor plane variance, distortion of the first image, and damage of the first image.
42. The method of claim 37 , wherein the first image includes multiple planar faces of the object that are processed separately to achieve separate rectified images of more than one plane of the object.
43. The method of claim 37 , wherein the graphic arts rendering process comprises at least one of changing contrast, changing hue, changing saturation, changing color balance, converting to grayscale, finding edges (regions of change in texture or contrast or color), tracing, masking, separating to color channels, and applying mathematical actions on color channels including adding, subtracting, equalizing, indexing, multiplying, and inverting.
44. The method of claim 37 , wherein the graphic arts rendering process is operable to:
determine at least one of a midtone balance tonal threshold of the first image and a highlight balance tonal threshold of the first image; and
process original texture data by isolating the at least one midtone balance tonal threshold and highlight balance tonal threshold.
45. The method of claim 37 , wherein the graphic arts rendering process is operable to:
extract original texture data of the object from the first orthogonal image.
46. The method of claim 37 , wherein the graphic arts rendering process is operable to:
determine a shadow balance tonal threshold of the first image; and
process original texture data by isolating the at least one shadow balance tonal threshold.
47. A method performed on a computer for the production of photogrammetric renderings of an object from an image of the object, the method comprising:
processing the image by a photogrammetric process to produce a photogrammetric image; and
processing the photogrammetric image by a graphic arts rendering process to provide a processed two-dimensional image, wherein the graphic arts rendering process:
processes original texture data of the object from the photogrammetric image to generate processed texture data that comprises less data than the original texture data but still conveys information related to an actual texture of the object;
preserves at least a portion of detail related to stone surfaces of the object while partially or fully eliminating at least a portion of detail related to mortar joints of the object; and
generates the processed two-dimensional image by fabricating a rendering of the object that portrays the processed texture data and is based entirely on the actual texture of the object.
48. The method of claim 47 , wherein the photogrammetric processing comprises a rectification of the image for at least one of a camera lens distortion, image receptor plane effect, optical effect, distortion due to image receptor plane variance, distortion of the image, and damage of the image.
49. The method of claim 47 , wherein a plurality of images are used during the photogrammetric process and the processing comprises:
separately correcting each individual image of the plurality of images to form a plurality of photogrammetrically-corrected images; and
joining the plurality of photogrammetrically-corrected images together into the photogrammetric image.
50. The method of claim 47 , wherein the graphic arts rendering process comprises at least one of changing contrast, changing hue, changing saturation, changing color balance, converting to grayscale, finding edges (regions of change in texture or contrast or color), tracing, masking, separating to color channels, and applying mathematical actions on color channels including adding, subtracting, equalizing, indexing, multiplying, and inverting.
51. The method of claim 47 , wherein the photogrammetric process produces the photogrammetric image by generating an orthogonal version of the image.
52. The method of claim 47 , wherein the graphic arts rendering process:
determines at least one of a midtone balance tonal threshold of the image and a highlight balance tonal threshold of the image; and
processes the original texture data by isolating the at least one midtone balance tonal threshold and highlight balance tonal threshold.
53. The method of claim 47 , wherein the processing the image by the photogrammetric process and the processing the photogrammetric image by the graphic arts rendering process are performed autonomously by a computer.
54. The method of claim 47 , wherein the graphic arts rendering process:
determines a shadow balance tonal threshold of the image; and
processes the original texture data by isolating the at least one shadow balance tonal threshold.
55. A method performed on a computer for the production of photogrammetric renderings of an object from an image of the object, the method comprising:
processing the image by a photogrammetric process to produce a photogrammetric image; and
processing the photogrammetric image by a graphic arts rendering process to provide a processed two-dimensional image, wherein the graphic arts rendering process:
processes original texture data of the object from the photogrammetric image to generate processed texture data that comprises less data than the original texture data but still conveys information related to an actual texture of the object;
preserves at least a portion of detail related to mortar joints of the object while partially or fully eliminating at least a portion of detail related to stone surfaces of the object; and
generates the processed two-dimensional image by fabricating a rendering of the object that portrays the processed texture data and is based entirely on the actual texture of the object.
56. The method of claim 55 , wherein the photogrammetric processing comprises a rectification of the image for at least one of a camera lens distortion, image receptor plane effect, optical effect, distortion due to image receptor plane variance, distortion of the image, and damage of the image.
57. The method of claim 55 , wherein a plurality of images are used during the photogrammetric process and the processing comprises:
separately correcting each individual image of the plurality of images to form a plurality of photogrammetrically-corrected images; and
joining the plurality of photogrammetrically-corrected images together into the photogrammetric image.
58. The method of claim 55 , wherein the graphic arts rendering process comprises at least one of changing contrast, changing hue, changing saturation, changing color balance, converting to grayscale, finding edges (regions of change in texture or contrast or color), tracing, masking, separating to color channels, and applying mathematical actions on color channels including adding, subtracting, equalizing, indexing, multiplying, and inverting.
59. The method of claim 55 , wherein the photogrammetric process produces the photogrammetric image by generating an orthogonal version of the image.
60. The method of claim 55 , wherein the graphic arts rendering process:
determines at least one of a midtone balance tonal threshold of the image and a highlight balance tonal threshold of the image; and
processes the original texture data by isolating the at least one midtone balance tonal threshold and highlight balance tonal threshold.
61. The method of claim 55 , wherein the processing the image by the photogrammetric process and the processing the photogrammetric image by the graphic arts rendering process are performed autonomously by a computer.
62. The method of claim 55 , wherein the graphic arts rendering process:
determines a shadow balance tonal threshold of the image; and
processes the original texture data by isolating the at least one shadow balance tonal threshold.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/800,159 US8194074B2 (en) | 2006-05-04 | 2007-05-04 | Systems and methods for photogrammetric rendering |
US13/476,703 US8542233B2 (en) | 2006-05-04 | 2012-05-21 | Systems and methods for photogrammetric rendering |
US14/034,333 US8866814B2 (en) | 2006-05-04 | 2013-09-23 | Systems and methods for photogrammetric rendering |
US14/495,712 US9715755B2 (en) | 2006-05-04 | 2014-09-24 | Systems and methods for photogrammetric rendering |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US79751106P | 2006-05-04 | 2006-05-04 | |
US11/800,159 US8194074B2 (en) | 2006-05-04 | 2007-05-04 | Systems and methods for photogrammetric rendering |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/476,703 Continuation US8542233B2 (en) | 2006-05-04 | 2012-05-21 | Systems and methods for photogrammetric rendering |
Publications (2)
Publication Number | Publication Date |
---|---|
US20070285420A1 US20070285420A1 (en) | 2007-12-13 |
US8194074B2 true US8194074B2 (en) | 2012-06-05 |
Family
ID=38821429
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/800,159 Active 2030-01-17 US8194074B2 (en) | 2006-05-04 | 2007-05-04 | Systems and methods for photogrammetric rendering |
US13/476,703 Active US8542233B2 (en) | 2006-05-04 | 2012-05-21 | Systems and methods for photogrammetric rendering |
US14/034,333 Active US8866814B2 (en) | 2006-05-04 | 2013-09-23 | Systems and methods for photogrammetric rendering |
US14/495,712 Active 2027-05-13 US9715755B2 (en) | 2006-05-04 | 2014-09-24 | Systems and methods for photogrammetric rendering |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/476,703 Active US8542233B2 (en) | 2006-05-04 | 2012-05-21 | Systems and methods for photogrammetric rendering |
US14/034,333 Active US8866814B2 (en) | 2006-05-04 | 2013-09-23 | Systems and methods for photogrammetric rendering |
US14/495,712 Active 2027-05-13 US9715755B2 (en) | 2006-05-04 | 2014-09-24 | Systems and methods for photogrammetric rendering |
Country Status (1)
Country | Link |
---|---|
US (4) | US8194074B2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110148866A1 (en) * | 2009-12-18 | 2011-06-23 | Electronics And Telecommunications Research Institute | Three-dimensional urban modeling apparatus and method |
Families Citing this family (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070046694A1 (en) * | 2005-08-24 | 2007-03-01 | Tamar Aizikowitz | System and method for image customization |
WO2009126173A1 (en) * | 2008-04-11 | 2009-10-15 | Military Wraps Research & Development | Immersive training scenario systems and related methods |
GB2461912A (en) * | 2008-07-17 | 2010-01-20 | Micron Technology Inc | Method and apparatus for dewarping and/or perspective correction of an image |
WO2011075076A1 (en) * | 2009-12-16 | 2011-06-23 | T-Data Systems (S) Pte Ltd | Method of converting digital data |
US9073259B2 (en) * | 2011-11-29 | 2015-07-07 | Xerox Corporation | Media-based system for forming three-dimensional objects |
WO2013116347A1 (en) * | 2012-01-31 | 2013-08-08 | Google Inc. | Method for improving speed and visual fidelity of multi-pose 3d renderings |
US10192347B2 (en) * | 2016-05-17 | 2019-01-29 | Vangogh Imaging, Inc. | 3D photogrammetry |
US10169894B2 (en) | 2016-10-06 | 2019-01-01 | International Business Machines Corporation | Rebuilding images based on historical image data |
US10380762B2 (en) | 2016-10-07 | 2019-08-13 | Vangogh Imaging, Inc. | Real-time remote collaboration and virtual presence using simultaneous localization and mapping to construct a 3D model and update a scene based on sparse data |
CN107031266B (en) * | 2017-05-26 | 2019-10-25 | 东莞市唯美陶瓷工业园有限公司 | A method of utilizing planar design documenting three-dimensional mold |
US10839585B2 (en) | 2018-01-05 | 2020-11-17 | Vangogh Imaging, Inc. | 4D hologram: real-time remote avatar creation and animation control |
US11080540B2 (en) | 2018-03-20 | 2021-08-03 | Vangogh Imaging, Inc. | 3D vision processing using an IP block |
US10810783B2 (en) | 2018-04-03 | 2020-10-20 | Vangogh Imaging, Inc. | Dynamic real-time texture alignment for 3D models |
US11170224B2 (en) | 2018-05-25 | 2021-11-09 | Vangogh Imaging, Inc. | Keyframe-based object scanning and tracking |
US11232633B2 (en) | 2019-05-06 | 2022-01-25 | Vangogh Imaging, Inc. | 3D object capture and object reconstruction using edge cloud computing resources |
US11170552B2 (en) | 2019-05-06 | 2021-11-09 | Vangogh Imaging, Inc. | Remote visualization of three-dimensional (3D) animation with synchronized voice in real-time |
US11335063B2 (en) | 2020-01-03 | 2022-05-17 | Vangogh Imaging, Inc. | Multiple maps for 3D object scanning and reconstruction |
CN112288661B (en) * | 2020-12-28 | 2021-04-09 | 成都索贝数码科技股份有限公司 | Image color correction method |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5485568A (en) * | 1993-10-08 | 1996-01-16 | Xerox Corporation | Structured image (Sl) format for describing complex color raster images |
US5790713A (en) * | 1992-06-17 | 1998-08-04 | Fujitsu Limited | Three-dimensional computer graphics image generator |
US5847712A (en) * | 1995-01-03 | 1998-12-08 | University Of Washington | Method and system for generating graphic illustrations according to a stroke texture and a tone |
US20030161530A1 (en) * | 1998-10-19 | 2003-08-28 | Osamu Yamada | Image processing apparatus and method, and recording medium |
US20040081363A1 (en) * | 2002-10-25 | 2004-04-29 | Eastman Kodak Company | Enhancing the tonal and spatial characteristics of digital images using selective spatial filters |
US20040170337A1 (en) * | 2003-02-28 | 2004-09-02 | Eastman Kodak Company | Method and system for enhancing portrait images that are processed in a batch mode |
US20050190991A1 (en) * | 2004-02-27 | 2005-09-01 | Intergraph Software Technologies Company | Forming a single image from overlapping images |
US20060291747A1 (en) * | 2000-09-08 | 2006-12-28 | Adobe Systems Incorporated, A Delaware Corporation | Merging images to form a panoramic image |
US7619663B2 (en) * | 2004-03-19 | 2009-11-17 | Casio Computer Co., Ltd. | Image processing apparatus for correcting distortion of image and image shooting apparatus for correcting distortion of shot image |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7256910B2 (en) * | 2002-04-23 | 2007-08-14 | Weyerhaeuser Company | Color separation method and printed product of the method |
US8560972B2 (en) * | 2004-08-10 | 2013-10-15 | Microsoft Corporation | Surface UI for gesture-based interaction |
-
2007
- 2007-05-04 US US11/800,159 patent/US8194074B2/en active Active
-
2012
- 2012-05-21 US US13/476,703 patent/US8542233B2/en active Active
-
2013
- 2013-09-23 US US14/034,333 patent/US8866814B2/en active Active
-
2014
- 2014-09-24 US US14/495,712 patent/US9715755B2/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5790713A (en) * | 1992-06-17 | 1998-08-04 | Fujitsu Limited | Three-dimensional computer graphics image generator |
US5485568A (en) * | 1993-10-08 | 1996-01-16 | Xerox Corporation | Structured image (Sl) format for describing complex color raster images |
US5847712A (en) * | 1995-01-03 | 1998-12-08 | University Of Washington | Method and system for generating graphic illustrations according to a stroke texture and a tone |
US20030161530A1 (en) * | 1998-10-19 | 2003-08-28 | Osamu Yamada | Image processing apparatus and method, and recording medium |
US20060291747A1 (en) * | 2000-09-08 | 2006-12-28 | Adobe Systems Incorporated, A Delaware Corporation | Merging images to form a panoramic image |
US20040081363A1 (en) * | 2002-10-25 | 2004-04-29 | Eastman Kodak Company | Enhancing the tonal and spatial characteristics of digital images using selective spatial filters |
US20040170337A1 (en) * | 2003-02-28 | 2004-09-02 | Eastman Kodak Company | Method and system for enhancing portrait images that are processed in a batch mode |
US20050190991A1 (en) * | 2004-02-27 | 2005-09-01 | Intergraph Software Technologies Company | Forming a single image from overlapping images |
US7619663B2 (en) * | 2004-03-19 | 2009-11-17 | Casio Computer Co., Ltd. | Image processing apparatus for correcting distortion of image and image shooting apparatus for correcting distortion of shot image |
Non-Patent Citations (8)
Title |
---|
C. Poullis et al., Photogrammetric modeling and image-based rendering for rapid virtual environment creation. Proceedings of ASC2004, 2004. * |
G. Pomaska, Automated processing of digital image data in architectural surveying. Porc. of ISPRS Commission V Symposium, Hakodate, Japan. International Archives of Photogrammetry and Remote Sensing, vol. 32, Part 5, 1998, pp. 637-642. * |
G. Pomaska, et al., Implementation of digital 3D-Models in building surveys based on multi image photogrammetry, International Archives of Photogrammetry and Remote Sensing XXXI (1996), pp. 487-492 Part B5. * |
P. Debevec, et al., Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach, University of California at Berkeley, Berkeley, CA, 1996. * |
Poulin, P. et al., Interactively Modeling with Photogrammetry, In Eurographics Workshop on Rendering, 1998. * |
S.B. Miller et al., A line of high performance digital photogrammetric workstations-synergy of General Dynamics, Helava Associates, and Leica, International Archives of Photogrammetry and Remote Sensing, Kyoto, Japan, vol. 29, Part B2, 1992, pp. 87-94. * |
S.B. Miller et al., A line of high performance digital photogrammetric workstations—synergy of General Dynamics, Helava Associates, and Leica, International Archives of Photogrammetry and Remote Sensing, Kyoto, Japan, vol. 29, Part B2, 1992, pp. 87-94. * |
Straforini, M. et al, The Recovery and Understanding of a Line Drawing from Indoor Scenes, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, No. 2, Feb. 1992. * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110148866A1 (en) * | 2009-12-18 | 2011-06-23 | Electronics And Telecommunications Research Institute | Three-dimensional urban modeling apparatus and method |
US8963943B2 (en) * | 2009-12-18 | 2015-02-24 | Electronics And Telecommunications Research Institute | Three-dimensional urban modeling apparatus and method |
Also Published As
Publication number | Publication date |
---|---|
US20140022597A1 (en) | 2014-01-23 |
US8866814B2 (en) | 2014-10-21 |
US20070285420A1 (en) | 2007-12-13 |
US8542233B2 (en) | 2013-09-24 |
US9715755B2 (en) | 2017-07-25 |
US20120229465A1 (en) | 2012-09-13 |
US20160098854A1 (en) | 2016-04-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9715755B2 (en) | Systems and methods for photogrammetric rendering | |
US7675647B2 (en) | Apparatus, method, and program for editing images | |
US8130238B2 (en) | Methods and files for delivering imagery with embedded data | |
Agarwala et al. | Photographing long scenes with multi-viewpoint panoramas | |
US6898316B2 (en) | Multiple image area detection in a digital image | |
US4970666A (en) | Computerized video imaging system for creating a realistic depiction of a simulated object in an actual environment | |
US5982999A (en) | Post card printing system, which orients multiple images symmetrically about a central point | |
US20120182403A1 (en) | Stereoscopic imaging | |
US20030063319A1 (en) | Image processing apparatus and method, computer program, and recording medium | |
US20050117215A1 (en) | Stereoscopic imaging | |
JPH0262671A (en) | Color editing processor | |
JP2001238177A (en) | Image processing method and image processing apparatus | |
Yamafune | Using computer vision photogrammetry (Agisoft Photoscan) to record and analyze underwater shipwreck sites | |
US20030169343A1 (en) | Method, apparatus, and program for processing images | |
Bryan et al. | Digital rectification techniques for architectural and archaeological presentation | |
JP6644966B2 (en) | Three-dimensional model creation device and three-dimensional model creation method | |
JP5241133B2 (en) | Method and apparatus for creating three-dimensional relief | |
Der Manuelian | Digital epigraphy: An approach to streamlining Egyptological epigraphic method | |
Cléry et al. | An ergonomic interface to compute 3D models using photogrammetry | |
US6826312B1 (en) | Method, apparatus, and recording medium for image processing | |
Cacho Toca et al. | New procedures for tracing Paleolithic rock paintings: digital photography | |
JP2004192401A (en) | Image processing apparatus, method and program | |
Malaperdas | Standards for Digitization in Cases of Maps, Documents, and other Relics in the Service of Cultural Heritage | |
CN117836810A (en) | Image processing and rendering method and system | |
WO2021117099A1 (en) | Image processing method, program, and image processing device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2552); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Year of fee payment: 8 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |