US20120124036A1 - Browsing related image search result sets - Google Patents
Browsing related image search result sets Download PDFInfo
- Publication number
- US20120124036A1 US20120124036A1 US12/947,603 US94760310A US2012124036A1 US 20120124036 A1 US20120124036 A1 US 20120124036A1 US 94760310 A US94760310 A US 94760310A US 2012124036 A1 US2012124036 A1 US 2012124036A1
- Authority
- US
- United States
- Prior art keywords
- results
- responsive
- display
- along
- query
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 39
- 238000013519 translation Methods 0.000 claims description 48
- 230000008569 process Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000007704 transition Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 238000012552 review Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
- G06F16/24578—Query processing with adaptation to user needs using ranking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/168—Details of user interfaces specifically adapted to file systems, e.g. browsing and visualisation, 2d or 3d GUIs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/35—Clustering; Classification
- G06F16/358—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/53—Querying
- G06F16/532—Query formulation, e.g. graphical querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/54—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9577—Optimising the visualization of content, e.g. distillation of HTML documents
Definitions
- methods and/or computer executable instructions embodied on computer readable media are provided for displaying image results responsive to a search query.
- responsive results are also provided for related queries.
- the results are ordered along a plurality of display axes, including at least one axis corresponding to the ordering of the various search queries.
- the results can be displayed in an aligned or non-aligned manner.
- the results can then be translated along one or more of the display axes to allow a user to browse the various results.
- FIG. 1 is a block diagram of an exemplary computing environment suitable for use in implementing embodiments of the present invention.
- FIG. 2 is a block diagram of an exemplary network environment suitable for use in implementing embodiments of the present invention.
- FIG. 3 schematically shows a display of ordered, aligned results according to an embodiment of the invention.
- FIG. 4 schematically shows a display of ordered results aligned along some display axes according to an embodiment of the invention.
- FIG. 5 schematically shows a display of ordered results during translation along a display axis according to an embodiment of the invention.
- FIG. 6 schematically shows a display of ordered, non-aligned results according to an embodiment of the invention.
- FIG. 7 schematically shows display of ordered, non-aligned results after translation along a display axis.
- FIG. 8 schematically shows additional user interface features for viewing selected images and maintaining a history of selected images.
- FIG. 9 schematically shows an alternative method for display of ordered, non-aligned results according to an embodiment of the invention.
- FIGS. 10-12 depict flow charts of various methods according to embodiments of the invention.
- image search results may be displayed in a manner similar to the display method for text based documents.
- An initial results page can provide a series of matching images, with the highest ranked image at the top of the page, and lower ranked images becoming available as the user scrolls to the bottom of the page and/or accesses subsequent pages of results.
- This type of conventional search display does not allow a user to modify the nature of the search while scrolling through the results. Instead, when a new search is submitted or a link for a suggested search is accessed, the current listing of images is replaced with a new listing. Additionally, the conventional presentation of results does not assist the user in viewing the results. The only organization provided is the ranking relative to the search request.
- methods and user interfaces are provided for organizing image search results.
- the image search results can be presented so that the user can transition from an initial set of search results to a related set of results by translating the results along one or more display axes. As a user continues to translate the results, results for additional related searches can be presented.
- some display axes can be used for organizing the search results based on an image feature.
- the user interface can provide some search results as representative results, with additional results being available after selecting a representative result. Selecting the representative result can allow the user to “zoom in” and access a second layer of results organized by display categories.
- the image search results can be presented to the user in a manner that automatically allows the viewer to browse the results. This can include translating the results into and out of the field of view of the user along an axis.
- the results can be organized in a non-aligned manner, so that results are grouped together without appearing to explicitly be in a standard column or row.
- the user can modify the speed and/or direction of translation to allow more detailed viewing of a particular result, or to more rapidly view and browse additional results.
- a “display axis” refers to one of a plurality of axes used for displaying search results.
- a common example of a plurality of display axes is the use of orthogonal axes, such as a horizontal axis and a vertical axis for organizing a square grid of results.
- the horizontal axis can be referred to as an “X” axis while the vertical axis is referred to as a “Y” axis.
- any convenient combination of axes in the plane of a display screen can be used, so axes that are rotated 45 degrees relative to the typical horizontal and vertical axes could equally be used.
- rectangular, rhomboid, and hexagonal grids could also be used.
- orthogonal axes are convenient for distinguishing between the display axes, strict orthogonality is not necessary.
- Axes that have an approximately orthogonal relationship can also be sufficient to allow a user to select one display axis for translation without causing translation along a second axis.
- the plurality of axes can be selected that represent three (optionally orthogonal or approximately orthogonal) axes for display. While a horizontal, vertical, and depth axis provide one convenient choice for three display axes, any other convenient combination of axes can also be used.
- the axes can be selected to provide display axes that correspond to an infinite cylinder.
- one axis represents a linear axis, such as a horizontal or vertical axis.
- the second axis can represent an angular axis that gives the appearance that the results are located on a curved cylinder.
- such an axis might be referred to by the variable “ ⁇ ”.
- the cylinder can be translated along the horizontal or vertical axis, or the cylinder can be rotated around the angular axis.
- results may not be displayed on a true cylinder, as the apparent angle of curvature may not literally correspond to the number of results available for display. (In other words, the number of results available for display does not have to be limited to the number that would fit on an actual cylinder having the same apparent radius.) Also, in the limiting case, a cylinder of nearly infinite radius would result in a viewing experience for the user that would not be distinguishable from having a horizontal or vertical axis as described above.
- orthogonal axes are often convenient choices, this is not required.
- a hexagonal grid can be used. This would result in three possible display axes in the viewing plane of a display screen.
- results can be ordered along a display axis. Ordering of results along a display axis refers to organizing the results based on some feature or property. For example, one display axis can be used to order results based on relevance to a given search query. In this situation, movement along one direction of the display axis will correspond to results with higher relevance, while moving in the opposite direction will correspond to results with lower relevance. Another option for ordering results along a display axis can be to order results based on related searches. In this situation, one set of results can correspond to the current search query. These results can be displayed centrally relative to the display axis. In either direction along the display axis, results that are responsive to related searches can be displayed. Still other options can include ordering results based on a feature of the image, such as ordering results based on whether the results are color versus black and white, or ordering based on the size of the image.
- image results that are ordered along a display axis may described as being displayed in an aligned or non-aligned manner.
- Results displayed in an aligned manner correspond to results that have some type of linear feature along the corresponding display axis.
- Alignment of results can be determined using any convenient metric. For example, results ordered along a vertical axis can be aligned based on alignment of the left edges of the images, the center-points of the images, the right edges of the images, or aligned based on any other convenient point in the images.
- results that are ordered along a display axis may be ordered in a non-aligned manner. For example, consider a group of images that are ordered in a non-aligned manner along a vertical axis based on relevance of the result to a search query. Based on the ordering, in this example results with a higher relevance will appear at a higher position along the vertical axis, while results with a lower relevance will appear at a lower position.
- the results will be confined within some horizontal region for display, but the boundaries for this region may not be visible on the display. Within the horizontal boundaries, the results can be displayed in any convenient horizontal location, so long as the appropriate vertical ordering is maintained.
- the non-aligned results may be located based on a pattern, such as a sinusoidal curve, or the horizontal location of the results may be random. However, the ordered results will lack a linear relationship between common points on the images.
- “translating” or “translation” of results refers to moving displayed results along one or more display axes. This will cause some new results to enter the field of view, while other results may be removed from the field of view.
- translation of results along a vertical display axis can cause some new results to appear at the top/bottom of a display screen, while other results exit the display screen from the bottom/top.
- For translation along a display axis into or out of the plane of a display screen (such as a “depth” display axis)
- translation can result in objects changing size.
- planes can also be defined in the “depth” direction beyond which an image is no longer displayed.
- one plane can correspond to a back plane, where images are considered too far away and therefore are no longer rendered.
- Another plane can be a front plane where images are considered to be too far forward for view, as if the viewer of the display device had walked past the image so that the image is behind the viewer.
- one or more display axes can be used to organize search results based on related searches.
- one display axis can be used for related searches, but a plurality of display axes can also be used.
- an initial search query is provided of “George Washington”. This generates a variety of image results, with the highest ranked results corresponding to images of the first U.S. president.
- related queries can be generated or identified by any convenient method. Two of the related queries can be selected for use. These selected related queries can be ordered along the horizontal axis, typically on either side of the initial query. The selected related queries can be the highest ranked related queries, or any other convenient method can be used for selecting the related queries. The related queries can be used to generate responsive image results. These results are displayed on either side of the results for the initial query. In this example, the related search queries can lead to display of results responsive to “Martha Washington” to the right along the horizontal axis and results responsive to “John Adams” displayed to the left.
- FIG. 3 schematically shows a possible representation of the above example.
- three columns of results are presented.
- the middle column corresponds to the current search query 310 of “George Washington.”
- three representative results 312 , 313 , and 314 are schematically shown.
- the vertical axis in this example corresponds to relevance of the search results to the query. Any convenient number of results can be displayed in the viewing area at one time. Depending on the size of the display screen and the size of the images, the number of results displayed along an axis can be at least one, or at least 3, or at least 5, or at least 7, or any other convenient number. In this example, additional responsive results beyond the initially displayed results are available by translating the results along the vertical axis.
- the left and right columns correspond to related search query 320 for “John Adams” and related search query 330 for “Martha Washington”. These columns show representative results 322 - 324 and 332 - 334 .
- additional results for queries 320 and 330 are also available by translating along the vertical display axis.
- the displayed image results have been scaled so that each displayed result has the same width.
- the results have then been aligned in the vertical direction based on the left edge of the displayed images.
- the right edge of the image, center of the image, or any other location in the images could have been used instead.
- the displayed images are also aligned along the horizontal direction by aligning the bottom edge of images.
- the example in FIG. 3 provides an ordered representation for the displayed images that is aligned along both display axes.
- FIG. 4 schematically shows an alternative format for displaying image results.
- the same searches 310 , 320 , and 33 are shown in FIG. 4 .
- the responsive results are also the same, and the alignment of the results along the horizontal axis has been maintained.
- FIG. 4 shows an embodiment where the results are not aligned along the vertical axis. Instead, the images in each column are ordered, but the horizontal location within the column can be any convenient location. The scaling requirement of the images has also been removed, so that the images may each have any size that is convenient for display.
- the boundaries for display of results along a non-aligned axis can be selected in any convenient manner.
- the boundaries 417 and 418 for display of the “George Washington” column are distinct from the boundaries for display 427 and 438 for the adjacent related search columns.
- Another option can be to have shared boundaries, so that boundary 418 and boundary 427 would be in the same location.
- boundary 418 could be the right hand boundary for the “John Adams” results while boundary 427 could be the left hand boundary for the “George Washington” results.
- the overlap in display areas for results may help in giving the feel of a smooth transition from one set of results to another.
- a user may decide that the image results for “John Adams” look interesting.
- the user can translate the results along the horizontal axis so that the results for John Adams become the central query. This leads to several changes in the display.
- the results for John Adams are moved to the center, the results for George Washington become the related search to the right while the results for Martha Washington are moved off of the page.
- the fact that Martha was originally displayed can be tracked, so that the user can always return to a previously viewed display.
- the John Adams results move to the center another related search also becomes visible. In this example, the highest ranked related search is George Washington. However, that result has already been selected for display during this session.
- FIG. 5 schematically shows the translation along the horizontal axis to change the central search.
- FIG. 5 is based on the aligned result display shown in FIG. 3 .
- the translation has moved the “John Adams” part of the way toward being the central search query.
- the results 542 - 544 for the “Thomas Jefferson” related query 540 are partially visible while the results for the “Martha Washington” related query 330 are leaving the viewing area. Note that there is no requirement that the “John Adams” result is moved fully to the central position.
- the user can stop the translation. Alternatively, the user can modify the rate of translation to move more quickly or more slowly through the results.
- the user can continue to receive new related search results. In embodiments where previously selected related searches are excluded, this can lead to a seemingly infinite browsing experience. For example, translating the results to make Thomas Jefferson the central search query could result in an adjacent related search of “U.S. historical documents”. As noted above, the history of related searches can also be tracked. In an embodiment where the history of related searches is tracked, translating the view back to “George Washington” would also bring the related search of “Martha Washington” back into the display view.
- a user may be interested generally in related searches, but the particular related searches provided may not be of interest.
- a user can choose to have one or both displayed related searches replaced with alternative related searches. For example, replacing both related searches could lead to the new related search “Revolutionary War” appearing to the left on the horizontal display axis while “George Washington Carver” appears to the right. This can be repeated as desired, until the user receives related search queries of interest. If a user requested new related searches, depending on the user settings, the search queries for “John Adams” and “Martha Washington” can be excluded from being used as related searches, or they can now appear in the related search chain if they are they are identified as the next related search query.
- a user can also provide a new main search query at any time. Related searches based on the new search query can then be provided. The user can be given an option to exclude previously viewed search queries from being selected as a related query to the new search query, or a default behavior can be chosen by the system.
- Another potential variation can be to have a one or more default or recommended initial search queries.
- a museum may provide initial search queries based on the current contents of the museum collection.
- the related queries could optionally be defined in advance for each query. This would allow a user of the museum search to be able to scroll through the museum collection in an ordered manner without having to know anything about the collection. The user can simply select an initial query of interest and start browsing.
- Still another option can be to allow the user to modify a search query by selecting an image.
- each image can have a search query associated with the image.
- the user can optionally indicate an interest in more images similar to the selected image.
- the search query associated with the image can then be used as a new initial query.
- one or more display axes can be based on a characteristic or feature of the image results.
- image features for ordering the display of the images can include the size of the image; whether the image is color or black and white; the brightness or color characteristics of the image; a date associated with the image; or any other convenient characteristic of the image. Images ordered along a display axis based on a feature may be aligned or non-aligned.
- the display axes for an image feature may be finite.
- a display axis for color versus black and white images may be small enough to have the entire display axis on the display screen.
- the amount of translation available for a display axis can be as much or as little as is convenient for displaying the associated images.
- relevance of an image to a search query can also be used as a display axis for ordering the images.
- the images can be ordered along a display axis based on relevance such that the initial display to the user includes the most relevant images for the search query.
- a display axis for ordering search results by relevance may also be limited in the amount of translation that is possible. Since the display may start with the most relevant results being visible, initially it may only be possible to translate along the relevance display axis in one direction.
- ordering images along display axes based on features can be a second level of display after an initial image has been selected. For example, consider a situation where an initial search is displayed with two display axes for related searches. In this type of configuration, a limited number of images can be displayed associated with each search or related search. Selecting an image can identify a search or related search for an expanded display. This expanded display can provide additional images for the query corresponding to the selected image, and the images can be ordered along one or more display axes based on the features or characteristics of the images.
- image results When image results are displayed to a user, one option is to provide a static initial view and then allow translation of the results along one or more of the display axes based on user input.
- image results can be automatically translated along one or more of the display axes for viewing by the user.
- the automatic translation of image results can begin when results are displayed, or the automatic translation can be activated during review of results by the user.
- the user can provide input to set the rate of translation along each display axis, or a translation rate can be selected automatically.
- the automatic translation process can be guided in any convenient manner.
- the direction for automatic translation can be guided in part by a random process, or by a process based on stored navigational histories of a current user, or by a process based on stored navigational histories of a plurality or group of users, or by relevance, or by a process based on another convenient factor.
- Still another option can be to use a combination of two or more types of processes to guide the navigation for automatic translation.
- a user may identify an image of interest. Based on user input, one or more actions may be performed when an image is selected. The automatic translation of images may be stopped or slowed when an image is selected. The user can be provided with a larger view of the image and/or additional information about the image. Optionally, the user can submit a new search query based on keywords associated with the image. The selected image can also be added to a library or collection of images selected by the user. The library of selected images can provide the user a convenient way to return to images of interest after the images are no longer in view on the display.
- FIGS. 6-9 provide another example of display of image results according to various embodiments of the invention.
- results are ordered along three display axes.
- a horizontal display axis is used for ordering results based on search query.
- the vertical axis is used for ordering results based on the size of the image.
- the “depth” axis into and out of the plane of the display screen is used for ordering based on relevance of a result to a query.
- FIG. 6 provides the initial view based on a received search query 610 of “George Washington”.
- the results are not aligned along any of the display axes. Instead, the results 612 - 614 are randomly scattered in a manner otherwise consistent with the ordering along each display axis.
- the results 622 - 624 responsive to query 620 and results 632 - 634 responsive to query 630 are similarly scattered. Qualitatively, this can give the viewer a feeling of object suspended in a medium that can flow through the viewer's field of vision.
- the highest ranked results 612 , 622 , and 632 are displayed as the closest objects in the field of view.
- the next few lower ranked images are smaller as the objects appear to recede into the page.
- images are organized based on the actual size of the image.
- the highest ranked image results 632 - 634 for “Martha Washington” query 630 have a similar size in this example.
- FIG. 7 schematically shows the display of results after some translation of the results has occurred along the “depth” display axis.
- the two highest ranked results for the center search and the related searches have passed beyond the viewing plane. This leaves images 714 , 724 , and 734 as the highest ranked displayed images. These images also have the largest display size at this time. New images 716 - 717 , 726 - 727 , and 736 - 737 have also come into view as lower ranked results that are visible due to translation along the “depth” display axis.
- the user identifies image 726 as being of interest. In the embodiment shown in FIG. 8 , this causes the automatic translation to stop while the user reviews the selected image. This also adds the selected image to a library 860 of selected images.
- the user can be presented with a larger view 865 of the selected image, as well as additional information 867 about the image.
- the larger image view 865 and additional information 867 can be presented as an overlay to the image results, or they can optionally be displayed in a separate window 870 .
- FIG. 9 schematically shows a variation for how to display results.
- FIG. 9 is generally similar to the display in FIG. 6 .
- the relationship between the center search query and the related search queries is modified.
- the ordering of results along the horizontal axis indicates not only which search query a result is associated with, but also how the result is ranked in relation to one of the related queries.
- result 633 was the second highest ranked result for “Martha Washington”.
- result 633 is shown roughly halfway between the query for “George Washington” and “Martha Washington”. In the embodiment shown in FIG. 9 , this indicates that result 633 also has a high ranking in response to the “George Washington” query.
- result 612 is not considered responsive to either the “John Adams” query or the “Martha Washington” query.
- result 612 is shown as being centrally located under the “George Washington” query.
- another way to attempt to smooth the transition between the results for two adjacent queries would be to explicitly generate results for a search query that is based on a pair of adjacent queries.
- a combined query of “John Adams and George Washington” or “Martha Washington and George Washington” could be used to generate responsive image results.
- results for a combined query can be shown between the explicitly identified center query and the related query.
- Still another option can be to use both horizontal positioning and explicit combined queries to provide a smooth transition from an initial query such as “George Washington” to a related query such as “Martha Washington”.
- Any convenient set of controls can be provided to allow a user to translate along the various display axes.
- One option can be to provide keyboard based controls.
- the arrow keys on a keyboard can be used to increase or decrease speed in the plane of the display screen, while the “plus” and “minus” keys can modify the speed of translation along the depth display axis.
- a key such as the space bar could be used to stop all motion.
- Another option could be to use a combination of mouse movement and clicks of mouse buttons. Still other options could be based on touch screen interactions by a user.
- computing device 100 is but one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computing device 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated.
- Embodiments of the invention may be described in the general context of computer code or machine-useable instructions, including computer-executable instructions such as program modules, being executed by a computer or other machine, such as a personal data assistant or other handheld device.
- program modules including routines, programs, objects, components, data structures, applications, etc., refer to code that perform particular tasks or implement particular abstract data types.
- the invention may be practiced in a variety of system configurations, including hand-held devices, consumer electronics, general-purpose computers, more specialty computing devices, and the like.
- the invention may also be practiced in distributed computing environments where tasks are performed by remote-processing devices that are linked through a communications network.
- computing device 100 includes a bus 110 that directly or indirectly couples the following devices: memory 112 , one or more processors 114 , one or more presentation components 116 , input/output (I/O) ports 118 , I/O components 120 , and an illustrative power supply 122 .
- Bus 110 represents what may be one or more busses (such as an address bus, data bus, or combination thereof).
- FIG. 1 is merely illustrative of an exemplary computing device that can be used in connection with one or more embodiments of the present invention. Distinction is not made between such categories as “workstation,” “server,” “laptop,” “hand-held device,” etc., as all are contemplated within the scope of FIG. 1 and reference to “computing device.”
- the computing device 100 typically includes a variety of computer-readable media.
- Computer-readable media can be any available media that can be accessed by computing device 100 and includes both volatile and nonvolatile media, removable and non-removable media.
- Computer-readable media may comprise computer storage media and communication media.
- Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data.
- Computer storage media includes, but is not limited to, Random Access Memory (RAM), Read Only Memory (ROM), Electronically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other holographic memory, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, carrier wave, or any other medium that can be used to encode desired information and which can be accessed by the computing device 100 .
- the computer storage media can be selected from tangible computer storage media.
- the computer storage media can be selected from non-transitory computer storage media.
- the memory 112 includes computer-storage media in the form of volatile and/or nonvolatile memory.
- the memory may be removable, non-removable, or a combination thereof.
- Exemplary hardware devices include solid-state memory, hard drives, optical-disc drives, etc.
- the computing device 100 includes one or more processors that read data from various entities such as the memory 112 or the I/O components 120 .
- the presentation component(s) 116 present data indications to a user or other device.
- Exemplary presentation components include a display device, speaker, printing component, vibrating component, and the like.
- the I/O ports 118 allow the computing device 100 to be logically coupled to other devices including the I/O components 120 , some of which may be built in.
- Illustrative components include a microphone, joystick, game pad, satellite dish, scanner, printer, wireless device, etc.
- FIG. 2 a block diagram is illustrated, in accordance with an embodiment of the present invention, showing an exemplary computing system and/or network environment 200 .
- the computing system 200 shown in FIG. 2 is merely an example of one suitable computing system environment and is not intended to suggest any limitation as to the scope of use or functionality of embodiments of the present invention. Neither should the computing system 200 be interpreted as having any dependency or requirement related to any single component or combination of components illustrated therein. Further, the computing system 200 may be provided as a stand-alone product, as part of a software development environment, or any combination thereof.
- the computing system 200 includes a user device 206 , a search engine or search service 205 , and an image ordering and display component 208 , all in communication with one another via a network 204 and/or via location on a common device.
- the network may include, without limitation, one or more local area networks (LANs) and/or wide area networks (WANs).
- LANs local area networks
- WANs wide area networks
- Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet. Accordingly, the network 204 is not further described herein.
- Each of the user device 206 , search engine 205 , and image ordering and display component 208 shown in FIG. 2 may be any type of computing device, such as, for example, computing device 200 described above with reference to FIG. 2 .
- each of the user device 206 , search engine 205 , and image ordering and display component 208 may be a personal computer, desktop computer, laptop computer, handheld device, mobile handset, consumer electronic device, and the like.
- the user device 206 may further include a keyboard, keypad, stylus, joystick, and any other input-initiating component that allows a user to provide wired or wireless data to the network 204 , e.g., verification inquires, web page addresses, and the like.
- the present invention is not limited to implementation on such computing devices, but may be implemented on any of a variety of different types of computing devices within the scope of embodiments hereof.
- search engine or service 205 can identify responsive results.
- Image ordering and display component 208 can then order the responsive image results and provide a display view for user device 206 in accordance with various embodiments of the invention.
- FIG. 10 depicts a flow chart showing a method according to an embodiment of the invention.
- a plurality of search queries and corresponding responsive image results are ordered 1010 along a first display axis.
- the responsive image results are also ordered 1020 along a second display axis.
- the ordering along the second display axis can be based on, for example, a ranking of the results relative to the corresponding query, or an image feature, or another characteristic. If the ordering is based on an image feature, the image feature can be the size of the image, whether the image is color or black and white, a date associated with the image feature, or any other convenient image feature.
- a portion of the responsive results are displayed 1030 based on the ordering of the results along the display axes.
- An additional query related to at least one of the plurality of search queries is identified 1040 , along with corresponding additional results responsive to the additional query.
- the additional query and the additional results are ordered 1050 along the first display axis.
- the additional query will be ordered to be adjacent to the query that it is related to in the plurality of queries.
- the plurality of queries and corresponding responsive image results are translated 1060 along the first display axis. This results in removing one of the plurality of queries from display. The translation also creates space in the display view, and this space can be used to display 1070 the additional query and corresponding additional results.
- FIG. 11 depicts a flow chart showing a method according to another embodiment of the invention.
- a plurality of search queries and corresponding responsive image results are ordered 1110 along a first display axis.
- the responsive image results are also ordered 1120 along a second display axis.
- This second display axis is approximately orthogonal to the viewing plane of the display device.
- the ordering along the second display axis can be based on, for example, a ranking of the results relative to the corresponding query, or an image feature, or another characteristic. If the ordering is based on an image feature, the image feature can be the size of the image, whether the image is color or black and white, a date associated with the image feature, or any other convenient image feature.
- the responsive image results are also ordered 1130 along a third display axis. A portion of the responsive results are displayed 1140 based on the ordering of the results along the display axes.
- the responsive image results are translated 1150 along at least the second display axis. This results in removing a first plurality of responsive results from display.
- the translation also creates space in the display view, and this space can be used to display 1160 a second plurality of results.
- FIG. 12 depicts a flow chart showing a method according to another embodiment of the invention.
- a plurality of search queries and corresponding responsive image results are ordered 1210 along a first display axis.
- the responsive image results are also ordered 1220 along a second display axis. This second display axis is approximately orthogonal to the first display axis.
- the responsive image results are also ordered 1230 along a third display axis based on an image feature.
- the third display axis is approximately orthogonal to the first and second display axes.
- a portion of the responsive results are displayed 1240 based on the ordering of the results along the display axes.
- the results are ordered along at least two of the display axes in a non-aligned manner.
- the responsive image results are automatically translated 1250 along one or more of the display axes. This results in removing a first plurality of responsive results from display.
- the translation also creates space in the display view, and this space can be used to display 1260 a second plurality of results.
- one or more computer-storage media storing computer-useable instructions are provided that, when executed by a computing device, perform a method for displaying image results.
- the method includes ordering a plurality of search queries and corresponding responsive image results along a first display axis; ordering the responsive image results along a second display axis; displaying at least a portion of the responsive results based on the ordering along the first and second display axes; identifying an additional query related to at least one of the plurality of search queries and a corresponding plurality of additional responsive image results; adding the additional query and the corresponding additional responsive image results to the ordering of search queries along the first display axis; translating the plurality of queries and the corresponding responsive image results along the first display axis, the translation resulting in removing one of the plurality of queries from display; and displaying the additional query and the corresponding additional responsive image results.
- a method for displaying image results includes ordering a plurality of search queries and corresponding responsive image results along a first display axis; ordering the responsive image results along a second display axis, the second display axis being approximately orthogonal to a viewing plane of a display device; ordering the responsive results along a third display axis; displaying at least a portion of the responsive results based on the ordering along the first, second, and third display axes; translating the responsive results along at least the second display axis, the translation resulting in removing a first plurality of responsive results from display; and displaying of a second plurality of responsive results.
- one or more computer-storage media storing computer-useable instructions are provided that, when executed by a computing device, perform a method for displaying image results.
- the method includes ordering a plurality of search queries and corresponding responsive search results along a first display axis; ordering image results responsive to the plurality of queries along a second display axis, the second display axis being approximately orthogonal to the first display axis; ordering the responsive results along a third display axis, the third display axis being approximately orthogonal to the first display axis and the second display axis; displaying at least a portion of the responsive results based on the ordering along the first, second, and third display axes; automatically translating the responsive results along one or more of the display axes, the translation resulting in removing a first plurality of results from display; and displaying a second plurality of responsive results, wherein the responsive results are ordered in a non-aligned manner along at least two display axes.
- a first embodiment can provide one or more computer storage media storing computer-useable instructions that, when executed by a computing device, perform a method for displaying image results.
- the method can include ordering a plurality of search queries and corresponding responsive image results along a first display axis; ordering the responsive image results along a second display axis; displaying at least a portion of the responsive results based on the ordering along the first and second display axes; identifying an additional query related to at least one of the plurality of search queries and a corresponding plurality of additional responsive image results, the additional query being different from the queries in the query history; adding the additional query and the corresponding additional responsive image results to the ordering of search queries along the first display axis; translating the plurality of queries and the corresponding responsive image results along the first display axis, the translation resulting in removing one of the plurality of queries from display; and displaying the additional query and the corresponding additional responsive image results.
- a query history retains the ordering of queries along the first display axis for queries in the query history
- identifying an additional query related to at least one of the plurality of search queries comprises identifying an additional query that is different from the plurality of search queries stored in the query history
- translating the responsive results along the first display axis comprises automatically translating the responsive results along the first display axis.
- computer storage media according to any of the above embodiments are provided, further comprising: translating, after display of the additional query, the currently displayed queries and corresponding responsive results along the first display axis, the translation resulting in removing the additional query from display; and displaying the plurality of queries and corresponding responsive results.
- one or more computer storage media storing computer-useable instructions are provided that, when executed by a computing device, perform a method for displaying image results.
- the method can include ordering a plurality of search queries and corresponding responsive search results along a first display axis; ordering image results responsive to the plurality of queries along a second display axis, the second display axis being approximately orthogonal to the first display axis; ordering the responsive results along a third display axis, the ordering optionally being based on an image feature, the third display axis being approximately orthogonal to the first display axis and the second display axis; displaying at least a portion of the responsive results based on the ordering along the first, second, and third display axes; translating the responsive results along at least the second display axis, the translation resulting in removing a first plurality of results from display; and displaying a second plurality of responsive results.
- translating the responsive results along one or more display axes comprises automatically translating the responsive results along at least the second display axis.
- computer storage media according to the fifth or sixth embodiment are provided, wherein the second plurality of responsive results comprises results with a ranking relative to the corresponding query that is lower than the ranking of results in the first plurality of responsive results.
- computer storage media according to any of the above embodiments are provided, wherein the responsive results are ordered along the second display axis in a non-aligned manner.
- computer storage media according to the eighth embodiment are provided, wherein the non-aligned responsive results are positioned along the first axis to reflect a ranking relative to an adjacent query.
- computer storage media according to any of the above embodiments are provided, further comprising: identifying an intermediate query for a pair of queries in the ordered queries along the first display axis, the intermediate query being based on the pair of queries; obtaining results responsive to the intermediate query; and displaying the results responsive to the intermediate query between the results for the pair of queries.
- translating the responsive results comprises translating the responsive results along at least two display axes.
- computer storage media according to any of the above embodiments are provided, wherein the responsive results are ordered in a non-aligned manner along at least two display axes.
- computer storage media according to the first embodiment are provided, further comprising ordering the responsive results along a third display axis based on an image feature.
- computer storage media according to any of the above embodiments are provided, wherein the responsive results are ordered along the second axis based on a ranking of the results relative to the corresponding query.
- computer storage media according to any of the above embodiments are provided, wherein the second display axis is approximately orthogonal to a viewing plane of a display device.
Abstract
Description
- Early search techniques for network documents focused primarily on text-based documents that could be identified by a keyword. More recently, searches for images located on a device or a network are becoming increasingly popular. As network and/or processor speeds increase while the cost of storage decreases, the number of images available for retrieval by a search will continue to grow.
- In various embodiments, methods and/or computer executable instructions embodied on computer readable media are provided for displaying image results responsive to a search query. In addition to displaying responsive results for a query, responsive results are also provided for related queries. The results are ordered along a plurality of display axes, including at least one axis corresponding to the ordering of the various search queries. The results can be displayed in an aligned or non-aligned manner. The results can then be translated along one or more of the display axes to allow a user to browse the various results.
- This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid, in isolation, in determining the scope of the claimed subject matter.
- The invention is described in detail below with reference to the attached drawing figures, wherein:
-
FIG. 1 is a block diagram of an exemplary computing environment suitable for use in implementing embodiments of the present invention. -
FIG. 2 is a block diagram of an exemplary network environment suitable for use in implementing embodiments of the present invention. -
FIG. 3 schematically shows a display of ordered, aligned results according to an embodiment of the invention. -
FIG. 4 schematically shows a display of ordered results aligned along some display axes according to an embodiment of the invention. -
FIG. 5 schematically shows a display of ordered results during translation along a display axis according to an embodiment of the invention. -
FIG. 6 schematically shows a display of ordered, non-aligned results according to an embodiment of the invention. -
FIG. 7 schematically shows display of ordered, non-aligned results after translation along a display axis. -
FIG. 8 schematically shows additional user interface features for viewing selected images and maintaining a history of selected images. -
FIG. 9 schematically shows an alternative method for display of ordered, non-aligned results according to an embodiment of the invention. -
FIGS. 10-12 depict flow charts of various methods according to embodiments of the invention. - For an image search based on conventional techniques, image search results may be displayed in a manner similar to the display method for text based documents. An initial results page can provide a series of matching images, with the highest ranked image at the top of the page, and lower ranked images becoming available as the user scrolls to the bottom of the page and/or accesses subsequent pages of results. This type of conventional search display does not allow a user to modify the nature of the search while scrolling through the results. Instead, when a new search is submitted or a link for a suggested search is accessed, the current listing of images is replaced with a new listing. Additionally, the conventional presentation of results does not assist the user in viewing the results. The only organization provided is the ranking relative to the search request.
- In various embodiments, methods and user interfaces are provided for organizing image search results. The image search results can be presented so that the user can transition from an initial set of search results to a related set of results by translating the results along one or more display axes. As a user continues to translate the results, results for additional related searches can be presented. Optionally, some display axes can be used for organizing the search results based on an image feature. To increase the number of dimensions or axes available, in some embodiments the user interface can provide some search results as representative results, with additional results being available after selecting a representative result. Selecting the representative result can allow the user to “zoom in” and access a second layer of results organized by display categories.
- In some embodiments, the image search results can be presented to the user in a manner that automatically allows the viewer to browse the results. This can include translating the results into and out of the field of view of the user along an axis. Optionally, the results can be organized in a non-aligned manner, so that results are grouped together without appearing to explicitly be in a standard column or row. The user can modify the speed and/or direction of translation to allow more detailed viewing of a particular result, or to more rapidly view and browse additional results.
- In the discussion below, a “display axis” refers to one of a plurality of axes used for displaying search results. A common example of a plurality of display axes is the use of orthogonal axes, such as a horizontal axis and a vertical axis for organizing a square grid of results. Sometimes the horizontal axis can be referred to as an “X” axis while the vertical axis is referred to as a “Y” axis. However, any convenient combination of axes in the plane of a display screen can be used, so axes that are rotated 45 degrees relative to the typical horizontal and vertical axes could equally be used. More generally, in two dimensions rectangular, rhomboid, and hexagonal grids could also be used. Note that while orthogonal axes are convenient for distinguishing between the display axes, strict orthogonality is not necessary. Axes that have an approximately orthogonal relationship can also be sufficient to allow a user to select one display axis for translation without causing translation along a second axis.
- Although current display technology is typically a two-dimensional screen, techniques are well known for giving the appearance of a third dimension of depth into the display screen. An appearance of a third dimension can be generated, for example, by controlling the size of objects displayed and use of “perspective” techniques. This apparent third dimension can, for example, be a dimension that appears to have an axis that is approximately orthogonal to the viewing plane of a display device. In the discussion below, display axes that make use of this apparent third dimension will be referred to in the same manner as display axes that only make use of the dimensions in the viewing plane of the display device. Thus, in some embodiments, the plurality of axes can be selected that represent three (optionally orthogonal or approximately orthogonal) axes for display. While a horizontal, vertical, and depth axis provide one convenient choice for three display axes, any other convenient combination of axes can also be used.
- Use of the apparent depth in the display can also be used to generate alternative display axes. For example, the axes can be selected to provide display axes that correspond to an infinite cylinder. In this type of coordinates, one axis represents a linear axis, such as a horizontal or vertical axis. The second axis can represent an angular axis that gives the appearance that the results are located on a curved cylinder. In a mathematics textbook, such an axis might be referred to by the variable “θ”. In order to view more results, the cylinder can be translated along the horizontal or vertical axis, or the cylinder can be rotated around the angular axis. Note that the results may not be displayed on a true cylinder, as the apparent angle of curvature may not literally correspond to the number of results available for display. (In other words, the number of results available for display does not have to be limited to the number that would fit on an actual cylinder having the same apparent radius.) Also, in the limiting case, a cylinder of nearly infinite radius would result in a viewing experience for the user that would not be distinguishable from having a horizontal or vertical axis as described above.
- Although orthogonal axes are often convenient choices, this is not required. For example, a hexagonal grid can be used. This would result in three possible display axes in the viewing plane of a display screen.
- In the discussion below, results can be ordered along a display axis. Ordering of results along a display axis refers to organizing the results based on some feature or property. For example, one display axis can be used to order results based on relevance to a given search query. In this situation, movement along one direction of the display axis will correspond to results with higher relevance, while moving in the opposite direction will correspond to results with lower relevance. Another option for ordering results along a display axis can be to order results based on related searches. In this situation, one set of results can correspond to the current search query. These results can be displayed centrally relative to the display axis. In either direction along the display axis, results that are responsive to related searches can be displayed. Still other options can include ordering results based on a feature of the image, such as ordering results based on whether the results are color versus black and white, or ordering based on the size of the image.
- In the discussion below, image results that are ordered along a display axis may described as being displayed in an aligned or non-aligned manner. Results displayed in an aligned manner correspond to results that have some type of linear feature along the corresponding display axis. For example, consider a typical grid of thumbnail images ordered along the horizontal and vertical axes of a display screen, where each thumbnail has the same size. In this situation, the thumbnails in the grid are likely to be aligned along both the horizontal and vertical display axes, as some type of common point in each thumbnail will form a line along the corresponding axis. Alignment of results can be determined using any convenient metric. For example, results ordered along a vertical axis can be aligned based on alignment of the left edges of the images, the center-points of the images, the right edges of the images, or aligned based on any other convenient point in the images.
- Alternatively, results that are ordered along a display axis may be ordered in a non-aligned manner. For example, consider a group of images that are ordered in a non-aligned manner along a vertical axis based on relevance of the result to a search query. Based on the ordering, in this example results with a higher relevance will appear at a higher position along the vertical axis, while results with a lower relevance will appear at a lower position. The results will be confined within some horizontal region for display, but the boundaries for this region may not be visible on the display. Within the horizontal boundaries, the results can be displayed in any convenient horizontal location, so long as the appropriate vertical ordering is maintained. Within the boundaries, the non-aligned results may be located based on a pattern, such as a sinusoidal curve, or the horizontal location of the results may be random. However, the ordered results will lack a linear relationship between common points on the images.
- In the discussion below, “translating” or “translation” of results refers to moving displayed results along one or more display axes. This will cause some new results to enter the field of view, while other results may be removed from the field of view. For example, translation of results along a vertical display axis can cause some new results to appear at the top/bottom of a display screen, while other results exit the display screen from the bottom/top. For translation along a display axis into or out of the plane of a display screen (such as a “depth” display axis), translation can result in objects changing size. For translation into or out of the plane of the display screen, planes can also be defined in the “depth” direction beyond which an image is no longer displayed. For example, one plane can correspond to a back plane, where images are considered too far away and therefore are no longer rendered. Another plane can be a front plane where images are considered to be too far forward for view, as if the viewer of the display device had walked past the image so that the image is behind the viewer.
- In various embodiments, one or more display axes can be used to organize search results based on related searches. In many situations, one display axis can be used for related searches, but a plurality of display axes can also be used. As an example, consider a situation where a horizontal display axis is used to provide related searches. In this example, an initial search query is provided of “George Washington”. This generates a variety of image results, with the highest ranked results corresponding to images of the first U.S. president.
- Based on the initial search query, related queries can be generated or identified by any convenient method. Two of the related queries can be selected for use. These selected related queries can be ordered along the horizontal axis, typically on either side of the initial query. The selected related queries can be the highest ranked related queries, or any other convenient method can be used for selecting the related queries. The related queries can be used to generate responsive image results. These results are displayed on either side of the results for the initial query. In this example, the related search queries can lead to display of results responsive to “Martha Washington” to the right along the horizontal axis and results responsive to “John Adams” displayed to the left.
-
FIG. 3 schematically shows a possible representation of the above example. InFIG. 3 , three columns of results are presented. The middle column corresponds to thecurrent search query 310 of “George Washington.” In the middle column, threerepresentative results related search query 320 for “John Adams” andrelated search query 330 for “Martha Washington”. These columns show representative results 322-324 and 332-334. Again, additional results forqueries FIG. 3 provides an ordered representation for the displayed images that is aligned along both display axes. -
FIG. 4 schematically shows an alternative format for displaying image results. Thesame searches FIG. 4 . The responsive results are also the same, and the alignment of the results along the horizontal axis has been maintained. However,FIG. 4 shows an embodiment where the results are not aligned along the vertical axis. Instead, the images in each column are ordered, but the horizontal location within the column can be any convenient location. The scaling requirement of the images has also been removed, so that the images may each have any size that is convenient for display. - In embodiments such as
FIG. 4 , where image results are displayed in a non-aligned manner, the boundaries for display of results along a non-aligned axis can be selected in any convenient manner. InFIG. 4 , theboundaries boundary 418 and boundary 427 would be in the same location. - Still another option can be to have boundaries that allow for overlap of adjacent results. Under this type of option,
boundary 418 could be the right hand boundary for the “John Adams” results while boundary 427 could be the left hand boundary for the “George Washington” results. In this type of option, the overlap in display areas for results may help in giving the feel of a smooth transition from one set of results to another. - After seeing the display of results, a user may decide that the image results for “John Adams” look interesting. The user can translate the results along the horizontal axis so that the results for John Adams become the central query. This leads to several changes in the display. As the results for John Adams are moved to the center, the results for George Washington become the related search to the right while the results for Martha Washington are moved off of the page. In some embodiments, the fact that Martha was originally displayed can be tracked, so that the user can always return to a previously viewed display. As the John Adams results move to the center, another related search also becomes visible. In this example, the highest ranked related search is George Washington. However, that result has already been selected for display during this session. (In this embodiment, even if the results for George Washington were no longer visible, George Washington would not be selected as the related search because it was used at some point during the search session.) Instead, the next highest ranked related search of “Thomas Jefferson” is selected, and results responsive for “Thomas Jefferson” are displayed to the left of John Adams.
-
FIG. 5 schematically shows the translation along the horizontal axis to change the central search.FIG. 5 is based on the aligned result display shown inFIG. 3 . InFIG. 5 , the translation has moved the “John Adams” part of the way toward being the central search query. As a result, the results 542-544 for the “Thomas Jefferson”related query 540 are partially visible while the results for the “Martha Washington”related query 330 are leaving the viewing area. Note that there is no requirement that the “John Adams” result is moved fully to the central position. If the user prefers the view displayed at the point in time corresponding toFIG. 5 , or at any other convenient time, the user can stop the translation. Alternatively, the user can modify the rate of translation to move more quickly or more slowly through the results. - By translating in the horizontal direction, the user can continue to receive new related search results. In embodiments where previously selected related searches are excluded, this can lead to a seemingly infinite browsing experience. For example, translating the results to make Thomas Jefferson the central search query could result in an adjacent related search of “U.S. historical documents”. As noted above, the history of related searches can also be tracked. In an embodiment where the history of related searches is tracked, translating the view back to “George Washington” would also bring the related search of “Martha Washington” back into the display view.
- Based on the above, a variety of other features can be incorporated. For example, a user may be interested generally in related searches, but the particular related searches provided may not be of interest. In an embodiment, a user can choose to have one or both displayed related searches replaced with alternative related searches. For example, replacing both related searches could lead to the new related search “Revolutionary War” appearing to the left on the horizontal display axis while “George Washington Carver” appears to the right. This can be repeated as desired, until the user receives related search queries of interest. If a user requested new related searches, depending on the user settings, the search queries for “John Adams” and “Martha Washington” can be excluded from being used as related searches, or they can now appear in the related search chain if they are they are identified as the next related search query. A user can also provide a new main search query at any time. Related searches based on the new search query can then be provided. The user can be given an option to exclude previously viewed search queries from being selected as a related query to the new search query, or a default behavior can be chosen by the system.
- Another potential variation can be to have a one or more default or recommended initial search queries. For example, a museum may provide initial search queries based on the current contents of the museum collection. The related queries could optionally be defined in advance for each query. This would allow a user of the museum search to be able to scroll through the museum collection in an ordered manner without having to know anything about the collection. The user can simply select an initial query of interest and start browsing.
- Still another option can be to allow the user to modify a search query by selecting an image. In an embodiment, each image can have a search query associated with the image. When a user selects an image, the user can optionally indicate an interest in more images similar to the selected image. The search query associated with the image can then be used as a new initial query.
- In addition to providing related searches, one or more display axes can be based on a characteristic or feature of the image results. Examples of image features for ordering the display of the images can include the size of the image; whether the image is color or black and white; the brightness or color characteristics of the image; a date associated with the image; or any other convenient characteristic of the image. Images ordered along a display axis based on a feature may be aligned or non-aligned.
- Unlike the potentially “infinite” browsing possible for display axes corresponding to related searches, the display axes for an image feature may be finite. For example, a display axis for color versus black and white images may be small enough to have the entire display axis on the display screen. More generally, the amount of translation available for a display axis can be as much or as little as is convenient for displaying the associated images.
- Although not explicitly a “feature” of an image, relevance of an image to a search query can also be used as a display axis for ordering the images. In an embodiment, the images can be ordered along a display axis based on relevance such that the initial display to the user includes the most relevant images for the search query. A display axis for ordering search results by relevance may also be limited in the amount of translation that is possible. Since the display may start with the most relevant results being visible, initially it may only be possible to translate along the relevance display axis in one direction.
- In another embodiment, ordering images along display axes based on features can be a second level of display after an initial image has been selected. For example, consider a situation where an initial search is displayed with two display axes for related searches. In this type of configuration, a limited number of images can be displayed associated with each search or related search. Selecting an image can identify a search or related search for an expanded display. This expanded display can provide additional images for the query corresponding to the selected image, and the images can be ordered along one or more display axes based on the features or characteristics of the images.
- Automatic Translation along Display Axes
- When image results are displayed to a user, one option is to provide a static initial view and then allow translation of the results along one or more of the display axes based on user input. In other embodiments, image results can be automatically translated along one or more of the display axes for viewing by the user. The automatic translation of image results can begin when results are displayed, or the automatic translation can be activated during review of results by the user. Depending on the embodiment, the user can provide input to set the rate of translation along each display axis, or a translation rate can be selected automatically. In another embodiment, the automatic translation process can be guided in any convenient manner. For example, the direction for automatic translation can be guided in part by a random process, or by a process based on stored navigational histories of a current user, or by a process based on stored navigational histories of a plurality or group of users, or by relevance, or by a process based on another convenient factor. Still another option can be to use a combination of two or more types of processes to guide the navigation for automatic translation.
- During automatic translation of results, a user may identify an image of interest. Based on user input, one or more actions may be performed when an image is selected. The automatic translation of images may be stopped or slowed when an image is selected. The user can be provided with a larger view of the image and/or additional information about the image. Optionally, the user can submit a new search query based on keywords associated with the image. The selected image can also be added to a library or collection of images selected by the user. The library of selected images can provide the user a convenient way to return to images of interest after the images are no longer in view on the display.
-
FIGS. 6-9 provide another example of display of image results according to various embodiments of the invention. InFIGS. 6-9 , results are ordered along three display axes. A horizontal display axis is used for ordering results based on search query. The vertical axis is used for ordering results based on the size of the image. The “depth” axis into and out of the plane of the display screen is used for ordering based on relevance of a result to a query. -
FIG. 6 provides the initial view based on a receivedsearch query 610 of “George Washington”. In the embodiment shown inFIG. 6 , the results are not aligned along any of the display axes. Instead, the results 612-614 are randomly scattered in a manner otherwise consistent with the ordering along each display axis. The results 622-624 responsive to query 620 and results 632-634 responsive to query 630 are similarly scattered. Qualitatively, this can give the viewer a feeling of object suspended in a medium that can flow through the viewer's field of vision. - In the initial view shown in
FIG. 6 , the highest rankedresults query 630 have a similar size in this example. - In this example, after the query is received, the results are automatically translated along the “depth” display axis. This allows the user to begin browsing the results for the center query and the related queries without any further user action. The user may alter the direction or speed of translation at any time, or the user can halt the translation.
FIG. 7 schematically shows the display of results after some translation of the results has occurred along the “depth” display axis. InFIG. 7 , the two highest ranked results for the center search and the related searches have passed beyond the viewing plane. This leaves images 714, 724, and 734 as the highest ranked displayed images. These images also have the largest display size at this time. New images 716-717, 726-727, and 736-737 have also come into view as lower ranked results that are visible due to translation along the “depth” display axis. - At this point, the user identifies
image 726 as being of interest. In the embodiment shown inFIG. 8 , this causes the automatic translation to stop while the user reviews the selected image. This also adds the selected image to alibrary 860 of selected images. When an image is selected, the user can be presented with alarger view 865 of the selected image, as well asadditional information 867 about the image. Thelarger image view 865 andadditional information 867 can be presented as an overlay to the image results, or they can optionally be displayed in aseparate window 870. -
FIG. 9 schematically shows a variation for how to display results.FIG. 9 is generally similar to the display inFIG. 6 . The relationship between the center search query and the related search queries is modified. InFIG. 9 , the ordering of results along the horizontal axis indicates not only which search query a result is associated with, but also how the result is ranked in relation to one of the related queries. For example, inFIG. 6 , result 633 was the second highest ranked result for “Martha Washington”. InFIG. 9 , result 633 is shown roughly halfway between the query for “George Washington” and “Martha Washington”. In the embodiment shown inFIG. 9 , this indicates thatresult 633 also has a high ranking in response to the “George Washington” query. By contrast, result 612 is not considered responsive to either the “John Adams” query or the “Martha Washington” query. Thus, result 612 is shown as being centrally located under the “George Washington” query. In other embodiments, another way to attempt to smooth the transition between the results for two adjacent queries would be to explicitly generate results for a search query that is based on a pair of adjacent queries. Thus, a combined query of “John Adams and George Washington” or “Martha Washington and George Washington” could be used to generate responsive image results. These results for a combined query can be shown between the explicitly identified center query and the related query. Still another option can be to use both horizontal positioning and explicit combined queries to provide a smooth transition from an initial query such as “George Washington” to a related query such as “Martha Washington”. - Any convenient set of controls can be provided to allow a user to translate along the various display axes. One option can be to provide keyboard based controls. As an example of possible key assignments, the arrow keys on a keyboard can be used to increase or decrease speed in the plane of the display screen, while the “plus” and “minus” keys can modify the speed of translation along the depth display axis. For convenience, a key such as the space bar could be used to stop all motion. Another option could be to use a combination of mouse movement and clicks of mouse buttons. Still other options could be based on touch screen interactions by a user.
- Having briefly described an overview of various embodiments of the invention, an exemplary operating environment suitable for performing the invention is now described. Referring to the drawings in general, and initially to
FIG. 1 in particular, an exemplary operating environment for implementing embodiments of the present invention is shown and designated generally ascomputing device 100.Computing device 100 is but one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should thecomputing device 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated. - Embodiments of the invention may be described in the general context of computer code or machine-useable instructions, including computer-executable instructions such as program modules, being executed by a computer or other machine, such as a personal data assistant or other handheld device. Generally, program modules, including routines, programs, objects, components, data structures, applications, etc., refer to code that perform particular tasks or implement particular abstract data types. The invention may be practiced in a variety of system configurations, including hand-held devices, consumer electronics, general-purpose computers, more specialty computing devices, and the like. The invention may also be practiced in distributed computing environments where tasks are performed by remote-processing devices that are linked through a communications network.
- With continued reference to
FIG. 1 ,computing device 100 includes abus 110 that directly or indirectly couples the following devices:memory 112, one ormore processors 114, one ormore presentation components 116, input/output (I/O)ports 118, I/O components 120, and anillustrative power supply 122.Bus 110 represents what may be one or more busses (such as an address bus, data bus, or combination thereof). Although the various blocks ofFIG. 1 are shown with lines for the sake of clarity, in reality, delineating various components is not so clear, and metaphorically, the lines would more accurately be grey and fuzzy. For example, one may consider a presentation component such as a display device to be an I/O component. Additionally, many processors have memory. The inventors hereof recognize that such is the nature of the art, and reiterate that the diagram ofFIG. 1 is merely illustrative of an exemplary computing device that can be used in connection with one or more embodiments of the present invention. Distinction is not made between such categories as “workstation,” “server,” “laptop,” “hand-held device,” etc., as all are contemplated within the scope ofFIG. 1 and reference to “computing device.” - The
computing device 100 typically includes a variety of computer-readable media. Computer-readable media can be any available media that can be accessed by computingdevice 100 and includes both volatile and nonvolatile media, removable and non-removable media. By way of example, and not limitation, computer-readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, Random Access Memory (RAM), Read Only Memory (ROM), Electronically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other holographic memory, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, carrier wave, or any other medium that can be used to encode desired information and which can be accessed by thecomputing device 100. In an embodiment, the computer storage media can be selected from tangible computer storage media. In another embodiment, the computer storage media can be selected from non-transitory computer storage media. - The
memory 112 includes computer-storage media in the form of volatile and/or nonvolatile memory. The memory may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memory, hard drives, optical-disc drives, etc. Thecomputing device 100 includes one or more processors that read data from various entities such as thememory 112 or the I/O components 120. The presentation component(s) 116 present data indications to a user or other device. Exemplary presentation components include a display device, speaker, printing component, vibrating component, and the like. - The I/
O ports 118 allow thecomputing device 100 to be logically coupled to other devices including the I/O components 120, some of which may be built in. Illustrative components include a microphone, joystick, game pad, satellite dish, scanner, printer, wireless device, etc. - Turning now to
FIG. 2 , a block diagram is illustrated, in accordance with an embodiment of the present invention, showing an exemplary computing system and/ornetwork environment 200. It will be understood and appreciated by those of ordinary skill in the art that thecomputing system 200 shown inFIG. 2 is merely an example of one suitable computing system environment and is not intended to suggest any limitation as to the scope of use or functionality of embodiments of the present invention. Neither should thecomputing system 200 be interpreted as having any dependency or requirement related to any single component or combination of components illustrated therein. Further, thecomputing system 200 may be provided as a stand-alone product, as part of a software development environment, or any combination thereof. - The
computing system 200 includes auser device 206, a search engine orsearch service 205, and an image ordering anddisplay component 208, all in communication with one another via anetwork 204 and/or via location on a common device. The network may include, without limitation, one or more local area networks (LANs) and/or wide area networks (WANs). Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet. Accordingly, thenetwork 204 is not further described herein. - Each of the
user device 206,search engine 205, and image ordering anddisplay component 208 shown inFIG. 2 may be any type of computing device, such as, for example,computing device 200 described above with reference toFIG. 2 . By way of example only and not limitation, each of theuser device 206,search engine 205, and image ordering anddisplay component 208 may be a personal computer, desktop computer, laptop computer, handheld device, mobile handset, consumer electronic device, and the like. Additionally, theuser device 206 may further include a keyboard, keypad, stylus, joystick, and any other input-initiating component that allows a user to provide wired or wireless data to thenetwork 204, e.g., verification inquires, web page addresses, and the like. It should be noted, however, that the present invention is not limited to implementation on such computing devices, but may be implemented on any of a variety of different types of computing devices within the scope of embodiments hereof. - Based on search queries, search engine or
service 205 can identify responsive results. Image ordering anddisplay component 208 can then order the responsive image results and provide a display view foruser device 206 in accordance with various embodiments of the invention. -
FIG. 10 depicts a flow chart showing a method according to an embodiment of the invention. InFIG. 10 , a plurality of search queries and corresponding responsive image results are ordered 1010 along a first display axis. The responsive image results are also ordered 1020 along a second display axis. The ordering along the second display axis can be based on, for example, a ranking of the results relative to the corresponding query, or an image feature, or another characteristic. If the ordering is based on an image feature, the image feature can be the size of the image, whether the image is color or black and white, a date associated with the image feature, or any other convenient image feature. A portion of the responsive results are displayed 1030 based on the ordering of the results along the display axes. An additional query related to at least one of the plurality of search queries is identified 1040, along with corresponding additional results responsive to the additional query. The additional query and the additional results are ordered 1050 along the first display axis. Typically, the additional query will be ordered to be adjacent to the query that it is related to in the plurality of queries. The plurality of queries and corresponding responsive image results are translated 1060 along the first display axis. This results in removing one of the plurality of queries from display. The translation also creates space in the display view, and this space can be used to display 1070 the additional query and corresponding additional results. -
FIG. 11 depicts a flow chart showing a method according to another embodiment of the invention. InFIG. 11 , a plurality of search queries and corresponding responsive image results are ordered 1110 along a first display axis. The responsive image results are also ordered 1120 along a second display axis. This second display axis is approximately orthogonal to the viewing plane of the display device. The ordering along the second display axis can be based on, for example, a ranking of the results relative to the corresponding query, or an image feature, or another characteristic. If the ordering is based on an image feature, the image feature can be the size of the image, whether the image is color or black and white, a date associated with the image feature, or any other convenient image feature. The responsive image results are also ordered 1130 along a third display axis. A portion of the responsive results are displayed 1140 based on the ordering of the results along the display axes. The responsive image results are translated 1150 along at least the second display axis. This results in removing a first plurality of responsive results from display. The translation also creates space in the display view, and this space can be used to display 1160 a second plurality of results. -
FIG. 12 depicts a flow chart showing a method according to another embodiment of the invention. InFIG. 12 , a plurality of search queries and corresponding responsive image results are ordered 1210 along a first display axis. The responsive image results are also ordered 1220 along a second display axis. This second display axis is approximately orthogonal to the first display axis. The responsive image results are also ordered 1230 along a third display axis based on an image feature. The third display axis is approximately orthogonal to the first and second display axes. A portion of the responsive results are displayed 1240 based on the ordering of the results along the display axes. InFIG. 12 , the results are ordered along at least two of the display axes in a non-aligned manner. The responsive image results are automatically translated 1250 along one or more of the display axes. This results in removing a first plurality of responsive results from display. The translation also creates space in the display view, and this space can be used to display 1260 a second plurality of results. - In an embodiment, one or more computer-storage media storing computer-useable instructions are provided that, when executed by a computing device, perform a method for displaying image results. The method includes ordering a plurality of search queries and corresponding responsive image results along a first display axis; ordering the responsive image results along a second display axis; displaying at least a portion of the responsive results based on the ordering along the first and second display axes; identifying an additional query related to at least one of the plurality of search queries and a corresponding plurality of additional responsive image results; adding the additional query and the corresponding additional responsive image results to the ordering of search queries along the first display axis; translating the plurality of queries and the corresponding responsive image results along the first display axis, the translation resulting in removing one of the plurality of queries from display; and displaying the additional query and the corresponding additional responsive image results.
- In another embodiment, a method for displaying image results is provided. The method includes ordering a plurality of search queries and corresponding responsive image results along a first display axis; ordering the responsive image results along a second display axis, the second display axis being approximately orthogonal to a viewing plane of a display device; ordering the responsive results along a third display axis; displaying at least a portion of the responsive results based on the ordering along the first, second, and third display axes; translating the responsive results along at least the second display axis, the translation resulting in removing a first plurality of responsive results from display; and displaying of a second plurality of responsive results.
- In still another embodiment, one or more computer-storage media storing computer-useable instructions are provided that, when executed by a computing device, perform a method for displaying image results. The method includes ordering a plurality of search queries and corresponding responsive search results along a first display axis; ordering image results responsive to the plurality of queries along a second display axis, the second display axis being approximately orthogonal to the first display axis; ordering the responsive results along a third display axis, the third display axis being approximately orthogonal to the first display axis and the second display axis; displaying at least a portion of the responsive results based on the ordering along the first, second, and third display axes; automatically translating the responsive results along one or more of the display axes, the translation resulting in removing a first plurality of results from display; and displaying a second plurality of responsive results, wherein the responsive results are ordered in a non-aligned manner along at least two display axes.
- In yet another group of embodiments, a first embodiment can provide one or more computer storage media storing computer-useable instructions that, when executed by a computing device, perform a method for displaying image results. The method can include ordering a plurality of search queries and corresponding responsive image results along a first display axis; ordering the responsive image results along a second display axis; displaying at least a portion of the responsive results based on the ordering along the first and second display axes; identifying an additional query related to at least one of the plurality of search queries and a corresponding plurality of additional responsive image results, the additional query being different from the queries in the query history; adding the additional query and the corresponding additional responsive image results to the ordering of search queries along the first display axis; translating the plurality of queries and the corresponding responsive image results along the first display axis, the translation resulting in removing one of the plurality of queries from display; and displaying the additional query and the corresponding additional responsive image results.
- In an second embodiment, computer storage media according to the first embodiment are provided, wherein a query history retains the ordering of queries along the first display axis for queries in the query history, and wherein identifying an additional query related to at least one of the plurality of search queries comprises identifying an additional query that is different from the plurality of search queries stored in the query history.
- In a third embodiment, computer storage media according to any of the above embodiments are provided, wherein translating the responsive results along the first display axis comprises automatically translating the responsive results along the first display axis.
- In a fourth embodiment, computer storage media according to any of the above embodiments are provided, further comprising: translating, after display of the additional query, the currently displayed queries and corresponding responsive results along the first display axis, the translation resulting in removing the additional query from display; and displaying the plurality of queries and corresponding responsive results.
- In a fifth embodiment, one or more computer storage media storing computer-useable instructions are provided that, when executed by a computing device, perform a method for displaying image results. The method can include ordering a plurality of search queries and corresponding responsive search results along a first display axis; ordering image results responsive to the plurality of queries along a second display axis, the second display axis being approximately orthogonal to the first display axis; ordering the responsive results along a third display axis, the ordering optionally being based on an image feature, the third display axis being approximately orthogonal to the first display axis and the second display axis; displaying at least a portion of the responsive results based on the ordering along the first, second, and third display axes; translating the responsive results along at least the second display axis, the translation resulting in removing a first plurality of results from display; and displaying a second plurality of responsive results.
- In a sixth embodiment, computer storage media according to the fifth embodiment are provided, wherein translating the responsive results along one or more display axes comprises automatically translating the responsive results along at least the second display axis.
- In a seventh embodiment, computer storage media according to the fifth or sixth embodiment are provided, wherein the second plurality of responsive results comprises results with a ranking relative to the corresponding query that is lower than the ranking of results in the first plurality of responsive results.
- In an eighth embodiment, computer storage media according to any of the above embodiments are provided, wherein the responsive results are ordered along the second display axis in a non-aligned manner.
- In a ninth embodiment, computer storage media according to the eighth embodiment are provided, wherein the non-aligned responsive results are positioned along the first axis to reflect a ranking relative to an adjacent query.
- In a tenth embodiment, computer storage media according to any of the above embodiments are provided, further comprising: identifying an intermediate query for a pair of queries in the ordered queries along the first display axis, the intermediate query being based on the pair of queries; obtaining results responsive to the intermediate query; and displaying the results responsive to the intermediate query between the results for the pair of queries.
- In a eleventh embodiment, computer storage media according to any of the above embodiments are provided, wherein translating the responsive results comprises translating the responsive results along at least two display axes.
- In a twelfth embodiment, computer storage media according to any of the above embodiments are provided, wherein the responsive results are ordered in a non-aligned manner along at least two display axes.
- In a thirteenth embodiment, computer storage media according to the first embodiment are provided, further comprising ordering the responsive results along a third display axis based on an image feature.
- In a fourteenth embodiment, computer storage media according to any of the above embodiments are provided, wherein the responsive results are ordered along the second axis based on a ranking of the results relative to the corresponding query.
- In a fifteenth embodiment, computer storage media according to any of the above embodiments are provided, wherein the second display axis is approximately orthogonal to a viewing plane of a display device.
- Embodiments of the present invention have been described in relation to particular embodiments, which are intended in all respects to be illustrative rather than restrictive. Alternative embodiments will become apparent to those of ordinary skill in the art to which the present invention pertains without departing from its scope.
- From the foregoing, it will be seen that this invention is one well adapted to attain all the ends and objects hereinabove set forth together with other advantages which are obvious and which are inherent to the structure.
- It will be understood that certain features and subcombinations are of utility and may be employed without reference to other features and subcombinations. This is contemplated by and is within the scope of the claims.
Claims (20)
Priority Applications (15)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/947,603 US9384216B2 (en) | 2010-11-16 | 2010-11-16 | Browsing related image search result sets |
TW100135319A TW201222293A (en) | 2010-11-16 | 2011-09-29 | Browsing related image search result sets |
EP11842381.3A EP2641196A4 (en) | 2010-11-16 | 2011-11-02 | Browsing related image search result sets |
AU2011329379A AU2011329379B2 (en) | 2010-11-16 | 2011-11-02 | Browsing related image search result sets |
RU2016134021A RU2719445C2 (en) | 2010-11-16 | 2011-11-02 | Viewing related sets of image search results |
JP2013539873A JP5990180B2 (en) | 2010-11-16 | 2011-11-02 | Browsing related image search result sets |
MX2013005537A MX339052B (en) | 2010-11-16 | 2011-11-02 | Browsing related image search result sets. |
RU2013122463/08A RU2598818C2 (en) | 2010-11-16 | 2011-11-02 | Browsing related image search result sets |
PCT/US2011/059020 WO2012067834A1 (en) | 2010-11-16 | 2011-11-02 | Browsing related image search result sets |
KR1020137012333A KR20130132805A (en) | 2010-11-16 | 2011-11-02 | Browsing related image search result sets |
CN201110362986.3A CN102411620B (en) | 2010-11-16 | 2011-11-16 | Method for Displaying Relative Image Searching Result |
HK12108683.1A HK1167913A1 (en) | 2010-11-16 | 2012-09-05 | Browsing related image search result sets |
US13/616,617 US9372873B2 (en) | 2010-11-16 | 2012-09-14 | Browsing related image search result sets |
IL226002A IL226002A (en) | 2010-11-16 | 2013-04-28 | Browsing related image search result sets |
US15/170,178 US20160350312A1 (en) | 2010-11-16 | 2016-06-01 | Browsing related image search result sets |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/947,603 US9384216B2 (en) | 2010-11-16 | 2010-11-16 | Browsing related image search result sets |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/616,617 Continuation US9372873B2 (en) | 2010-11-16 | 2012-09-14 | Browsing related image search result sets |
US15/170,178 Continuation US20160350312A1 (en) | 2010-11-16 | 2016-06-01 | Browsing related image search result sets |
Publications (2)
Publication Number | Publication Date |
---|---|
US20120124036A1 true US20120124036A1 (en) | 2012-05-17 |
US9384216B2 US9384216B2 (en) | 2016-07-05 |
Family
ID=45913691
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/947,603 Active 2032-03-29 US9384216B2 (en) | 2010-11-16 | 2010-11-16 | Browsing related image search result sets |
US13/616,617 Active US9372873B2 (en) | 2010-11-16 | 2012-09-14 | Browsing related image search result sets |
US15/170,178 Abandoned US20160350312A1 (en) | 2010-11-16 | 2016-06-01 | Browsing related image search result sets |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/616,617 Active US9372873B2 (en) | 2010-11-16 | 2012-09-14 | Browsing related image search result sets |
US15/170,178 Abandoned US20160350312A1 (en) | 2010-11-16 | 2016-06-01 | Browsing related image search result sets |
Country Status (12)
Country | Link |
---|---|
US (3) | US9384216B2 (en) |
EP (1) | EP2641196A4 (en) |
JP (1) | JP5990180B2 (en) |
KR (1) | KR20130132805A (en) |
CN (1) | CN102411620B (en) |
AU (1) | AU2011329379B2 (en) |
HK (1) | HK1167913A1 (en) |
IL (1) | IL226002A (en) |
MX (1) | MX339052B (en) |
RU (2) | RU2719445C2 (en) |
TW (1) | TW201222293A (en) |
WO (1) | WO2012067834A1 (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120328148A1 (en) * | 2011-06-27 | 2012-12-27 | Grey William Doherty | Method and system for secure image management |
US20140188844A1 (en) * | 2013-01-02 | 2014-07-03 | Google Inc. | Adjacent search results exploration |
WO2014144173A1 (en) * | 2013-03-15 | 2014-09-18 | Nike, Inc. | Product presentation assisted by visual search |
US20140317104A1 (en) * | 2013-04-19 | 2014-10-23 | Palo Alto Research Center Incorporated | Computer-Implemented System And Method For Visual Search Construction, Document Triage, and Coverage Tracking |
US20140351000A1 (en) * | 2013-05-21 | 2014-11-27 | Yahoo Inc. | Dynamic Modification of A Parameter of An Image Based on User Interest |
US9372873B2 (en) | 2010-11-16 | 2016-06-21 | Microsoft Technology Licensing, Llc | Browsing related image search result sets |
US9576487B2 (en) | 2015-04-20 | 2017-02-21 | Intellectual Fortress, LLC | Global positioning system |
US20170293616A1 (en) * | 2016-04-06 | 2017-10-12 | Baidu Usa Llc | Method for processing and rendering feed-like based images for mobile devices |
US20180267813A1 (en) * | 2017-03-16 | 2018-09-20 | Ca, Inc. | System and Method for Navigating Web-Based Application Programs |
US20220179899A1 (en) * | 2019-03-20 | 2022-06-09 | Nec Corporation | Information processing apparatus, search method, and non-transitory computer readable medium storing program |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9075825B2 (en) | 2011-09-26 | 2015-07-07 | The University Of Kansas | System and methods of integrating visual features with textual features for image searching |
CN103577413B (en) * | 2012-07-20 | 2017-11-17 | 阿里巴巴集团控股有限公司 | Search result ordering method and system, search results ranking optimization method and system |
CN104239005B (en) * | 2013-06-09 | 2018-07-27 | 腾讯科技(深圳)有限公司 | Figure alignment schemes and device |
US8819006B1 (en) | 2013-12-31 | 2014-08-26 | Google Inc. | Rich content for query answers |
RU2014125471A (en) | 2014-06-24 | 2015-12-27 | Общество С Ограниченной Ответственностью "Яндекс" | SEARCH QUERY PROCESSING METHOD AND SERVER |
JP6368421B1 (en) * | 2017-12-21 | 2018-08-01 | 株式会社Cygames | Program, system, electronic apparatus, and method for recognizing solid |
JP2019114226A (en) * | 2018-07-06 | 2019-07-11 | 株式会社Cygames | Program, system, electronic device and method for enabling solid to be recognized |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5220625A (en) * | 1989-06-14 | 1993-06-15 | Hitachi, Ltd. | Information search terminal and system |
US5835094A (en) * | 1996-12-31 | 1998-11-10 | Compaq Computer Corporation | Three-dimensional computer environment |
US20020055946A1 (en) * | 1996-06-28 | 2002-05-09 | Randy Prager | Enterprise, stream-based, information management system |
US6574632B2 (en) * | 1998-11-18 | 2003-06-03 | Harris Corporation | Multiple engine information retrieval and visualization system |
US20060038796A1 (en) * | 2001-08-29 | 2006-02-23 | Microsoft Corporation | Enhanced scrolling |
US20060048076A1 (en) * | 2004-08-31 | 2006-03-02 | Microsoft Corporation | User Interface having a carousel view |
US20070174790A1 (en) * | 2006-01-23 | 2007-07-26 | Microsoft Corporation | User interface for viewing clusters of images |
US20080094370A1 (en) * | 2006-09-06 | 2008-04-24 | Bas Ording | Portable Electronic Device Performing Similar Operations for Different Gestures |
US20080109750A1 (en) * | 2001-01-20 | 2008-05-08 | Catherine Lin-Hendel | Automated scrolling of browser content and automated activation of browser links |
US20080141126A1 (en) * | 2006-11-17 | 2008-06-12 | Vincent Lee Johnson | Method and system to aid in viewing digital content |
US7437005B2 (en) * | 2004-02-17 | 2008-10-14 | Microsoft Corporation | Rapid visual sorting of digital files and data |
US20090187558A1 (en) * | 2008-01-03 | 2009-07-23 | Mcdonald John Bradley | Method and system for displaying search results |
US20110119714A1 (en) * | 2009-11-19 | 2011-05-19 | Verizon Patent And Licensing, Inc. | Autoscrolling through interactive television content |
US8131702B1 (en) * | 2004-03-31 | 2012-03-06 | Google Inc. | Systems and methods for browsing historical content |
US8352465B1 (en) * | 2009-09-03 | 2013-01-08 | Google Inc. | Grouping of image search results |
Family Cites Families (47)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3572595B2 (en) | 1995-07-21 | 2004-10-06 | ソニー株式会社 | Electronic program guide display control apparatus and method |
US6233586B1 (en) | 1998-04-01 | 2001-05-15 | International Business Machines Corp. | Federated searching of heterogeneous datastores using a federated query object |
US6426761B1 (en) | 1999-04-23 | 2002-07-30 | Internation Business Machines Corporation | Information presentation system for a graphical user interface |
JP3996723B2 (en) | 1999-06-21 | 2007-10-24 | 株式会社日立製作所 | Image display method and apparatus, and search service using the same |
CA2319996A1 (en) | 1999-09-22 | 2001-03-22 | Goodhome.Com | Method and system for generating web pages with information displayed in a carousel |
WO2001031502A1 (en) | 1999-10-27 | 2001-05-03 | Fujitsu Limited | Multimedia information classifying/arranging device and method |
WO2003001413A1 (en) | 2001-06-22 | 2003-01-03 | Nosa Omoigui | System and method for knowledge retrieval, management, delivery and presentation |
US7495795B2 (en) * | 2002-02-21 | 2009-02-24 | Ricoh Company, Ltd. | Interface for printing multimedia information |
US7421660B2 (en) * | 2003-02-04 | 2008-09-02 | Cataphora, Inc. | Method and apparatus to visually present discussions for data mining purposes |
US7334195B2 (en) | 2003-10-14 | 2008-02-19 | Microsoft Corporation | System and process for presenting search results in a histogram/cluster format |
JP2005202535A (en) | 2004-01-14 | 2005-07-28 | Hitachi Ltd | Document tabulation method and device, and storage medium storing program used therefor |
US7293007B2 (en) * | 2004-04-29 | 2007-11-06 | Microsoft Corporation | Method and system for identifying image relatedness using link and page layout analysis |
JP2006014237A (en) | 2004-06-29 | 2006-01-12 | Sharp Corp | Image reproducing apparatus |
JP4533791B2 (en) | 2005-04-19 | 2010-09-01 | 株式会社日立製作所 | Information browsing device |
US7761812B2 (en) | 2005-07-27 | 2010-07-20 | Microsoft Corporation | Media user interface gallery control |
JP2007148948A (en) | 2005-11-30 | 2007-06-14 | Hitachi Ltd | Document search program |
US7725451B2 (en) | 2006-01-23 | 2010-05-25 | Microsoft Corporation | Generating clusters of images for search results |
US7542994B2 (en) | 2006-03-24 | 2009-06-02 | Scenera Technologies, Llc | Graphical user interface for rapid image categorization |
US20070239698A1 (en) | 2006-04-10 | 2007-10-11 | Graphwise, Llc | Search engine for evaluating queries from a user and presenting to the user graphed search results |
US20070299830A1 (en) | 2006-06-26 | 2007-12-27 | Christopher Muenchhoff | Display of search results |
US20080033935A1 (en) | 2006-08-04 | 2008-02-07 | Metacarta, Inc. | Systems and methods for presenting results of geographic text searches |
US8453060B2 (en) | 2006-08-25 | 2013-05-28 | Microsoft Corporation | Panoramic ring user interface |
JP2008217117A (en) | 2007-02-28 | 2008-09-18 | Fujifilm Corp | Image retrieval method and image retrieval system |
JP2008257341A (en) | 2007-04-02 | 2008-10-23 | Sony Corp | Search result display device, search result display method and program |
US20080282158A1 (en) | 2007-05-11 | 2008-11-13 | Nokia Corporation | Glance and click user interface |
AU2008279855A1 (en) | 2007-07-25 | 2009-01-29 | Serial Multivision Pte Ltd | A content management and delivery system |
JP5149724B2 (en) | 2007-09-07 | 2013-02-20 | キヤノン株式会社 | Image management apparatus, control method therefor, and storage medium |
US20090125504A1 (en) * | 2007-11-08 | 2009-05-14 | Randy Adams | Systems and methods for visualizing web page query results |
US8392847B2 (en) | 2008-05-20 | 2013-03-05 | Hewlett-Packard Development Company, L.P. | System and method for providing content on an electronic device |
US20100031152A1 (en) | 2008-07-31 | 2010-02-04 | Microsoft Corporation | Creation and Navigation of Infinite Canvas Presentation |
US8489582B2 (en) * | 2008-08-06 | 2013-07-16 | Yahoo! Inc. | Interconnected, universal search experience across multiple verticals |
US8452793B2 (en) * | 2008-09-30 | 2013-05-28 | Yahoo! Inc. | Query refinement based on user selections |
US9928242B2 (en) | 2008-11-05 | 2018-03-27 | Oracle International Corporation | Managing the content of shared slide presentations |
US8271413B2 (en) | 2008-11-25 | 2012-09-18 | Google Inc. | Providing digital content based on expected user behavior |
US9037999B2 (en) | 2008-12-31 | 2015-05-19 | Tivo Inc. | Adaptive search result user interface |
JP4787887B2 (en) | 2009-04-13 | 2011-10-05 | 株式会社Tbsテレビ | System for searching digital contents and search method using the same |
US20100299342A1 (en) | 2009-05-22 | 2010-11-25 | Nbc Universal, Inc. | System and method for modification in computerized searching |
EP2462521A1 (en) | 2009-08-07 | 2012-06-13 | Thomson Licensing | System and method for searching in internet on a video device |
US20110106808A1 (en) | 2009-10-30 | 2011-05-05 | Salesforce.Com, Inc. | Multi-dimensional content organization and delivery |
KR101617461B1 (en) | 2009-11-17 | 2016-05-02 | 엘지전자 주식회사 | Method for outputting tts voice data in mobile terminal and mobile terminal thereof |
US9465532B2 (en) | 2009-12-18 | 2016-10-11 | Synaptics Incorporated | Method and apparatus for operating in pointing and enhanced gesturing modes |
JP2010205308A (en) | 2010-06-25 | 2010-09-16 | Fujitsu Ltd | Display device, display program and display method |
US9384216B2 (en) | 2010-11-16 | 2016-07-05 | Microsoft Technology Licensing, Llc | Browsing related image search result sets |
AU2011202182B1 (en) | 2011-05-11 | 2011-10-13 | Frequency Ip Holdings, Llc | Creation and presentation of selective digital content feeds |
US8799817B2 (en) | 2011-05-25 | 2014-08-05 | Samsung Electronics Co., Ltd. | Carousel user interface |
US8700999B2 (en) | 2011-08-15 | 2014-04-15 | Google Inc. | Carousel user interface for document management |
US20130232148A1 (en) | 2012-03-01 | 2013-09-05 | Microsoft Corporation | Content mapping |
-
2010
- 2010-11-16 US US12/947,603 patent/US9384216B2/en active Active
-
2011
- 2011-09-29 TW TW100135319A patent/TW201222293A/en unknown
- 2011-11-02 JP JP2013539873A patent/JP5990180B2/en active Active
- 2011-11-02 KR KR1020137012333A patent/KR20130132805A/en active Search and Examination
- 2011-11-02 RU RU2016134021A patent/RU2719445C2/en active
- 2011-11-02 WO PCT/US2011/059020 patent/WO2012067834A1/en active Application Filing
- 2011-11-02 RU RU2013122463/08A patent/RU2598818C2/en active
- 2011-11-02 EP EP11842381.3A patent/EP2641196A4/en not_active Withdrawn
- 2011-11-02 AU AU2011329379A patent/AU2011329379B2/en active Active
- 2011-11-02 MX MX2013005537A patent/MX339052B/en active IP Right Grant
- 2011-11-16 CN CN201110362986.3A patent/CN102411620B/en active Active
-
2012
- 2012-09-05 HK HK12108683.1A patent/HK1167913A1/en unknown
- 2012-09-14 US US13/616,617 patent/US9372873B2/en active Active
-
2013
- 2013-04-28 IL IL226002A patent/IL226002A/en active IP Right Grant
-
2016
- 2016-06-01 US US15/170,178 patent/US20160350312A1/en not_active Abandoned
Patent Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5220625A (en) * | 1989-06-14 | 1993-06-15 | Hitachi, Ltd. | Information search terminal and system |
US20020055946A1 (en) * | 1996-06-28 | 2002-05-09 | Randy Prager | Enterprise, stream-based, information management system |
US5835094A (en) * | 1996-12-31 | 1998-11-10 | Compaq Computer Corporation | Three-dimensional computer environment |
US6574632B2 (en) * | 1998-11-18 | 2003-06-03 | Harris Corporation | Multiple engine information retrieval and visualization system |
US20080109750A1 (en) * | 2001-01-20 | 2008-05-08 | Catherine Lin-Hendel | Automated scrolling of browser content and automated activation of browser links |
US20060038796A1 (en) * | 2001-08-29 | 2006-02-23 | Microsoft Corporation | Enhanced scrolling |
US7437005B2 (en) * | 2004-02-17 | 2008-10-14 | Microsoft Corporation | Rapid visual sorting of digital files and data |
US8131702B1 (en) * | 2004-03-31 | 2012-03-06 | Google Inc. | Systems and methods for browsing historical content |
US20060048076A1 (en) * | 2004-08-31 | 2006-03-02 | Microsoft Corporation | User Interface having a carousel view |
US20070174790A1 (en) * | 2006-01-23 | 2007-07-26 | Microsoft Corporation | User interface for viewing clusters of images |
US20080094370A1 (en) * | 2006-09-06 | 2008-04-24 | Bas Ording | Portable Electronic Device Performing Similar Operations for Different Gestures |
US20080141126A1 (en) * | 2006-11-17 | 2008-06-12 | Vincent Lee Johnson | Method and system to aid in viewing digital content |
US20090187558A1 (en) * | 2008-01-03 | 2009-07-23 | Mcdonald John Bradley | Method and system for displaying search results |
US8352465B1 (en) * | 2009-09-03 | 2013-01-08 | Google Inc. | Grouping of image search results |
US20110119714A1 (en) * | 2009-11-19 | 2011-05-19 | Verizon Patent And Licensing, Inc. | Autoscrolling through interactive television content |
Cited By (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9372873B2 (en) | 2010-11-16 | 2016-06-21 | Microsoft Technology Licensing, Llc | Browsing related image search result sets |
US20120328148A1 (en) * | 2011-06-27 | 2012-12-27 | Grey William Doherty | Method and system for secure image management |
US9361318B2 (en) * | 2013-01-02 | 2016-06-07 | Google Inc. | Adjacent search results exploration |
WO2014107485A3 (en) * | 2013-01-02 | 2014-11-20 | Google Inc. | Adjacent search results exploration |
US8996516B2 (en) * | 2013-01-02 | 2015-03-31 | Google Inc. | Adjacent search results exploration |
US20150205821A1 (en) * | 2013-01-02 | 2015-07-23 | Google Inc. | Adjacent Search Results Exploration |
CN104969223A (en) * | 2013-01-02 | 2015-10-07 | 谷歌公司 | Adjacent search results exploration |
US20140188844A1 (en) * | 2013-01-02 | 2014-07-03 | Google Inc. | Adjacent search results exploration |
WO2014144173A1 (en) * | 2013-03-15 | 2014-09-18 | Nike, Inc. | Product presentation assisted by visual search |
US9830630B2 (en) | 2013-03-15 | 2017-11-28 | Nike, Inc. | Product presentation assisted by visual search |
US11532024B2 (en) | 2013-03-15 | 2022-12-20 | Nike, Inc. | Product presentation assisted by visual search |
US10733649B2 (en) | 2013-03-15 | 2020-08-04 | Nike, Inc. | Product presentation assisted by visual search |
US20140317104A1 (en) * | 2013-04-19 | 2014-10-23 | Palo Alto Research Center Incorporated | Computer-Implemented System And Method For Visual Search Construction, Document Triage, and Coverage Tracking |
US9690831B2 (en) * | 2013-04-19 | 2017-06-27 | Palo Alto Research Center Incorporated | Computer-implemented system and method for visual search construction, document triage, and coverage tracking |
US20140351000A1 (en) * | 2013-05-21 | 2014-11-27 | Yahoo Inc. | Dynamic Modification of A Parameter of An Image Based on User Interest |
US10282736B2 (en) * | 2013-05-21 | 2019-05-07 | Excalibur Ip, Llc | Dynamic modification of a parameter of an image based on user interest |
US9576487B2 (en) | 2015-04-20 | 2017-02-21 | Intellectual Fortress, LLC | Global positioning system |
US20170293616A1 (en) * | 2016-04-06 | 2017-10-12 | Baidu Usa Llc | Method for processing and rendering feed-like based images for mobile devices |
US10909170B2 (en) * | 2016-04-06 | 2021-02-02 | Baidu Usa Llc | Method for processing and rendering feed-like based images for mobile devices |
US20180267813A1 (en) * | 2017-03-16 | 2018-09-20 | Ca, Inc. | System and Method for Navigating Web-Based Application Programs |
US10452413B2 (en) * | 2017-03-16 | 2019-10-22 | Ca, Inc. | System and method for navigating web-based application programs |
US20220179899A1 (en) * | 2019-03-20 | 2022-06-09 | Nec Corporation | Information processing apparatus, search method, and non-transitory computer readable medium storing program |
Also Published As
Publication number | Publication date |
---|---|
WO2012067834A1 (en) | 2012-05-24 |
EP2641196A1 (en) | 2013-09-25 |
US20160350312A1 (en) | 2016-12-01 |
TW201222293A (en) | 2012-06-01 |
AU2011329379B2 (en) | 2016-10-27 |
MX339052B (en) | 2016-05-06 |
US9384216B2 (en) | 2016-07-05 |
RU2016134021A (en) | 2018-12-10 |
AU2011329379A1 (en) | 2013-05-23 |
JP2013544406A (en) | 2013-12-12 |
JP5990180B2 (en) | 2016-09-07 |
CN102411620A (en) | 2012-04-11 |
IL226002A0 (en) | 2013-06-27 |
RU2016134021A3 (en) | 2019-11-08 |
EP2641196A4 (en) | 2015-04-01 |
MX2013005537A (en) | 2013-07-03 |
KR20130132805A (en) | 2013-12-05 |
IL226002A (en) | 2016-11-30 |
US9372873B2 (en) | 2016-06-21 |
RU2719445C2 (en) | 2020-04-17 |
RU2013122463A (en) | 2014-11-20 |
CN102411620B (en) | 2015-02-25 |
RU2598818C2 (en) | 2016-09-27 |
US20130006972A1 (en) | 2013-01-03 |
HK1167913A1 (en) | 2012-12-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9384216B2 (en) | Browsing related image search result sets | |
US9892175B2 (en) | Data set preview technology | |
US8306982B2 (en) | Method for associating and manipulating documents with an object | |
US9529495B2 (en) | Static and dynamic information elements selection | |
US9442942B2 (en) | Method, apparatus and computer program product for dynamic and visual object search interface | |
US9305330B2 (en) | Providing images with zoomspots | |
KR20160138440A (en) | Adjusting serp presentation based on query intent | |
CN105723364B (en) | Transitioning from a first search results environment to a second search results environment | |
AU2009322821A1 (en) | Previewing search results for suggested refinement terms and vertical searches | |
US8352524B2 (en) | Dynamic multi-scale schema | |
US20090303253A1 (en) | Personalized scaling of information | |
US9405446B1 (en) | Efficient and interactive presentation of item images | |
US20210311611A1 (en) | Dynamic multi-axis graphical user interface | |
Gutwin et al. | Testing the Limits of the Spatial Approach: Comparing Retrieval and Revisitation Performance of Spatial and Paged Data Organizations for Large Item Sets | |
Yoder et al. | A Zigzag Approach to Cascading Menus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MICROSOFT CORPORATION, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:RAMOS, GONZALO A;DRUCKER, STEVEN M;AKBARZADEH, AMIR;SIGNING DATES FROM 20101104 TO 20101108;REEL/FRAME:025378/0764 |
|
AS | Assignment |
Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034544/0001 Effective date: 20141014 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |