US8595222B2 - Methods and systems for representing, using and displaying time-varying information on the semantic web - Google Patents

Methods and systems for representing, using and displaying time-varying information on the semantic web Download PDF

Info

Publication number
US8595222B2
US8595222B2 US12/240,605 US24060508A US8595222B2 US 8595222 B2 US8595222 B2 US 8595222B2 US 24060508 A US24060508 A US 24060508A US 8595222 B2 US8595222 B2 US 8595222B2
Authority
US
United States
Prior art keywords
lifetime
rdf statement
rdf
statement
subject
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US12/240,605
Other versions
US20100281045A1 (en
Inventor
Michael Anthony Dean
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Raytheon BBN Technologies Corp
Original Assignee
Raytheon BBN Technologies Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Raytheon BBN Technologies Corp filed Critical Raytheon BBN Technologies Corp
Priority to US12/240,605 priority Critical patent/US8595222B2/en
Assigned to RAYTHEON BBN TECHNOLOGIES CORP. reassignment RAYTHEON BBN TECHNOLOGIES CORP. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: BBN TECHNOLOGIES CORP.
Assigned to BBNT SOLUTIONS LLC reassignment BBNT SOLUTIONS LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DEAN, MICHAEL ANTHONY
Publication of US20100281045A1 publication Critical patent/US20100281045A1/en
Assigned to BBN TECHNOLOGIES CORP. reassignment BBN TECHNOLOGIES CORP. MERGER (SEE DOCUMENT FOR DETAILS). Assignors: BBNT SOLUTIONS LLC
Application granted granted Critical
Publication of US8595222B2 publication Critical patent/US8595222B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/30Semantic analysis

Definitions

  • the methods and systems relate to representing, using and displaying information, and more particularly to methods and systems for representing, using and displaying time-varying information on the Semantic Web.
  • the Semantic Web is an evolving collection of software tools and content, which provides information on the Internet, or World Wide Web, in such a way that it can be readily used by intelligent agents and other computer programs. Information on the Semantic Web, rather than being in natural language text, can be maintained in a structure workable by both computers and people.
  • the Resource Description Framework (RDF) from the World Wide Web Consortium (W3C) underlies most Semantic Web efforts. RDF consists of statements (subject-predicate-object triples) made about instances of specific classes (similar to an object-oriented programming language).
  • the Resource Description Framework is a general framework for how to describe an Internet resource such as a Web site and its content.
  • An Internet resource is defined herein as a resource with a Uniform Resource Identifier (URI), including the Uniform Resource Locators (URLs) that identify Web sites as well as specific Web pages. Resources can also be physical objects (such as people) represented on Web pages.
  • URI Uniform Resource Identifier
  • URLs Uniform Resource Locators
  • Resources can also be physical objects (such as people) represented on Web pages.
  • HTML HyperText Markup Language
  • XML Extensible Markup Language
  • RDF description statements can be represented as graphs containing nodes (instances or string literals) and arcs (statements).
  • FIG. 6A provides an example of such a graph for an RDF statement of the form, “Mike Thornton has a father Joe Thornton.” For this RDF statement, “Mike Thornton” is the subject, “father” is the predicate, and “Joe Thornton” is the object.
  • the ovals can illustrate nodes representing resources (ovals 2 and 4 ), and arcs can represent the named property, as shown by arc 6 .
  • the direction of the arc can be from subject ( 2 ) to object ( 4 ). It can be understood that other representations besides the illustrated ovals and directional arcs can be used.
  • FIG. 6B illustrates a graph of a collection of statements in which “Mike Thornton” (using an abbreviated form to represent a full URI) can be both the subject and object of various ones of the statements, including, “Jason Thornton has a father Mike Thornton,” and “Mike Thornton is married to Nancy Frier.”
  • the subject “Jason Thornton” is represented by oval 8 and predicate “father” is represented by arc 10 from subject “Jason Thornton” (oval 8 ) to object “Mike Thornton” (oval 2 ).
  • the object “Nancy Frier” is represented by oval 12 and predicate “married to” is represented by arc 14 from subject “Mike. Thornton” (oval 2 ) to object “Nancy Frier” (oval 12 ).
  • FIGS. 6A and 6B can pictorially present the properties of subjects and objects, they can do so in a static fashion.
  • FIG. 6C can illustrate an extended graph for statements concerning “Mike Thornton” taken from a genealogical resource.
  • FIG. 6C can include the statements shown in Table 1.
  • the methods and systems described herein can include providing start and stop time properties to Semantic Web structured resources and statements.
  • the start and stop time properties can specify a lifetime during which a resource or statement can be valid.
  • a call or query to one or more resources can return statement data including the start and stop properties for the subjects and objects of the statements, and/or the statements themselves. Dates can be specified with the call or query such that the returned statements have lifetimes that include the specified dates. The specified dates can be used by a filter after obtaining the data for the query.
  • Screen images of the data can display subject and object nodes and predicate arcs for the statement data.
  • a sequence of screen images can display a timeline of nodes and arcs by adding or hiding nodes and arcs to correspond with the start and stop properties of the statements and nodes. Tools can be provided for the user to navigate through the sequence.
  • a method of displaying Semantic Web statements having start properties and stop properties related to lifetimes of the statements includes displaying subjects and objects of the statements as nodes, displaying predicates of the statements as arcs connecting the nodes and labeled by the predicates, and hiding the nodes and arcs for subjects, objects, and statements having lifetimes outside of a timeframe selected by a user. Hiding can comprise painting the nodes and arcs of those statements to match a background of the display.
  • One aspect of the embodiment includes providing tools by which the user can select the timeframe.
  • the user can be given options to select a start timeframe corresponding to an earliest one of the start properties of the statements, to select an end timeframe corresponding to a latest one of the start properties of the statements, and/or to select a timeframe increment for displaying the statements in temporal order corresponding to the start properties and the stop properties of the statements.
  • Nodes can be labeled with their URI's or with the value of a literal property, such as a name, which may itself vary over time based on the start and stop time properties of statements using that property.
  • a system for displaying graphical representations of time varying information for Semantic Web structured statements includes a processor connected to Semantic Web structured resources and receiving input from a user, including a query to retrieve selected statements matching the query.
  • Application program interfaces APIs
  • the APIs determine the selected statements from the resource and obtain the start and stop properties for subjects and objects of the matching statements and for the statements themselves.
  • the APIs also determine graphical representation data from the selected statements and their properties.
  • the processor receives the graphical representation data and control a display to present the graphical representations of the selected statements.
  • the processor controls the display to hide graphical representations of those statements whose lifetime does not include a timeframe input by the user.
  • the system include an application tool set operable by the user to input the timeframe, wherein the user can select timeframe increments corresponding to the start and stop properties of the selected statements.
  • a method of displaying graphical representations of time varying information for Semantic Web structured statements from Semantic Web resources includes receiving a query to retrieve selected statements that match a query, determining the selected statements from the Semantic Web structured resources, obtaining start and stop properties for subjects and objects of the selected statements and for the statements themselves, determining graphical representation data for the selected statements and the properties, filtering the graphical representation data to control a display to present graphical representations of the statements, and controlling the display to hide the graphical representations of those statements whose lifetimes exclude a selected timeframe.
  • a computer-readable medium includes instructions for controlling a processor to associate a lifetime with a Semantic Web structured statement by implementing a start property for the statement that denotes a start time when the statement becomes valid, and implementing a stop property for the statement that denotes a stop time when the statement ceases to be valid, wherein the lifetime of the statement is denoted by a time interval between the start time and the stop time.
  • the start property and the stop property can be implemented as an XML Schema Datatype, including an xsd:dateTime datatype, an xsd:date datatype and/or a xsd:gYear datatype.
  • the instructions include instructions for controlling a processor to display a plurality of statements on a display by displaying subjects and objects of the statements as nodes, displaying predicates of the statements as arcs connecting the nodes, and hiding nodes and arcs for particular statements when a selected display timeframe is outside the lifetimes of those particular statements.
  • the instructions include instructions for controlling a processor to hide the nodes and arcs by painting the nodes and arcs for those particular statements to match a background of the display.
  • the instructions include instructions for controlling a processor to display a toolset operable by a user to select said timeframe.
  • the toolset can be operable by the user to select a start timeframe corresponding to an earliest one of said start properties of said statements, to select an end timeframe corresponding to a latest one of said stop properties of said statements, and/or to select timeframe increments for displaying the statements in temporal order corresponding to their start properties and stop properties.
  • FIG. 1 illustrates a screen image of a graphical representation of statements taken from a Semantic Web resource
  • FIGS. 2A-2I illustrate time varying graphical representations of the statements of FIG. 1 ;
  • FIG. 3 illustrates a system for providing time varying graphical representations of statements from a Semantic Web resource
  • FIG. 4 illustrates allow chart of a method of implementing time varying graphical representations of statements from a Semantic Web resource
  • FIG. 5A illustrates a statement associated directly with start and stop properties
  • FIG. 5B illustrates a statement having multiple Interval instances.
  • FIG. 5C illustrates a reified version of a statement.
  • FIGS. 6A-6C illustrate prior art graphical representations of statements from Semantic Web structured resources
  • the illustrated embodiments can be understood as providing exemplary features of varying detail of certain embodiments, and therefore, unless otherwise specified, features, components, modules, and/or aspects of the illustrations can be otherwise combined, separated, interchanged, and/or rearranged without departing from the disclosed systems or methods. Additionally, the shapes and sizes of components are also exemplary and unless otherwise specified, can be altered without affecting the disclosed systems or methods.
  • FIG. 1 shows a screen image of a graphical representation of RDF statements from a Semantic Web resource.
  • the graphical representation of FIG. 1 can include the statements from the genealogical resource as in FIG. 6C .
  • the elements in FIG. 1 having numbering offset by 100 from those of FIG. 6C refer to corresponding elements of the statements described with respect to FIG. 6C . It can be understood that the numbering of elements in FIG. 1 and other figures described further herein, is shown for ease in describing the features of the graphical representations and need not be viewable by a user.
  • the RDF statements and Semantic Web resources for use with the methods and systems described herein can have associated start and stop properties.
  • the time interval starting with a specified start time and before a specified stop time can be referred to as the lifetime of the statement or resource.
  • Closed lifetimes include lifetimes having both start and stop times specified.
  • Open-ended lifetimes include those having one of the start or stop times specified.
  • Infinite lifetimes include those having neither a start or stop time specified.
  • the Resource Description Framework from the World Wide Web Consortium (W3C) can underlie most Semantic Web efforts.
  • W3C World Wide Web Consortium
  • the start and stop properties can include various known protocols or datatypes for providing and communicating such properties among resources and applications, the use of standardized protocols, properties, and datatypes can be preferred so as to provide for wide use of the methods and systems described herein.
  • the start and stop properties can make use of the xsd:dateTime datatype from the W3C XML Schema Datatypes Recommendation, though other datatypes, e.g., xsd:date orxsd:gYear, can be used.
  • instances of the class Interval can be used to group start/stop intervals.
  • the statement can have multiple Interval instances, which each can have its own start and stop properties.
  • FIG. 5A illustrates an example of statement 502 (a reified version of statement is shown in FIG. 5C ) having start property 504 and stop property 506 directly associated with statement 502 .
  • FIG. 5B illustrates the example of FIG. 5A , wherein statement 502 has multiple instances 508 , 510 of the class Interval 512 .
  • Instance 508 with respective start and stop properties 504 and 506 , corresponds with the interval for statement 502 of FIG. 5A
  • instance 510 shows the addition to statement 502 of a second interval with start property 514 .
  • the first interval 508 of the marriage can indicate the marriage (statement 502 ) began in 1960 (start property 504 ) and ended in 1970 (stop property 506 ).
  • the second interval 510 can indicate that the same marriage, i.e., marriage between the same two people, began again in 1980 (start property 514 ).
  • Intervals can be associated with instances as well as with statements.
  • the lifetime of a statement can also be constrained by the lifetimes of resources that it can reference as a subject or object. For example, a marriage relation ends when one of the participants dies.
  • Start and stop properties will typically be associated with statements by using RDF statementIDs.
  • RDF statementIDs can result in both asserted and reified statements.
  • the technique can be equally applied to content involving only reified statements. When applied to such content, the graph structure for each reified statement can be constructed explicitly without the use of statement IDs.
  • FIG. 3 illustrates an exemplary system 200 for presenting time-varying information to a user 202 from one or more Semantic Web structured resources 204 .
  • User 202 can connect to network 206 via processor 208 .
  • One or more servers 210 can facilitate connections to network 206 by user 202 and resources 204 , though it can be understood that processor 208 and/or resources 204 can be configured for direct connection to network 206 .
  • Processor 208 can include a display 212 by which screen images, such as screen image 100 of FIG. 1 and the screen images of FIGS. 2A-I can be viewed by the user 202 .
  • FIG. 4 is a flow chart for a method 400 of implementing time varying graphical representations of statements from a semantic web resource.
  • User 202 of FIG. 3 can query ( 402 ) one or more Semantic Web structured resources, such as resources 204 of FIG. 3 , using.
  • Application Program Interfaces (APIs) 214 As previously described with respect to FIGS. 6A-C , APIs for Semantic Web languages can include models containing sets of RDF Statements, as well as graphical representations linking resources and statements.
  • the APIs 214 of FIG. 3 for the systems and methods described herein can include obtaining the start and stop properties for the statements and resources selected by the user 202 and using the start and stop properties in displaying time varying graphical representation to user 202 .
  • servers 210 and/or resources 204 can include APIs 214 , or that APIs 214 can be distributed among one or more servers 210 ; and/or resources 204 .
  • Table 2 shows exemplary stop and start properties for the subjects, objects, and statements of FIG. 1 .
  • start and stop properties can be associated with the subjects and objects of the statements, as well as the statements themselves.
  • the subject (Mike Thornton) of statement 1 of Table 2 has a start date of 05/29/57, indicating Mike Thornton's birth date, and an open stop date, indicating Mike Thornton is living.
  • the statement with predicate father has a start date corresponding to Mike Thornton's birth date and a stop date of 06/14/92, indicating the father relationship with Joe Thornton ends on that date. By looking at the object (Joe Thornton) stop date, it can be seen that 06/14/92 corresponds to Joe Thornton's death, the reason for the stop date for the statement.
  • start and start properties can be associated with the statements and resources.
  • statement 1 can have a start property of 5/29/57, corresponding to the date Mike Thornton was born, and a stop property of 06/14/92.
  • the stop property can refer to a number of events by which the father relationship of Mike and Joe Thornton can end, including Mike's or Joe's death.
  • start and stop properties associated with subjects and objects can be used to obtain start and stop properties for the related statements as listed in Table 2. For example, the statements “Joe Thornton has a birth event of Mar.
  • Joe Thornton has a death event of 06/14/92 can be used to determine the start and stop properties for Joe Thornton.
  • the absence of a statement for a death event for Mike Thornton can indicate Mike Thornton has an open stop property.
  • the above can illustrate that the lifetime of a statement can be further restrained by the lifetimes of its subject and object.
  • APIs 214 of FIG. 3 in response to the user 202 query, can obtain ( 404 ) the statements with start and stop properties from resources 204 matching the user 202 query, including the start and stop properties for the statements, as shown in Table 2, and can determine ( 406 ) the corresponding data for the graphical representations.
  • Processor 208 of FIG. 3 can receive ( 408 ) the data and display ( 410 ) the corresponding screen image, such as image 100 of FIG. 1 .
  • Screen image 100 includes a view 130 in which the graphical representation can be displayed.
  • Screen image 100 includes one or more file and view manipulation tools, such as pull down menus 132 , action buttons 134 and scroll bar 136 .
  • screen image 100 includes time varying activation buttons, including START button 138 , NEXT button 140 , PREV (previous) button 142 and END button 144 .
  • varying means for implementing the functions or actions to be described with relation to the activation buttons can be used, including pull down menus, icons, keyboard entries, etc., and that the activation buttons shown in FIG. 1 are for illustrative purposes and are not restrictive as to the type, style and/or design of means user 202 can employ for displaying the time varying data provided by APIs 214 .
  • the choice of an activation button by user 202 is illustrated at 412 .
  • method 400 determines the earliest or base start property date ( 414 ), stores the date as the current active date ( 416 ) and displays ( 418 ) the corresponding subjects, objects and/or statements.
  • the display can include the one subject or object corresponding to the earliest start property.
  • displaying the corresponding subject or object at 418 includes hiding subjects, objects and statements not to be displayed as by painting those subjects, objects, or statements in the background color of the screen image.
  • the earliest start date (03/16/28) corresponds with Joe Thornton ( 104 ).
  • FIG. 2A illustrates the corresponding screen image 100 a , wherein the subjects, objects, and statements besides Joe Thornton ( 104 ) are hidden.
  • method 400 determines the next earliest start or stop property date ( 420 ) based on the stored current active date and again the method 400 stores the date determined as the current active date ( 422 ). If a start property is the next earliest date, as determined at 424 , the display of the corresponding subjects, objects and/or predicates is added ( 426 ) to the screen image. When 424 determines that a stop property is the next earliest date, the display of the corresponding subjects, objects and/or predicates is hidden ( 428 ) from the screen image.
  • FIGS. 2B-I illustrates selection of the NEXT button 140 from FIG. 2A .
  • the next earliest date (11/04/29) corresponds to a start property for Louise Hensley.
  • Louise Hensley ( 18 ) can be added to the screen image.
  • FIGS. 2C-G correspond to the start property dates for statement 8 (“Joe Thornton married to ( 28 ) Louise Hensley”) (9/17/55), Mike Thornton (5/29/57), Nancy Frier (08/19/58), statement 3 (“Mike Thornton married to ( 14 ) Nancy Frier”) (11/08/82), and Jason Thornton (08/05/87), respectively.
  • statement 8 (“Joe Thornton married to ( 28 ) Louise Hensley”) (9/17/55), Mike Thornton (5/29/57), Nancy Frier (08/19/58), statement 3 (“Mike Thornton married to ( 14 ) Nancy Frier”) (11/08/82), and Jason Thornton (08/05/87), respectively.
  • FIGS. 2B-I illustrate
  • Table 2 includes additional statements 3a, 3b, 8a and 8b associated with statements 3 and 8, respectively, as indicated below in Table 2A.
  • next earliest date corresponds to a stop property for Joe Thornton (06/14/92).
  • Joe Thornton ( 4 ) and the associated predicates “father” ( 6 ) and “married to” ( 28 ) are hidden.
  • the selection of NEXT from FIG. 2H determines that the next earliest date corresponds to start date (02/15/94) for Arthur Thornton ( 22 ).
  • start date 02/15/94
  • the method 400 can hide ( 430 ) corresponding subjects, objects, and/or statements for the current active date when the current active date is a start property date, as determined at 432 .
  • the method 400 adds ( 434 ) the corresponding subjects, objects, and/or statements for the current active date.
  • the method 400 determines ( 436 ) and stores the previous earlier date as the current active date ( 438 ). It can be seen that selection of the PREV button 142 reverses the process described in relation with selection of the NEXT button 140 and the sequence of screen images 100 b - i of FIGS. 2B-I .
  • the method 400 determines ( 440 ) the latest property date and store the latest date as the current date ( 442 ).
  • Method 400 can displays ( 444 ) the subjects, predicates and objects for the statements and hide ( 446 ) those subjects, objects, and statements having stop properties equal to or less than the determined current date.
  • FIG. 2I illustrates the resulting screen image 100 i when the user 202 chooses the END button 144 for the exemplary data of Table 2 and Table 2A.
  • the flow chart for method 400 indicates that after displaying the appropriate screen image (as at 418 , 426 , 428 , 438 and 446 ) method 400 can return to 412 to await further button activations by user 202 .
  • User 202 can end the display or return to perform new queries using the file or view manipulation tools, such as pull down menus 132 .
  • start and stop properties for the statements and resources can be used to filter the statements returned by APIs 214 .
  • user 202 can specify a date, or range of dates with the query at 402 .
  • APIs 214 can obtain the start and stop properties ( 404 ) and return the graphical representation data ( 406 ) for those statements having a lifetime that includes the date(s) specified.
  • user 202 can specify the current date.
  • the lifetimes of statements 2-7, 3a, 3b, 8a and 8b include the current date, and those statements will be returned by APIs 214 .
  • the screen image for the specified date can include screen image 100 i of FIG. 2I .
  • the APIs 214 can return statements having lifetimes that overlap the specified range of dates.
  • user 202 can specify dates in the range of 01/01/50 to 01/01/90.
  • the lifetimes of statements 1-4, 6, 8, 3a, 3b, 8a and 8b can include the specified range and it can be seen that the screen image for the specified range can include screen image 100 g of FIG. 2G .
  • APIs 214 can typically return statements including the current date, the current date can be adjusted to provide for date ranges, without having to re-fetch the data.
  • scroll bar 136 of FIG. 1 can represent a timeline corresponding to the time from the earliest start property date of the returned statements to the latest stop property date of the returned statements.
  • the scroll bar can represent a timeline from the birth of Joe Thornton (03/16/28) to the current date.
  • Slide 146 illustrated in FIGS. 2A-I , can be positioned on scroll bar 136 and can correspond to selecting a date for the screen image to be presented. Slide 146 can be activated when user 202 chooses one of the buttons 138 - 144 , as indicated in phantom at 448 in FIG. 4 . Thus, slide 146 can be inactive or hidden in screen image 100 of FIG. 1 .
  • FIG. 2F illustrates slide 146 positioned at 01/01/85, thus screen image 100 f can include statements having lifetimes that include the date 01/01/85.
  • the systems and methods described herein may not be limited to a particular hardware or software configuration.
  • the techniques described herein can be implemented in hardware or software, or a combination thereof.
  • the systems and methods can be implemented in one or more computer programs executing on one or more programmable computers, such as may be exemplified by processor 208 , servers 210 , or APIs 214 , among others, that include a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), one or more input devices, and one or more output devices.
  • the computer programs, or programs may be preferably implemented using one or more high level procedural or object-oriented programming languages to communicate with a computer system; however, the program(s) can be implemented in assembly or machine language, if desired.
  • the language can be compiled or interpreted.
  • the computer program(s) can be preferably stored on a storage medium or device (e.g., CD-ROM, hard disk, or magnetic disk) readable by a general or special purpose programmable computer for configuring and operating the computer when the storage medium or device is read by the computer to perform the procedures described herein.
  • the system can also be considered to be implemented as a computer-readable storage medium, configured with a computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner.
  • the processor(s) can thus be embedded in one or more devices that can be operated independently or together in a networked environment, where the network can include, for example, a Local Area Network (LAN), wide area network (WAN), and/or can include an intranet and/or the Internet and/or another network.
  • the network(s) can be wired or wireless or a combination thereof and can use one or more communications protocols to facilitate communications between the different processors.
  • the processors can be configured for distributed processing and can utilize, in some embodiments, a client-server model as needed. Accordingly, the methods and systems can utilize multiple processors and/or processor devices, and the processor instructions can be divided amongst such single or multiple processor/devices.
  • the device(s) or computer systems that integrate with the processor(s) can include, for example, a personal computer(s), workstation (e.g., Sun, HP), personal digital assistant (PDA), handheld device such as cellular telephone, laptop, handheld, or another device capable of being integrated with a processor(s) that can operate as provided herein. Accordingly, the devices provided herein are not exhaustive and are provided for illustration and not limitation.
  • workstation e.g., Sun, HP
  • PDA personal digital assistant
  • handheld device such as cellular telephone, laptop, handheld, or another device capable of being integrated with a processor(s) that can operate as provided herein. Accordingly, the devices provided herein are not exhaustive and are provided for illustration and not limitation.
  • references to “a microprocessor” and “a processor”, or “the microprocessor” and “the processor,” can be understood to include one or more microprocessors that can communicate in a stand-alone and/or a distributed environment(s), and can thus can be configured to communicate via wired or wireless communications with other processors, where such one or more processor can be configured to operate on one or more processor-controlled devices that can be similar or different devices.
  • references to memory can include one or more processor-readable and accessible memory elements and/or components that can be internal to the processor-controlled device, external to the processor-controlled device, and can be accessed via a wired or wireless network using a variety of communications protocols, and unless otherwise specified, can be arranged to include a combination of external and internal memory devices, where such memory can be contiguous and/or partitioned based on the application.
  • references to a database can be understood to include one or more memory associations, where such references can include commercially available database products (e.g., SQL, Informix, Oracle) and also proprietary databases, and may also include other structures for associating memory such as links, queues, graphs, trees, with such structures provided for illustration and not limitation.
  • references to a network can include one or more intranets and/or the Internet.
  • References herein to microprocessor instructions or microprocessor-executable instructions, in accordance with the above, can be understood to include programmable hardware.

Abstract

Methods and systems for providing start and stop properties to Semantic Web structured resources and statements are disclosed. The start and stop properties can specify a lifetime during which a resource or statement can be valid. A call or query to one or more resources can return statement data including the start and stop properties for the resources and/or statements. Dates can be specified with the call or query such that the returned resources and statements have lifetimes including the specified dates. Screen images of the data can display subject and object nodes and predicate arcs for the selected dates. A sequence of screen images can display a timeline of nodes and arcs by adding or hiding nodes and arcs to correspond with the start and stop properties of the statements. Tools are provided for the user to navigate through the sequence.

Description

RELATED APPLICATIONS
This application is a continuation of copending, commonly assigned U.S. patent application Ser. No. 10/806,406, filed on Mar. 23, 2004, which claims priority to U.S. Provisional Patent Application No. 60/465,925, filed on Apr. 28, 2003. Both of these applications are incorporated by reference herein in their entirety. This application is co-pending with a related patent application entitled “Methods and Apparatus for Focusing Search Results on the Semantic Web” Ser. No. 10/803,551, by the same inventor and having assignee in common, filed concurrently herewith and incorporated by reference herein in its entirety.
GOVERNMENT INTEREST
The United States Government has a paid-up license in this invention and the right in limited circumstances to require the patent owner to license to others on reasonable terms as provided for by the terms of Contract No. F30602-00-C-0178 awarded by the Defense Advanced Research Projects Agency.
FIELD
The methods and systems relate to representing, using and displaying information, and more particularly to methods and systems for representing, using and displaying time-varying information on the Semantic Web.
BACKGROUND
The Semantic Web is an evolving collection of software tools and content, which provides information on the Internet, or World Wide Web, in such a way that it can be readily used by intelligent agents and other computer programs. Information on the Semantic Web, rather than being in natural language text, can be maintained in a structure workable by both computers and people. The Resource Description Framework (RDF) from the World Wide Web Consortium (W3C) underlies most Semantic Web efforts. RDF consists of statements (subject-predicate-object triples) made about instances of specific classes (similar to an object-oriented programming language).
The Resource Description Framework (RDF) is a general framework for how to describe an Internet resource such as a Web site and its content. An Internet resource is defined herein as a resource with a Uniform Resource Identifier (URI), including the Uniform Resource Locators (URLs) that identify Web sites as well as specific Web pages. Resources can also be physical objects (such as people) represented on Web pages. As with known HyperText Markup Language (HTML) META tags, the RDF description statements, encased as part of an Extensible Markup Language (XML) section, can be included within a Web page (HTML file), or can be in separate files.
RDF description statements can be represented as graphs containing nodes (instances or string literals) and arcs (statements). FIG. 6A provides an example of such a graph for an RDF statement of the form, “Mike Thornton has a father Joe Thornton.” For this RDF statement, “Mike Thornton” is the subject, “father” is the predicate, and “Joe Thornton” is the object. In the exemplary diagram, or graph of FIG. 6A, the ovals can illustrate nodes representing resources (ovals 2 and 4), and arcs can represent the named property, as shown by arc 6. The direction of the arc can be from subject (2) to object (4). It can be understood that other representations besides the illustrated ovals and directional arcs can be used.
FIG. 6B illustrates a graph of a collection of statements in which “Mike Thornton” (using an abbreviated form to represent a full URI) can be both the subject and object of various ones of the statements, including, “Jason Thornton has a father Mike Thornton,” and “Mike Thornton is married to Nancy Frier.” The subject “Jason Thornton” is represented by oval 8 and predicate “father” is represented by arc 10 from subject “Jason Thornton” (oval 8) to object “Mike Thornton” (oval 2). The object “Nancy Frier” is represented by oval 12 and predicate “married to” is represented by arc 14 from subject “Mike. Thornton” (oval 2) to object “Nancy Frier” (oval 12).
While such graphs as illustrated in FIGS. 6A and 6B can pictorially present the properties of subjects and objects, they can do so in a static fashion. For example, FIG. 6C can illustrate an extended graph for statements concerning “Mike Thornton” taken from a genealogical resource. In addition to the statements in FIG. 6R, FIG. 6C can include the statements shown in Table 1.
Statement Subject (Identifier) Predicate (Identifier) Object (Identifier)
Mike Thornton has a Mike Thornton (2) mother (16) Louise Hensley (18)
mother Louise Hensley
Noah Thornton has a Noah Thornton (22) father (24) Mike Thornton (2)
father Mike Thornton
Jason Thornton has a Jason Thornton (8) mother (20) Nancy Frier (12)
mother Nancy Frier
Noah Thornton has a Noah Thornton (22) mother (26) Nancy Frier (12)
mother Nancy Frier
Joe Thornton is married Joe Thornton (4) married to (28) Louise Hensley (18)
to Louise Hensley
It can be seen that Mike Thornton is neither the subject nor object of the last three statements in Table 1. However, these statements can be included in the graphical representation as having both subjects and objects in common with statements concerning “Mike Thornton.”
Without additional statements providing dates for such events as births, deaths, or marriages, a user cannot determine time varying information from the graphs of FIGS. 6A-C. For example, one cannot assess whether Noah is older or younger than Jason, or the relative ages of other individuals shown. Other time varying information, such as multiple marriages, can also present difficulties for the representations of FIGS. 6A-C. Methods and systems are needed for determining and graphically representing such information from Semantic Web structured resources to a user.
SUMMARY
The methods and systems described herein can include providing start and stop time properties to Semantic Web structured resources and statements. The start and stop time properties can specify a lifetime during which a resource or statement can be valid. A call or query to one or more resources can return statement data including the start and stop properties for the subjects and objects of the statements, and/or the statements themselves. Dates can be specified with the call or query such that the returned statements have lifetimes that include the specified dates. The specified dates can be used by a filter after obtaining the data for the query. Screen images of the data can display subject and object nodes and predicate arcs for the statement data. A sequence of screen images can display a timeline of nodes and arcs by adding or hiding nodes and arcs to correspond with the start and stop properties of the statements and nodes. Tools can be provided for the user to navigate through the sequence.
In one embodiment, a method of displaying Semantic Web statements having start properties and stop properties related to lifetimes of the statements includes displaying subjects and objects of the statements as nodes, displaying predicates of the statements as arcs connecting the nodes and labeled by the predicates, and hiding the nodes and arcs for subjects, objects, and statements having lifetimes outside of a timeframe selected by a user. Hiding can comprise painting the nodes and arcs of those statements to match a background of the display. One aspect of the embodiment includes providing tools by which the user can select the timeframe. The user can be given options to select a start timeframe corresponding to an earliest one of the start properties of the statements, to select an end timeframe corresponding to a latest one of the start properties of the statements, and/or to select a timeframe increment for displaying the statements in temporal order corresponding to the start properties and the stop properties of the statements. Nodes can be labeled with their URI's or with the value of a literal property, such as a name, which may itself vary over time based on the start and stop time properties of statements using that property.
In one embodiment, a system for displaying graphical representations of time varying information for Semantic Web structured statements includes a processor connected to Semantic Web structured resources and receiving input from a user, including a query to retrieve selected statements matching the query. Application program interfaces (APIs) determine the selected statements from the resource and obtain the start and stop properties for subjects and objects of the matching statements and for the statements themselves. The APIs also determine graphical representation data from the selected statements and their properties. The processor receives the graphical representation data and control a display to present the graphical representations of the selected statements. The processor controls the display to hide graphical representations of those statements whose lifetime does not include a timeframe input by the user. The system include an application tool set operable by the user to input the timeframe, wherein the user can select timeframe increments corresponding to the start and stop properties of the selected statements.
In one embodiment, a method of displaying graphical representations of time varying information for Semantic Web structured statements from Semantic Web resources includes receiving a query to retrieve selected statements that match a query, determining the selected statements from the Semantic Web structured resources, obtaining start and stop properties for subjects and objects of the selected statements and for the statements themselves, determining graphical representation data for the selected statements and the properties, filtering the graphical representation data to control a display to present graphical representations of the statements, and controlling the display to hide the graphical representations of those statements whose lifetimes exclude a selected timeframe.
In one embodiment, a computer-readable medium includes instructions for controlling a processor to associate a lifetime with a Semantic Web structured statement by implementing a start property for the statement that denotes a start time when the statement becomes valid, and implementing a stop property for the statement that denotes a stop time when the statement ceases to be valid, wherein the lifetime of the statement is denoted by a time interval between the start time and the stop time. The start property and the stop property can be implemented as an XML Schema Datatype, including an xsd:dateTime datatype, an xsd:date datatype and/or a xsd:gYear datatype.
The instructions include instructions for controlling a processor to display a plurality of statements on a display by displaying subjects and objects of the statements as nodes, displaying predicates of the statements as arcs connecting the nodes, and hiding nodes and arcs for particular statements when a selected display timeframe is outside the lifetimes of those particular statements. The instructions include instructions for controlling a processor to hide the nodes and arcs by painting the nodes and arcs for those particular statements to match a background of the display.
The instructions include instructions for controlling a processor to display a toolset operable by a user to select said timeframe. The toolset can be operable by the user to select a start timeframe corresponding to an earliest one of said start properties of said statements, to select an end timeframe corresponding to a latest one of said stop properties of said statements, and/or to select timeframe increments for displaying the statements in temporal order corresponding to their start properties and stop properties.
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate several embodiments of the invention and together with the description, serve to explain the principles of the invention.
FIG. 1 illustrates a screen image of a graphical representation of statements taken from a Semantic Web resource;
FIGS. 2A-2I illustrate time varying graphical representations of the statements of FIG. 1;
FIG. 3 illustrates a system for providing time varying graphical representations of statements from a Semantic Web resource;
FIG. 4 illustrates allow chart of a method of implementing time varying graphical representations of statements from a Semantic Web resource;
FIG. 5A illustrates a statement associated directly with start and stop properties; and
FIG. 5B illustrates a statement having multiple Interval instances.
FIG. 5C illustrates a reified version of a statement.
FIGS. 6A-6C illustrate prior art graphical representations of statements from Semantic Web structured resources;
DETAILED DESCRIPTION
To provide an overall understanding, certain illustrative embodiments will now be described; however, it will be understood by one of ordinary skill in the art that the systems and methods described herein can be adapted and modified to provide systems and methods for other suitable applications and that other additions and modifications can be made without departing from the scope of the systems and methods described herein.
Unless otherwise specified, the illustrated embodiments can be understood as providing exemplary features of varying detail of certain embodiments, and therefore, unless otherwise specified, features, components, modules, and/or aspects of the illustrations can be otherwise combined, separated, interchanged, and/or rearranged without departing from the disclosed systems or methods. Additionally, the shapes and sizes of components are also exemplary and unless otherwise specified, can be altered without affecting the disclosed systems or methods.
FIG. 1 shows a screen image of a graphical representation of RDF statements from a Semantic Web resource. For simplicity, the graphical representation of FIG. 1 can include the statements from the genealogical resource as in FIG. 6C. The elements in FIG. 1 having numbering offset by 100 from those of FIG. 6C refer to corresponding elements of the statements described with respect to FIG. 6C. It can be understood that the numbering of elements in FIG. 1 and other figures described further herein, is shown for ease in describing the features of the graphical representations and need not be viewable by a user.
In addition to the subject, predicate and object for each statement, the RDF statements and Semantic Web resources for use with the methods and systems described herein can have associated start and stop properties. The time interval starting with a specified start time and before a specified stop time can be referred to as the lifetime of the statement or resource. Closed lifetimes include lifetimes having both start and stop times specified. Open-ended lifetimes include those having one of the start or stop times specified. Infinite lifetimes include those having neither a start or stop time specified.
The Resource Description Framework (RDF) from the World Wide Web Consortium (W3C) can underlie most Semantic Web efforts. While implementation of the start and stop properties can include various known protocols or datatypes for providing and communicating such properties among resources and applications, the use of standardized protocols, properties, and datatypes can be preferred so as to provide for wide use of the methods and systems described herein. Thus, in one embodiment, the start and stop properties can make use of the xsd:dateTime datatype from the W3C XML Schema Datatypes Recommendation, though other datatypes, e.g., xsd:date orxsd:gYear, can be used.
If multiple time intervals are associated with a given statement or resource (instance), e.g., a marriage relation between two people who divorce and then remarry each other, then instances of the class Interval can be used to group start/stop intervals. Thus, rather than having start and stop properties associated directly with the object or statement, the statement can have multiple Interval instances, which each can have its own start and stop properties.
FIG. 5A illustrates an example of statement 502 (a reified version of statement is shown in FIG. 5C) having start property 504 and stop property 506 directly associated with statement 502. FIG. 5B illustrates the example of FIG. 5A, wherein statement 502 has multiple instances 508, 510 of the class Interval 512. Instance 508, with respective start and stop properties 504 and 506, corresponds with the interval for statement 502 of FIG. 5A, while instance 510 shows the addition to statement 502 of a second interval with start property 514. For the marriage relation example discussed above, the first interval 508 of the marriage can indicate the marriage (statement 502) began in 1960 (start property 504) and ended in 1970 (stop property 506). The second interval 510 can indicate that the same marriage, i.e., marriage between the same two people, began again in 1980 (start property 514). Intervals can be associated with instances as well as with statements.
In addition to its start and stop properties, the lifetime of a statement can also be constrained by the lifetimes of resources that it can reference as a subject or object. For example, a marriage relation ends when one of the participants dies.
Start and stop properties will typically be associated with statements by using RDF statementIDs. The use of RDF statementIDs can result in both asserted and reified statements. The technique can be equally applied to content involving only reified statements. When applied to such content, the graph structure for each reified statement can be constructed explicitly without the use of statement IDs.
The screen images of FIGS. 1 and 2A-I can be described with relation to the systems 200 and method 400 of FIGS. 3 and 4, respectively. FIG. 3 illustrates an exemplary system 200 for presenting time-varying information to a user 202 from one or more Semantic Web structured resources 204. User 202 can connect to network 206 via processor 208. One or more servers 210 can facilitate connections to network 206 by user 202 and resources 204, though it can be understood that processor 208 and/or resources 204 can be configured for direct connection to network 206. Processor 208 can include a display 212 by which screen images, such as screen image 100 of FIG. 1 and the screen images of FIGS. 2A-I can be viewed by the user 202.
FIG. 4 is a flow chart for a method 400 of implementing time varying graphical representations of statements from a semantic web resource. User 202 of FIG. 3 can query (402) one or more Semantic Web structured resources, such as resources 204 of FIG. 3, using. Application Program Interfaces (APIs) 214. As previously described with respect to FIGS. 6A-C, APIs for Semantic Web languages can include models containing sets of RDF Statements, as well as graphical representations linking resources and statements. In addition, the APIs 214 of FIG. 3 for the systems and methods described herein can include obtaining the start and stop properties for the statements and resources selected by the user 202 and using the start and stop properties in displaying time varying graphical representation to user 202. While the APIs 214 are shown in FIG. 3 as directly accessible, or as part of processor 208, it can be understood that servers 210 and/or resources 204 can include APIs 214, or that APIs 214 can be distributed among one or more servers 210; and/or resources 204.
Table 2 shows exemplary stop and start properties for the subjects, objects, and statements of FIG. 1.
TABLE 2
Subject Object
(Identifier) (Identifier)
Start Predicate Start
Statement Stop (Identifier) Stop Start Stop
1. Mike Mike Thornton father (106) Joe Thornton May 29, 1957 Jun. 14, 1992
Thornton has (102) (104)
a father Joe May 29, 1957 Mar. 16, 1928
Thornton Jun. 14, 1992
2. Jason Jason Thornton father (110) Mike Thornton Aug. 05, 1987
Thornton has (108) (102)
a father Mike Aug. 05, 1987 May 29, 1957
Thornton
3. Mike Mike Thornton married to (114) Nancy Frier Nov. 02, 1982
Thornton is (102) (112)
married to May 29, 1957 Aug. 19, 1958
Nancy Frier
4. Mike Mike Thornton mother (116) Louise Hensley May 29, 1957
Thorton has a (102) (118)
mother May 29, 1957 Nov. 04, 1929
Louise
Thornton
5. Noah Noah Thornton father (124) Mike Thornton Feb. 15, 1994
Thornton has (122) (102)
a father Mike Feb. 15, 1994 May 29, 1957
Thornton
6. Jason Jason Thornton mother (120) Nancy Frier Aug. 05, 1987
Thornton has (108) (112)
a mother Aug. 05, 1987 Aug. 19, 1958
Nancy Frier
7. Noah Noah Thornton mother (126) Nancy Frier Feb. 15, 1994
Thornton has (122) (112)
a mother Feb. 15, 1994 Aug. 19, 1958
Nancy Frier
8. Joe Joe Thornton married to (128) Louise Hensley Sep. 17, 1955 Jun. 14, 1992
Thornton is (104) (118)
married to Mar. 16, 1928 Nov. 04, 1929
Louise Jun. 14, 1992
Hensley

As indicated in Table 2, start and stop properties can be associated with the subjects and objects of the statements, as well as the statements themselves. For example, the subject (Mike Thornton) of statement 1 of Table 2 has a start date of 05/29/57, indicating Mike Thornton's birth date, and an open stop date, indicating Mike Thornton is living. The statement with predicate father has a start date corresponding to Mike Thornton's birth date and a stop date of 06/14/92, indicating the father relationship with Joe Thornton ends on that date. By looking at the object (Joe Thornton) stop date, it can be seen that 06/14/92 corresponds to Joe Thornton's death, the reason for the stop date for the statement.
In one embodiment consistent with the invention, start and start properties can be associated with the statements and resources. Continuing with the example of statement 1 of Table 2, in this embodiment statement 1 can have a start property of 5/29/57, corresponding to the date Mike Thornton was born, and a stop property of 06/14/92. Without further information, the stop property can refer to a number of events by which the father relationship of Mike and Joe Thornton can end, including Mike's or Joe's death. In this embodiment, start and stop properties associated with subjects and objects can be used to obtain start and stop properties for the related statements as listed in Table 2. For example, the statements “Joe Thornton has a birth event of Mar. 16, 1928” “Joe Thornton has a death event of 06/14/92” can be used to determine the start and stop properties for Joe Thornton. The absence of a statement for a death event for Mike Thornton can indicate Mike Thornton has an open stop property. The above can illustrate that the lifetime of a statement can be further restrained by the lifetimes of its subject and object.
Referring again to FIG. 4, APIs 214 of FIG. 3, in response to the user 202 query, can obtain (404) the statements with start and stop properties from resources 204 matching the user 202 query, including the start and stop properties for the statements, as shown in Table 2, and can determine (406) the corresponding data for the graphical representations. Processor 208 of FIG. 3 can receive (408) the data and display (410) the corresponding screen image, such as image 100 of FIG. 1. Screen image 100 includes a view 130 in which the graphical representation can be displayed. Screen image 100 includes one or more file and view manipulation tools, such as pull down menus 132, action buttons 134 and scroll bar 136.
In addition to such known items or tools, screen image 100 includes time varying activation buttons, including START button 138, NEXT button 140, PREV (previous) button 142 and END button 144. It can be understood that varying means for implementing the functions or actions to be described with relation to the activation buttons can be used, including pull down menus, icons, keyboard entries, etc., and that the activation buttons shown in FIG. 1 are for illustrative purposes and are not restrictive as to the type, style and/or design of means user 202 can employ for displaying the time varying data provided by APIs 214. In the exemplary embodiment of FIG. 4, the choice of an activation button by user 202 is illustrated at 412.
When user 202 chooses start button 138, method 400 determines the earliest or base start property date (414), stores the date as the current active date (416) and displays (418) the corresponding subjects, objects and/or statements. For the earliest property, the display can include the one subject or object corresponding to the earliest start property. In one embodiment, displaying the corresponding subject or object at 418 includes hiding subjects, objects and statements not to be displayed as by painting those subjects, objects, or statements in the background color of the screen image. For the exemplary statements of Table 2, the earliest start date (03/16/28) corresponds with Joe Thornton (104). FIG. 2A illustrates the corresponding screen image 100 a, wherein the subjects, objects, and statements besides Joe Thornton (104) are hidden.
When the NEXT button 140 is chosen, method 400 determines the next earliest start or stop property date (420) based on the stored current active date and again the method 400 stores the date determined as the current active date (422). If a start property is the next earliest date, as determined at 424, the display of the corresponding subjects, objects and/or predicates is added (426) to the screen image. When 424 determines that a stop property is the next earliest date, the display of the corresponding subjects, objects and/or predicates is hidden (428) from the screen image.
FIGS. 2B-I illustrates selection of the NEXT button 140 from FIG. 2A. For FIG. 2B, the next earliest date (11/04/29) corresponds to a start property for Louise Hensley. Thus, Louise Hensley (18) can be added to the screen image. FIGS. 2C-G correspond to the start property dates for statement 8 (“Joe Thornton married to (28) Louise Hensley”) (9/17/55), Mike Thornton (5/29/57), Nancy Frier (08/19/58), statement 3 (“Mike Thornton married to (14) Nancy Frier”) (11/08/82), and Jason Thornton (08/05/87), respectively. In one embodiment, illustrated with particularity in FIGS. 2C and 2F, it can be seen that the “married to” predicate can also correspond to a change of the name property used to label the nodes for Louise Hensley and Nancy Frier, respectively. Such name changes can be reflected in the statements returned by APIs 214. For example, Table 2 includes additional statements 3a, 3b, 8a and 8b associated with statements 3 and 8, respectively, as indicated below in Table 2A.
TABLE 2A
Subject (Identifier)
Start Predicate Object
Statement Stop (Identifier) (Literal) Start Stop
3a. Person has Person name “Nancy Frier” Aug. 19, 1958 Nov. 08, 1982
a name “Nancy Aug. 19, 1958
Frier”
3b. Person has Person name “Nancy Nov. 02, 1982
a name “Nancy Aug. 19, 1958 Thornton”
Thornton”
8a. Person has Person name “Louise Nov. 04, 1929 Sep. 15, 1955-
a name “Louise Nov. 04, 1929 Hensley”
Hensley”
b. Person has a Person name “Louise Sep. 17, 1955
name “Louise Nov. 04, 1929 Thornton”
Thornton”
Continuing with the selection of NEXT from FIG. 2G, the next earliest date corresponds to a stop property for Joe Thornton (06/14/92). Thus, in FIG. 2H, Joe Thornton (4) and the associated predicates “father” (6) and “married to” (28) are hidden. The selection of NEXT from FIG. 2H determines that the next earliest date corresponds to start date (02/15/94) for Noah Thornton (22). Thus, in FIG. 2I Noah Thornton (22) is added, as well as predicates “father” (24) and “mother” (26).
When the PREV button 142 is chosen, the method 400 can hide (430) corresponding subjects, objects, and/or statements for the current active date when the current active date is a start property date, as determined at 432. When the current active date is a stop property date, the method 400 adds (434) the corresponding subjects, objects, and/or statements for the current active date. The method 400 determines (436) and stores the previous earlier date as the current active date (438). It can be seen that selection of the PREV button 142 reverses the process described in relation with selection of the NEXT button 140 and the sequence of screen images 100 b-i of FIGS. 2B-I.
When the END button 144 is chosen, the method 400 determines (440) the latest property date and store the latest date as the current date (442). Method 400 can displays (444) the subjects, predicates and objects for the statements and hide (446) those subjects, objects, and statements having stop properties equal to or less than the determined current date. FIG. 2I illustrates the resulting screen image 100 i when the user 202 chooses the END button 144 for the exemplary data of Table 2 and Table 2A. In the embodiment of FIG. 4, the flow chart for method 400 indicates that after displaying the appropriate screen image (as at 418, 426, 428, 438 and 446) method 400 can return to 412 to await further button activations by user 202. User 202 can end the display or return to perform new queries using the file or view manipulation tools, such as pull down menus 132.
In addition to displaying time varying information as described above, the use of start and stop properties for the statements and resources can be used to filter the statements returned by APIs 214. In this embodiment, user 202 can specify a date, or range of dates with the query at 402. APIs 214 can obtain the start and stop properties (404) and return the graphical representation data (406) for those statements having a lifetime that includes the date(s) specified. For example, user 202 can specify the current date. Based on Table 2 and Table 2A, the lifetimes of statements 2-7, 3a, 3b, 8a and 8b include the current date, and those statements will be returned by APIs 214. Thus, it can be seen that the screen image for the specified date can include screen image 100 i of FIG. 2I.
For a specified range of dates, the APIs 214 can return statements having lifetimes that overlap the specified range of dates. For example, user 202 can specify dates in the range of 01/01/50 to 01/01/90. Again using Table 2 and Table 2A, the lifetimes of statements 1-4, 6, 8, 3a, 3b, 8a and 8b can include the specified range and it can be seen that the screen image for the specified range can include screen image 100 g of FIG. 2G. While APIs 214 can typically return statements including the current date, the current date can be adjusted to provide for date ranges, without having to re-fetch the data.
In one embodiment, scroll bar 136 of FIG. 1 can represent a timeline corresponding to the time from the earliest start property date of the returned statements to the latest stop property date of the returned statements. For the exemplary statements of Table 2 and Table 2A, the scroll bar can represent a timeline from the birth of Joe Thornton (03/16/28) to the current date. Slide 146, illustrated in FIGS. 2A-I, can be positioned on scroll bar 136 and can correspond to selecting a date for the screen image to be presented. Slide 146 can be activated when user 202 chooses one of the buttons 138-144, as indicated in phantom at 448 in FIG. 4. Thus, slide 146 can be inactive or hidden in screen image 100 of FIG. 1. For example, FIG. 2F illustrates slide 146 positioned at 01/01/85, thus screen image 100 f can include statements having lifetimes that include the date 01/01/85.
The systems and methods described herein may not be limited to a particular hardware or software configuration. The techniques described herein can be implemented in hardware or software, or a combination thereof. The systems and methods can be implemented in one or more computer programs executing on one or more programmable computers, such as may be exemplified by processor 208, servers 210, or APIs 214, among others, that include a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), one or more input devices, and one or more output devices.
The computer programs, or programs, may be preferably implemented using one or more high level procedural or object-oriented programming languages to communicate with a computer system; however, the program(s) can be implemented in assembly or machine language, if desired. The language can be compiled or interpreted. The computer program(s) can be preferably stored on a storage medium or device (e.g., CD-ROM, hard disk, or magnetic disk) readable by a general or special purpose programmable computer for configuring and operating the computer when the storage medium or device is read by the computer to perform the procedures described herein. The system can also be considered to be implemented as a computer-readable storage medium, configured with a computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner.
As provided herein, the processor(s) can thus be embedded in one or more devices that can be operated independently or together in a networked environment, where the network can include, for example, a Local Area Network (LAN), wide area network (WAN), and/or can include an intranet and/or the Internet and/or another network. The network(s) can be wired or wireless or a combination thereof and can use one or more communications protocols to facilitate communications between the different processors. The processors can be configured for distributed processing and can utilize, in some embodiments, a client-server model as needed. Accordingly, the methods and systems can utilize multiple processors and/or processor devices, and the processor instructions can be divided amongst such single or multiple processor/devices.
The device(s) or computer systems that integrate with the processor(s) can include, for example, a personal computer(s), workstation (e.g., Sun, HP), personal digital assistant (PDA), handheld device such as cellular telephone, laptop, handheld, or another device capable of being integrated with a processor(s) that can operate as provided herein. Accordingly, the devices provided herein are not exhaustive and are provided for illustration and not limitation.
References to “a microprocessor” and “a processor”, or “the microprocessor” and “the processor,” can be understood to include one or more microprocessors that can communicate in a stand-alone and/or a distributed environment(s), and can thus can be configured to communicate via wired or wireless communications with other processors, where such one or more processor can be configured to operate on one or more processor-controlled devices that can be similar or different devices. Furthermore, references to memory, unless otherwise specified, can include one or more processor-readable and accessible memory elements and/or components that can be internal to the processor-controlled device, external to the processor-controlled device, and can be accessed via a wired or wireless network using a variety of communications protocols, and unless otherwise specified, can be arranged to include a combination of external and internal memory devices, where such memory can be contiguous and/or partitioned based on the application. Accordingly, references to a database can be understood to include one or more memory associations, where such references can include commercially available database products (e.g., SQL, Informix, Oracle) and also proprietary databases, and may also include other structures for associating memory such as links, queues, graphs, trees, with such structures provided for illustration and not limitation.
References to a network, unless provided otherwise, can include one or more intranets and/or the Internet. References herein to microprocessor instructions or microprocessor-executable instructions, in accordance with the above, can be understood to include programmable hardware.
While the method and systems have been disclosed in connection with the preferred embodiments shown and described in detail, various modifications and improvements thereon will become readily apparent to those skilled in the art. As an example, those with ordinary skill in the art will recognize that the arrangement and connectivity of the components shown in the figures are merely for illustrative purposes, and can be varied accordingly and components may be combined or otherwise reconfigured without departing from the scope of the disclosed systems and methods. Accordingly, many additional changes in the details and arrangement of parts, herein described and illustrated, can be made by those skilled in the art. It will thus be understood that the following claims are not to be limited to the embodiments disclosed herein, can include practices otherwise than specifically described, and are to be interpreted as broadly as allowed under the law.

Claims (22)

What is claimed is:
1. A computer-implemented method of using Resource Description Framework (RDF) reification to associate Semantic Web statements with start properties and stop properties related to lifetimes of the Semantic Web statements using a reification processor, comprising:
accessing an RDF statement from a Semantic Web resource wherein the RDF statement includes a subject, a predicate, and an object;
determining a lifetime of the subject of the RDF statement, wherein determining the lifetime of the subject is based on at least one of a start property of the subject and a stop property of the subject;
determining a lifetime of the predicate of the RDF statement, wherein determining the lifetime of the predicate is based on at least one of a start property of the predicate and a stop property the predicate;
determining a lifetime of the object of the RDF statement, wherein determining the lifetime of the object is based on at least one of a start property of the object and a stop property of the object;
automatically determining a lifetime of the RDF statement based on an overlap of the lifetime of the subject, the lifetime of the predicate, and the lifetime of the object;
generating a reified RDF statement, using the reification processor, wherein the reified RDF statement includes the subject, the predicate, the object and the lifetime of the RDF statement; and
storing the reified RDF statement in the Semantic Web resource.
2. The method of claim 1, further comprising:
receiving a Semantic Web query having an associated timeframe;
determining if the query timeframe is within the lifetime of a reified RDF statement in the Semantic Web resource; and
accessing the reified RDF statement in response to the determination.
3. The method of claim 1, further comprising:
displaying on a display the subject and the object of the reified RDF statement as nodes;
displaying on the display the predicate of the reified RDF statement as an arc connecting the displayed nodes;
selecting a timeframe associated with the display; and
hiding the nodes and the arc when the selected display timeframe is outside the lifetime of the reified RDF statement.
4. The method of claim 1,
wherein automatically determining the lifetime of the RDF statement comprises selecting the lifetime of the subject of the RDF statement as the lifetime of the RDF statement.
5. The method of claim 1,
wherein automatically determining the lifetime of the RDF statement comprises selecting the lifetime of the object of the RDF statement as the lifetime of the RDF statement.
6. The method of claim 1, wherein determining the lifetime of the RDF statement comprises:
comparing the lifetime of the object and the lifetime of the subject; and
in response to the comparison, selecting an intersection of the compared lifetimes as the lifetime of the RDF statement.
7. The method of claim 1,
wherein automatically determining the lifetime of the RDF statement comprises selecting the lifetime of the predicate of the RDF statement as the lifetime of the RDF statement.
8. The method of claim 1, wherein the lifetime of the RDF statement includes at least one of an open-ended start property and an open-ended stop property.
9. The method of claim 1, wherein the lifetime of the RDF statement is explicitly specified.
10. The method of claim 1, wherein the RDF statement is accessed from a Semantic Web resource and further comprising storing the reified RDF statement in the Semantic Web resource.
11. The method of claim 1, wherein the lifetime of at least one of the subject, object, and predicate includes at least one of an open-ended start property and an open-ended stop property.
12. The method of claim 1, wherein automatically determining a lifetime of the RDF statement further comprises determining the lifetime of the RDF statement based on at least one of a start and a stop property associated with the RDF statement.
13. A system for using Resource Description Framework (RDF) reification to associate Semantic Web statements with start properties and stop properties related to lifetimes of the Semantic Web statements, comprising:
a computer processor operable to
access an RDF statement from a Semantic Web resource, wherein the RDF statement includes a subject, a predicate, and an object,
determine a lifetime of the subject of the RDF statement, wherein determining the lifetime of the subject is based on at least one of a start property of the subject and a stop property of the subject,
determine a lifetime of the predicate of the RDF statement, wherein determining the lifetime of the predicate is based on at least one of a start property of the predicate and a stop property of the predicate,
determine a lifetime of the object of the RDF statement, wherein determining the lifetime of the object is based on at least one of a start property of the object and a stop property of the object, and
determine a lifetime of the RDF statement based on an overlap of the lifetime of the subject, the lifetime of the predicate, and the lifetime of the object; and
a reification processor operable to
generate a reified RDF statement, wherein the reified RDF statement includes the subject, the predicate, the object and the lifetime of the RDF statement; and
store the reified RDF statement in the Semantic Web resource.
14. The system of claim 13, wherein the computer processor is further operable to:
receive a Semantic Web query having an associated timeframe;
determine if the query timeframe is within the lifetime of a reified RDF statement in the Semantic Web resource; and
access the reified RDF statement in response to the determination.
15. The system of claim 13, further comprising a display operable to:
display the subject and the object of the reified RDF statement as nodes;
display the predicate of the reified RDF statement as an arc connecting the displayed nodes;
select a timeframe associated with the display; and
hide the nodes and the arc when the selected display timeframe is outside the lifetime of the reified RDF statement.
16. A non-transitory computer-readable medium comprising instructions for controlling a processor to use Resource Description Framework (RDF) reification to associate Semantic Web statements with start properties and stop properties related to lifetimes of the Semantic Web statements by:
accessing an RDF statement from a Semantic Web resource wherein the RDF statement includes a subject, a predicate, and an object;
determining a lifetime of the subject of the RDF statement, wherein determining the lifetime of the subject is based on at least one of a start property of the subject and a stop property of the subject;
determining a lifetime of the predicate of the RDF statement, wherein determining the lifetime of the predicate is based on at least one of a start property of the predicate and a stop property the predicate;
determining a lifetime of the object of the RDF statement, wherein determining the lifetime of the object is based on at least one of a start property of the object and a stop property of the object;
automatically determining a lifetime of the RDF statement based on an overlap of the lifetime of the subject, the lifetime of the predicate, and the lifetime of the object;
generating a reified RDF statement, using a reification processor, wherein the reified RDF statement includes the subject, the predicate, the object and the lifetime of the RDF statement; and
storing the reified RDF statement in the Semantic Web resource.
17. The non-transitory computer-readable medium of claim 16 further comprising instructions for controlling the processor to:
receive a Semantic Web query having an associated timeframe;
determine if the query timeframe is within the lifetime of a reified RDF statement in the Semantic Web resource; and
access the reified RDF statement in response to the determination.
18. The non-transitory computer-readable medium of claim 16 further comprising instructions for controlling the processor to:
display on a display the subject and the object of the reified RDF statement as nodes;
display on the display the predicate of the reified RDF statement as an arc connecting the displayed nodes;
select a timeframe associated with the display; and
hide the nodes and the arc when the selected display timeframe is outside the lifetime of the reified RDF statement.
19. The non-transitory computer-readable medium of claim 16,
wherein automatically determining the lifetime of the RDF statement comprises selecting the lifetime of the subject of the RDF statement as the lifetime of the RDF statement.
20. The non-transitory computer-readable medium of claim 16,
wherein automatically determining the lifetime of the RDF statement comprises selecting the lifetime of the object of the RDF statement as the lifetime of the RDF statement.
21. The non-transitory computer-readable medium of claim 16 further comprising instructions for controlling the processor to:
compare the lifetime of the object and the lifetime of the subject; and
in response to the comparison, select an intersection of the compared lifetimes as the lifetime of the RDF statement.
22. The non-transitory computer-readable medium of claim 16,
wherein automatically determining the lifetime of the RDF statement comprises selecting the lifetime of the predicate of the RDF statement as the lifetime of the RDF statement.
US12/240,605 2003-04-28 2008-09-29 Methods and systems for representing, using and displaying time-varying information on the semantic web Active 2026-03-14 US8595222B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/240,605 US8595222B2 (en) 2003-04-28 2008-09-29 Methods and systems for representing, using and displaying time-varying information on the semantic web

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US46592503P 2003-04-28 2003-04-28
US10/806,406 US20040243531A1 (en) 2003-04-28 2004-03-23 Methods and systems for representing, using and displaying time-varying information on the Semantic Web
US12/240,605 US8595222B2 (en) 2003-04-28 2008-09-29 Methods and systems for representing, using and displaying time-varying information on the semantic web

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/806,406 Continuation US20040243531A1 (en) 2003-04-28 2004-03-23 Methods and systems for representing, using and displaying time-varying information on the Semantic Web

Publications (2)

Publication Number Publication Date
US20100281045A1 US20100281045A1 (en) 2010-11-04
US8595222B2 true US8595222B2 (en) 2013-11-26

Family

ID=33457024

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/806,406 Abandoned US20040243531A1 (en) 2003-04-28 2004-03-23 Methods and systems for representing, using and displaying time-varying information on the Semantic Web
US12/240,605 Active 2026-03-14 US8595222B2 (en) 2003-04-28 2008-09-29 Methods and systems for representing, using and displaying time-varying information on the semantic web

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/806,406 Abandoned US20040243531A1 (en) 2003-04-28 2004-03-23 Methods and systems for representing, using and displaying time-varying information on the Semantic Web

Country Status (1)

Country Link
US (2) US20040243531A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120290290A1 (en) * 2011-05-12 2012-11-15 Microsoft Corporation Sentence Simplification for Spoken Language Understanding
US9064006B2 (en) 2012-08-23 2015-06-23 Microsoft Technology Licensing, Llc Translating natural language utterances to keyword search queries
US9244984B2 (en) 2011-03-31 2016-01-26 Microsoft Technology Licensing, Llc Location based conversational understanding
US9298287B2 (en) 2011-03-31 2016-03-29 Microsoft Technology Licensing, Llc Combined activation for natural user interface systems
US9760566B2 (en) 2011-03-31 2017-09-12 Microsoft Technology Licensing, Llc Augmented conversational understanding agent to identify conversation context between two humans and taking an agent action thereof
US9842168B2 (en) 2011-03-31 2017-12-12 Microsoft Technology Licensing, Llc Task driven user intents
US9858343B2 (en) 2011-03-31 2018-01-02 Microsoft Technology Licensing Llc Personalization of queries, conversations, and searches

Families Citing this family (161)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7957907B2 (en) * 2001-03-30 2011-06-07 Sorenson Molecular Genealogy Foundation Method for molecular genealogical research
US8855935B2 (en) * 2006-10-02 2014-10-07 Ancestry.Com Dna, Llc Method and system for displaying genetic and genealogical data
US20040243531A1 (en) 2003-04-28 2004-12-02 Dean Michael Anthony Methods and systems for representing, using and displaying time-varying information on the Semantic Web
US20060248093A1 (en) * 2005-04-29 2006-11-02 Ora Lassila Method for determining relationships between data resources
US20070185882A1 (en) * 2006-02-06 2007-08-09 International Business Machines Corporation Method and system for selective tracking of semantic web data using distributed update events
US20070185897A1 (en) * 2006-02-06 2007-08-09 International Business Machines Corporation Method and system for tracking and storing semantic web revision history
US8423348B2 (en) * 2006-03-08 2013-04-16 Trigent Software Ltd. Pattern generation
US7962495B2 (en) * 2006-11-20 2011-06-14 Palantir Technologies, Inc. Creating data in a data store using a dynamic ontology
US20080130778A1 (en) * 2006-12-04 2008-06-05 Samsung Electronics Co., Ltd. System and method for wireless communication of uncompressed high definition video data using a transfer matrix for beamforming estimation
US8554868B2 (en) 2007-01-05 2013-10-08 Yahoo! Inc. Simultaneous sharing communication interface
US8131536B2 (en) * 2007-01-12 2012-03-06 Raytheon Bbn Technologies Corp. Extraction-empowered machine translation
JP4552943B2 (en) * 2007-01-19 2010-09-29 ソニー株式会社 Chronological table providing method, chronological table providing apparatus, and chronological table providing program
US7890539B2 (en) 2007-10-10 2011-02-15 Raytheon Bbn Technologies Corp. Semantic matching using predicate-argument structure
US9495796B2 (en) * 2008-09-09 2016-11-15 Autodesk, Inc. Animatable graphics lighting analysis reporting
US8405657B2 (en) * 2008-09-09 2013-03-26 Autodesk, Inc. Animatable graphics lighting analysis
US9244965B2 (en) * 2010-02-22 2016-01-26 Thoughtwire Holdings Corp. Method and system for sharing data between software systems
US8407242B2 (en) 2010-12-16 2013-03-26 Microsoft Corporation Temporal binding for semantic queries
BR112014000615B1 (en) 2011-07-12 2021-07-13 Snap Inc METHOD TO SELECT VISUAL CONTENT EDITING FUNCTIONS, METHOD TO ADJUST VISUAL CONTENT, AND SYSTEM TO PROVIDE A PLURALITY OF VISUAL CONTENT EDITING FUNCTIONS
US8972357B2 (en) 2012-02-24 2015-03-03 Placed, Inc. System and method for data collection to validate location data
US11734712B2 (en) 2012-02-24 2023-08-22 Foursquare Labs, Inc. Attributing in-store visits to media consumption based on data collected from user devices
WO2013166588A1 (en) 2012-05-08 2013-11-14 Bitstrips Inc. System and method for adaptable avatars
WO2014031899A1 (en) 2012-08-22 2014-02-27 Goldrun Corporation Augmented reality virtual content platform apparatuses, methods and systems
US8775972B2 (en) 2012-11-08 2014-07-08 Snapchat, Inc. Apparatus and method for single action control of social network profile access
US10372442B2 (en) 2013-03-14 2019-08-06 Thoughtwire Holdings Corp. Method and system for generating a view incorporating semantically resolved data values
US10313433B2 (en) 2013-03-14 2019-06-04 Thoughtwire Holdings Corp. Method and system for registering software systems and data-sharing sessions
US9742843B2 (en) 2013-03-14 2017-08-22 Thoughtwire Holdings Corp. Method and system for enabling data sharing between software systems
US9742713B2 (en) 2013-05-30 2017-08-22 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US10439972B1 (en) 2013-05-30 2019-10-08 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US9705831B2 (en) 2013-05-30 2017-07-11 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US9083770B1 (en) 2013-11-26 2015-07-14 Snapchat, Inc. Method and system for integrating real time communication features in applications
CA2863124A1 (en) 2014-01-03 2015-07-03 Investel Capital Corporation User content sharing system and method with automated external content integration
US9628950B1 (en) 2014-01-12 2017-04-18 Investment Asset Holdings Llc Location-based messaging
US10082926B1 (en) 2014-02-21 2018-09-25 Snap Inc. Apparatus and method for alternate channel communication initiated through a common message thread
US8909725B1 (en) 2014-03-07 2014-12-09 Snapchat, Inc. Content delivery network for ephemeral objects
US9276886B1 (en) 2014-05-09 2016-03-01 Snapchat, Inc. Apparatus and method for dynamically configuring application component tiles
US9396354B1 (en) 2014-05-28 2016-07-19 Snapchat, Inc. Apparatus and method for automated privacy protection in distributed images
US9537811B2 (en) 2014-10-02 2017-01-03 Snap Inc. Ephemeral gallery of ephemeral messages
US20150356101A1 (en) 2014-06-05 2015-12-10 Mobli Technologies 2010 Ltd. Automatic article enrichment by social media trends
US9113301B1 (en) 2014-06-13 2015-08-18 Snapchat, Inc. Geo-location based event gallery
US9225897B1 (en) 2014-07-07 2015-12-29 Snapchat, Inc. Apparatus and method for supplying content aware photo filters
US10055717B1 (en) 2014-08-22 2018-08-21 Snap Inc. Message processor with application prompts
US10423983B2 (en) 2014-09-16 2019-09-24 Snap Inc. Determining targeting information based on a predictive targeting model
US10824654B2 (en) 2014-09-18 2020-11-03 Snap Inc. Geolocation-based pictographs
US11216869B2 (en) 2014-09-23 2022-01-04 Snap Inc. User interface to augment an image using geolocation
US10284508B1 (en) 2014-10-02 2019-05-07 Snap Inc. Ephemeral gallery of ephemeral messages with opt-in permanence
US9015285B1 (en) 2014-11-12 2015-04-21 Snapchat, Inc. User interface for accessing media at a geographic location
US9854219B2 (en) 2014-12-19 2017-12-26 Snap Inc. Gallery of videos set to an audio time line
US10311916B2 (en) 2014-12-19 2019-06-04 Snap Inc. Gallery of videos set to an audio time line
US9385983B1 (en) 2014-12-19 2016-07-05 Snapchat, Inc. Gallery of messages from individuals with a shared interest
US9754355B2 (en) 2015-01-09 2017-09-05 Snap Inc. Object recognition based photo filters
US11388226B1 (en) 2015-01-13 2022-07-12 Snap Inc. Guided personal identity based actions
US10133705B1 (en) 2015-01-19 2018-11-20 Snap Inc. Multichannel system
US9521515B2 (en) 2015-01-26 2016-12-13 Mobli Technologies 2010 Ltd. Content request by location
RU2596599C2 (en) * 2015-02-03 2016-09-10 Общество с ограниченной ответственностью "Аби ИнфоПоиск" System and method of creating and using user ontology-based patterns for processing user text in natural language
US10223397B1 (en) 2015-03-13 2019-03-05 Snap Inc. Social graph based co-location of network users
CN112040410B (en) 2015-03-18 2022-10-14 斯纳普公司 Geo-fence authentication provisioning
US9692967B1 (en) 2015-03-23 2017-06-27 Snap Inc. Systems and methods for reducing boot time and power consumption in camera systems
US9881094B2 (en) 2015-05-05 2018-01-30 Snap Inc. Systems and methods for automated local story generation and curation
US10135949B1 (en) 2015-05-05 2018-11-20 Snap Inc. Systems and methods for story and sub-story navigation
US10993069B2 (en) 2015-07-16 2021-04-27 Snap Inc. Dynamically adaptive media content delivery
US10817898B2 (en) 2015-08-13 2020-10-27 Placed, Llc Determining exposures to content presented by physical objects
US9652896B1 (en) 2015-10-30 2017-05-16 Snap Inc. Image based tracking in augmented reality systems
US10474321B2 (en) 2015-11-30 2019-11-12 Snap Inc. Network resource location linking and visual content sharing
US9984499B1 (en) 2015-11-30 2018-05-29 Snap Inc. Image and point cloud based tracking and in augmented reality systems
US10354425B2 (en) 2015-12-18 2019-07-16 Snap Inc. Method and system for providing context relevant media augmentation
US11023514B2 (en) 2016-02-26 2021-06-01 Snap Inc. Methods and systems for generation, curation, and presentation of media collections
US10285001B2 (en) 2016-02-26 2019-05-07 Snap Inc. Generation, curation, and presentation of media collections
US10679389B2 (en) 2016-02-26 2020-06-09 Snap Inc. Methods and systems for generation, curation, and presentation of media collections
US10339365B2 (en) 2016-03-31 2019-07-02 Snap Inc. Automated avatar generation
US11900418B2 (en) 2016-04-04 2024-02-13 Snap Inc. Mutable geo-fencing system
US11201981B1 (en) 2016-06-20 2021-12-14 Pipbin, Inc. System for notification of user accessibility of curated location-dependent content in an augmented estate
US10334134B1 (en) 2016-06-20 2019-06-25 Maximillian John Suiter Augmented real estate with location and chattel tagging system and apparatus for virtual diary, scrapbooking, game play, messaging, canvasing, advertising and social interaction
US10805696B1 (en) 2016-06-20 2020-10-13 Pipbin, Inc. System for recording and targeting tagged content of user interest
US11785161B1 (en) 2016-06-20 2023-10-10 Pipbin, Inc. System for user accessibility of tagged curated augmented reality content
US10638256B1 (en) 2016-06-20 2020-04-28 Pipbin, Inc. System for distribution and display of mobile targeted augmented reality content
US11044393B1 (en) 2016-06-20 2021-06-22 Pipbin, Inc. System for curation and display of location-dependent augmented reality content in an augmented estate system
US11876941B1 (en) 2016-06-20 2024-01-16 Pipbin, Inc. Clickable augmented reality content manager, system, and network
US9681265B1 (en) 2016-06-28 2017-06-13 Snap Inc. System to track engagement of media items
US10430838B1 (en) 2016-06-28 2019-10-01 Snap Inc. Methods and systems for generation, curation, and presentation of media collections with automated advertising
US10733255B1 (en) 2016-06-30 2020-08-04 Snap Inc. Systems and methods for content navigation with automated curation
US10855632B2 (en) 2016-07-19 2020-12-01 Snap Inc. Displaying customized electronic messaging graphics
WO2018020495A1 (en) * 2016-07-27 2018-02-01 Epistema Ltd. Computerized environment for human expert analysts
CN109804411B (en) 2016-08-30 2023-02-17 斯纳普公司 System and method for simultaneous localization and mapping
US10432559B2 (en) 2016-10-24 2019-10-01 Snap Inc. Generating and displaying customized avatars in electronic messages
KR102219304B1 (en) 2016-11-07 2021-02-23 스냅 인코포레이티드 Selective identification and order of image modifiers
US10203855B2 (en) 2016-12-09 2019-02-12 Snap Inc. Customized user-controlled media overlays
US11616745B2 (en) 2017-01-09 2023-03-28 Snap Inc. Contextual generation and selection of customized media content
US10454857B1 (en) 2017-01-23 2019-10-22 Snap Inc. Customized digital avatar accessories
US10915911B2 (en) 2017-02-03 2021-02-09 Snap Inc. System to determine a price-schedule to distribute media content
US11250075B1 (en) 2017-02-17 2022-02-15 Snap Inc. Searching social media content
US10319149B1 (en) 2017-02-17 2019-06-11 Snap Inc. Augmented reality anamorphosis system
US10074381B1 (en) 2017-02-20 2018-09-11 Snap Inc. Augmented reality speech balloon system
US10565795B2 (en) 2017-03-06 2020-02-18 Snap Inc. Virtual vision system
US10523625B1 (en) 2017-03-09 2019-12-31 Snap Inc. Restricted group content collection
US10582277B2 (en) 2017-03-27 2020-03-03 Snap Inc. Generating a stitched data stream
US10581782B2 (en) 2017-03-27 2020-03-03 Snap Inc. Generating a stitched data stream
US11170393B1 (en) 2017-04-11 2021-11-09 Snap Inc. System to calculate an engagement score of location based media content
US10387730B1 (en) 2017-04-20 2019-08-20 Snap Inc. Augmented reality typography personalization system
US10212541B1 (en) 2017-04-27 2019-02-19 Snap Inc. Selective location-based identity communication
US11893647B2 (en) 2017-04-27 2024-02-06 Snap Inc. Location-based virtual avatars
EP3667603A1 (en) 2017-04-27 2020-06-17 Snap Inc. Location privacy management on map-based social media platforms
US10467147B1 (en) 2017-04-28 2019-11-05 Snap Inc. Precaching unlockable data elements
US10803120B1 (en) 2017-05-31 2020-10-13 Snap Inc. Geolocation based playlists
US11475254B1 (en) 2017-09-08 2022-10-18 Snap Inc. Multimodal entity identification
US10740974B1 (en) 2017-09-15 2020-08-11 Snap Inc. Augmented reality system
US10499191B1 (en) 2017-10-09 2019-12-03 Snap Inc. Context sensitive presentation of content
US10573043B2 (en) 2017-10-30 2020-02-25 Snap Inc. Mobile-based cartographic control of display content
US11265273B1 (en) 2017-12-01 2022-03-01 Snap, Inc. Dynamic media overlay with smart widget
US11017173B1 (en) 2017-12-22 2021-05-25 Snap Inc. Named entity recognition visual context and caption data
US10678818B2 (en) 2018-01-03 2020-06-09 Snap Inc. Tag distribution visualization system
US11507614B1 (en) 2018-02-13 2022-11-22 Snap Inc. Icon based tagging
US10979752B1 (en) 2018-02-28 2021-04-13 Snap Inc. Generating media content items based on location information
US10885136B1 (en) 2018-02-28 2021-01-05 Snap Inc. Audience filtering system
US10327096B1 (en) 2018-03-06 2019-06-18 Snap Inc. Geo-fence selection system
KR102494540B1 (en) 2018-03-14 2023-02-06 스냅 인코포레이티드 Creation of collectible items based on location information
US11163941B1 (en) 2018-03-30 2021-11-02 Snap Inc. Annotating a collection of media content items
JP2021521511A (en) 2018-04-05 2021-08-26 アンセストリー ドットコム ディーエヌエー リミテッド ライアビリティ カンパニー Identity network by descent and community allocation in gene mutation development
US10219111B1 (en) 2018-04-18 2019-02-26 Snap Inc. Visitation tracking system
US10896197B1 (en) 2018-05-22 2021-01-19 Snap Inc. Event detection system
US10679393B2 (en) 2018-07-24 2020-06-09 Snap Inc. Conditional modification of augmented reality object
US10997760B2 (en) 2018-08-31 2021-05-04 Snap Inc. Augmented reality anthropomorphization system
US10698583B2 (en) 2018-09-28 2020-06-30 Snap Inc. Collaborative achievement interface
US10778623B1 (en) 2018-10-31 2020-09-15 Snap Inc. Messaging and gaming applications communication platform
US11199957B1 (en) 2018-11-30 2021-12-14 Snap Inc. Generating customized avatars based on location information
US10939236B1 (en) 2018-11-30 2021-03-02 Snap Inc. Position service to determine relative position to map features
US11032670B1 (en) 2019-01-14 2021-06-08 Snap Inc. Destination sharing in location sharing system
US10939246B1 (en) 2019-01-16 2021-03-02 Snap Inc. Location-based context information sharing in a messaging system
US11294936B1 (en) 2019-01-30 2022-04-05 Snap Inc. Adaptive spatial density based clustering
US10936066B1 (en) 2019-02-13 2021-03-02 Snap Inc. Sleep detection in a location sharing system
US10838599B2 (en) 2019-02-25 2020-11-17 Snap Inc. Custom media overlay system
US10964082B2 (en) 2019-02-26 2021-03-30 Snap Inc. Avatar based on weather
US10852918B1 (en) 2019-03-08 2020-12-01 Snap Inc. Contextual information in chat
US11868414B1 (en) 2019-03-14 2024-01-09 Snap Inc. Graph-based prediction for contact suggestion in a location sharing system
US11852554B1 (en) 2019-03-21 2023-12-26 Snap Inc. Barometer calibration in a location sharing system
US11249614B2 (en) 2019-03-28 2022-02-15 Snap Inc. Generating personalized map interface with enhanced icons
US10810782B1 (en) 2019-04-01 2020-10-20 Snap Inc. Semantic texture mapping system
US10582453B1 (en) 2019-05-30 2020-03-03 Snap Inc. Wearable device location systems architecture
US10560898B1 (en) 2019-05-30 2020-02-11 Snap Inc. Wearable device location systems
US10893385B1 (en) 2019-06-07 2021-01-12 Snap Inc. Detection of a physical collision between two client devices in a location sharing system
US11307747B2 (en) 2019-07-11 2022-04-19 Snap Inc. Edge gesture interface with smart interactions
US11821742B2 (en) 2019-09-26 2023-11-21 Snap Inc. Travel based notifications
US11218838B2 (en) 2019-10-31 2022-01-04 Snap Inc. Focused map-based context information surfacing
US11429618B2 (en) 2019-12-30 2022-08-30 Snap Inc. Surfacing augmented reality objects
US10880496B1 (en) 2019-12-30 2020-12-29 Snap Inc. Including video feed in message thread
US11128715B1 (en) 2019-12-30 2021-09-21 Snap Inc. Physical friend proximity in chat
US11343323B2 (en) 2019-12-31 2022-05-24 Snap Inc. Augmented reality objects registry
US11169658B2 (en) 2019-12-31 2021-11-09 Snap Inc. Combined map icon with action indicator
US11228551B1 (en) 2020-02-12 2022-01-18 Snap Inc. Multiple gateway message exchange
US11516167B2 (en) 2020-03-05 2022-11-29 Snap Inc. Storing data based on device location
US11619501B2 (en) 2020-03-11 2023-04-04 Snap Inc. Avatar based on trip
US11430091B2 (en) 2020-03-27 2022-08-30 Snap Inc. Location mapping for large scale augmented-reality
US10956743B1 (en) 2020-03-27 2021-03-23 Snap Inc. Shared augmented reality system
US11503432B2 (en) 2020-06-15 2022-11-15 Snap Inc. Scalable real-time location sharing framework
US11290851B2 (en) 2020-06-15 2022-03-29 Snap Inc. Location sharing using offline and online objects
US11483267B2 (en) 2020-06-15 2022-10-25 Snap Inc. Location sharing using different rate-limited links
US11314776B2 (en) 2020-06-15 2022-04-26 Snap Inc. Location sharing using friend list versions
US11308327B2 (en) 2020-06-29 2022-04-19 Snap Inc. Providing travel-based augmented reality content with a captured image
US11349797B2 (en) 2020-08-31 2022-05-31 Snap Inc. Co-location connection service
US11606756B2 (en) 2021-03-29 2023-03-14 Snap Inc. Scheduling requests for location data
US11645324B2 (en) 2021-03-31 2023-05-09 Snap Inc. Location-based timeline media content system
US11829834B2 (en) 2021-10-29 2023-11-28 Snap Inc. Extended QR code

Citations (108)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4599691A (en) 1982-05-20 1986-07-08 Kokusai Denshin Denwa Co., Ltd. Tree transformation system in machine translation system
US4754326A (en) 1983-10-25 1988-06-28 Keycom Electronic Publishing Method and apparatus for assisting user of information retrieval systems
US4809351A (en) 1985-06-07 1989-02-28 Saba Technologies, Inc. Optical character reader
US4914590A (en) 1988-05-18 1990-04-03 Emhart Industries, Inc. Natural language understanding system
US5062143A (en) 1990-02-23 1991-10-29 Harris Corporation Trigram-based method of language identification
US5343537A (en) 1991-10-31 1994-08-30 International Business Machines Corporation Statistical mixture approach to automatic handwriting recognition
US5396419A (en) 1991-09-07 1995-03-07 Hitachi, Ltd. Pre-edit support method and apparatus
US5406480A (en) 1992-01-17 1995-04-11 Matsushita Electric Industrial Co., Ltd. Building and updating of co-occurrence dictionary and analyzing of co-occurrence and meaning
US5418717A (en) 1990-08-27 1995-05-23 Su; Keh-Yih Multiple score language processing system
US5438630A (en) 1992-12-17 1995-08-01 Xerox Corporation Word spotting in bitmap images using word bounding boxes and hidden Markov models
US5492473A (en) 1993-12-29 1996-02-20 Shea; James W. Language instructional and fact recognition apparatus
US5544257A (en) 1992-01-08 1996-08-06 International Business Machines Corporation Continuous parameter hidden Markov model approach to automatic handwriting recognition
US5694559A (en) 1995-03-07 1997-12-02 Microsoft Corporation On-line help method and system utilizing free text query
US5745113A (en) 1996-04-03 1998-04-28 Institute For Research On Learning Representing work practices
US5752052A (en) 1994-06-24 1998-05-12 Microsoft Corporation Method and system for bootstrapping statistical processing into a rule-based natural language parser
US5757960A (en) 1994-09-30 1998-05-26 Murdock; Michael Chase Method and system for extracting features from handwritten text
US5787198A (en) 1992-11-24 1998-07-28 Lucent Technologies Inc. Text recognition using two-dimensional stochastic models
US5822747A (en) 1996-08-23 1998-10-13 Tandem Computers, Inc. System and method for optimizing database queries
US5839106A (en) 1996-12-17 1998-11-17 Apple Computer, Inc. Large-vocabulary speech recognition using an integrated syntactic and semantic statistical language model
US5841895A (en) 1996-10-25 1998-11-24 Pricewaterhousecoopers, Llp Method for learning local syntactic relationships for use in example-based information-extraction-pattern learning
US5862259A (en) 1996-03-27 1999-01-19 Caere Corporation Pattern recognition employing arbitrary segmentation and compound probabilistic evaluation
US5903858A (en) 1995-06-23 1999-05-11 Saraki; Masashi Translation machine for editing a original text by rewriting the same and translating the rewrote one
US5926784A (en) 1997-07-17 1999-07-20 Microsoft Corporation Method and system for natural language parsing using podding
US5926180A (en) 1996-01-16 1999-07-20 Nec Corporation Browsing unit and storage medium recording a browsing program thereon
US5933525A (en) 1996-04-10 1999-08-03 Bbn Corporation Language-independent and segmentation-free optical character recognition system and method
US5940821A (en) 1997-05-21 1999-08-17 Oracle Corporation Information presentation in a knowledge base search and retrieval system
US5963940A (en) 1995-08-16 1999-10-05 Syracuse University Natural language information retrieval system and method
US5963965A (en) 1997-02-18 1999-10-05 Semio Corporation Text processing and retrieval system and method
US6006221A (en) 1995-08-16 1999-12-21 Syracuse University Multilingual document retrieval system and method using semantic vector matching
US6021403A (en) 1996-07-19 2000-02-01 Microsoft Corporation Intelligent user assistance facility
US6026388A (en) 1995-08-16 2000-02-15 Textwise, Llc User interface and other enhancements for natural language information retrieval system and method
US6029195A (en) 1994-11-29 2000-02-22 Herz; Frederick S. M. System for customized electronic identification of desirable objects
US6105022A (en) 1997-02-26 2000-08-15 Hitachi, Ltd. Structured-text cataloging method, structured-text searching method, and portable medium used in the methods
US6112168A (en) 1997-10-20 2000-08-29 Microsoft Corporation Automatically recognizing the discourse structure of a body of text
US6167369A (en) 1998-12-23 2000-12-26 Xerox Company Automatic language identification using both N-gram and word information
US6243669B1 (en) 1999-01-29 2001-06-05 Sony Corporation Method and apparatus for providing syntactic analysis and data structure for translation knowledge in example-based language translation
US6243670B1 (en) 1998-09-02 2001-06-05 Nippon Telegraph And Telephone Corporation Method, apparatus, and computer readable medium for performing semantic analysis and generating a semantic structure having linked frames
US6278968B1 (en) 1999-01-29 2001-08-21 Sony Corporation Method and apparatus for adaptive speech recognition hypothesis construction and selection in a spoken language translation system
US6278967B1 (en) 1992-08-31 2001-08-21 Logovista Corporation Automated system for generating natural language translations that are domain-specific, grammar rule-based, and/or based on part-of-speech analysis
US20010029455A1 (en) 2000-03-31 2001-10-11 Chin Jeffrey J. Method and apparatus for providing multilingual translation over a network
US6304870B1 (en) 1997-12-02 2001-10-16 The Board Of Regents Of The University Of Washington, Office Of Technology Transfer Method and apparatus of automatically generating a procedure for extracting information from textual information sources
US20020007383A1 (en) 1997-03-31 2002-01-17 Naoyuki Yoden Document preparation method and machine translation device
US20020035466A1 (en) 2000-07-10 2002-03-21 Syuuzi Kodama Automatic translator and computer-readable storage medium having automatic translation program recorded thereon
US6430552B1 (en) 1998-12-24 2002-08-06 Microsoft Corporation Method for converting queries with logical operators into free text queries
US6442584B1 (en) 1997-05-16 2002-08-27 Sybase, Inc. Methods for resource consolidation in a computing environment
US20020143537A1 (en) 2001-03-30 2002-10-03 Fujitsu Limited Of Kawasaki, Japan Process of automatically generating translation- example dictionary, program product, computer-readable recording medium and apparatus for performing thereof
US20030078766A1 (en) 1999-09-17 2003-04-24 Douglas E. Appelt Information retrieval by natural language querying
US20030093613A1 (en) 2000-01-14 2003-05-15 David Sherman Compressed ternary mask system and method
US20030120640A1 (en) 2001-12-21 2003-06-26 Hitachi. Ltd. Construction method of substance dictionary, extraction of binary relationship of substance, prediction method and dynamic viewer
US6600501B1 (en) * 2000-05-18 2003-07-29 Microsoft Corporation Method and system for generating a dynamic timeline
US6606625B1 (en) 1999-06-03 2003-08-12 University Of Southern California Wrapper induction by hierarchical data analysis
US6609087B1 (en) 1999-04-28 2003-08-19 Genuity Inc. Fact recognition system
US6615207B1 (en) 1998-12-10 2003-09-02 International Business Machines Corporation Method of formulating and presenting search queries to a tabular database through a user-interactive computer display interface
US20030182310A1 (en) * 2002-02-04 2003-09-25 Elizabeth Charnock Method and apparatus for sociological data mining
US20030189933A1 (en) 2002-04-03 2003-10-09 Timucin Ozugur Shared wavelength group to differentiate label switched paths for congestion control in optical burst switching networks
US20030208499A1 (en) * 2002-05-03 2003-11-06 David Bigwood Methods and apparatus for visualizing relationships among triples of resource description framework (RDF) data sets
US20030212543A1 (en) 2002-05-07 2003-11-13 International Business Machines Corporation Integrated development tool for building a natural language understanding application
US20030216905A1 (en) 2002-05-20 2003-11-20 Ciprian Chelba Applying a structured language model to information extraction
CA2485554A1 (en) 2002-05-14 2003-11-27 Verity, Inc. Searching structured, semi-structured, and unstructured content
US6681044B1 (en) 2000-03-29 2004-01-20 Matsushita Electric Industrial Co., Ltd. Retrieval of cursive Chinese handwritten annotations based on radical model
US20040049495A1 (en) 2002-09-11 2004-03-11 Chung-I Lee System and method for automatically generating general queries
US20040054521A1 (en) 2002-09-13 2004-03-18 Fuji Xerox Co., Ltd. Text sentence comparing apparatus
US20040098670A1 (en) 2002-11-15 2004-05-20 Carroll Jeremy John Processing of data
US20040107118A1 (en) 2002-11-27 2004-06-03 Hugh Harnsberger Electronic clinical reference and education system and method of use
US20040111253A1 (en) 2002-12-10 2004-06-10 International Business Machines Corporation System and method for rapid development of natural language understanding using active learning
US20040162806A1 (en) 2002-09-13 2004-08-19 Fuji Xerox Co., Ltd. Text sentence comparing apparatus
US6785673B1 (en) 2000-02-09 2004-08-31 At&T Corp. Method for converting relational data into XML
US6795825B2 (en) 2000-09-12 2004-09-21 Naphtali David Rishe Database querying system and method
US20040243531A1 (en) 2003-04-28 2004-12-02 Dean Michael Anthony Methods and systems for representing, using and displaying time-varying information on the Semantic Web
US6839714B2 (en) 2000-08-04 2005-01-04 Infoglide Corporation System and method for comparing heterogeneous data sources
US6853992B2 (en) 1999-12-14 2005-02-08 Fujitsu Limited Structured-document search apparatus and method, recording medium storing structured-document searching program, and method of creating indexes for searching structured documents
US6856992B2 (en) * 2001-05-15 2005-02-15 Metatomix, Inc. Methods and apparatus for real-time business visibility using persistent schema-less data storage
US20050039123A1 (en) 2003-08-14 2005-02-17 Kuchinsky Allan J. Method and system for importing, creating and/or manipulating biological diagrams
US6892189B2 (en) 2001-01-26 2005-05-10 Inxight Software, Inc. Method for learning and combining global and local regularities for information extraction and classification
US6950753B1 (en) 1999-04-15 2005-09-27 The Trustees Of The Columbia University In The City Of New York Methods for extracting information on interactions between biological entities from natural language text data
US20050278325A1 (en) 2004-06-14 2005-12-15 Rada Mihalcea Graph-based ranking algorithms for text processing
US20050283365A1 (en) 2004-04-12 2005-12-22 Kenji Mizutani Dialogue supporting apparatus
US20060015320A1 (en) 2004-04-16 2006-01-19 Och Franz J Selection and use of nonstatistical translation components in a statistical machine translation framework
US20060036592A1 (en) 2004-08-11 2006-02-16 Oracle International Corporation System for ontology-based semantic matching in a relational database system
US7031970B2 (en) 2002-12-16 2006-04-18 Palo Alto Research Center Incorporated Method and apparatus for generating summary information for hierarchically related information
US20060116866A1 (en) 2004-11-02 2006-06-01 Hirokazu Suzuki Machine translation system, method and program
US7062483B2 (en) 2000-05-18 2006-06-13 Endeca Technologies, Inc. Hierarchical data-driven search and navigation system and method for information retrieval
US7081834B2 (en) 2003-03-21 2006-07-25 Rockwell Scientific Licensing Llc Aviation weather awareness and reporting enhancements (AWARE) system using a temporal-spatial weather database and a Bayesian network model
US20060242101A1 (en) 2005-04-21 2006-10-26 Rama Akkiraju Method and system for semantic matching of Web Service policies
US20060245641A1 (en) 2005-04-29 2006-11-02 Microsoft Corporation Extracting data from semi-structured information utilizing a discriminative context free grammar
US20060253476A1 (en) 2005-05-09 2006-11-09 Roth Mary A Technique for relationship discovery in schemas using semantic name indexing
US20060253274A1 (en) 2005-05-05 2006-11-09 Bbn Technologies Corp. Methods and systems relating to information extraction
US7146030B2 (en) 2002-05-22 2006-12-05 Agilent Technologies, Inc. System and methods for extracting semantics from images
US7146349B2 (en) 2000-11-06 2006-12-05 International Business Machines Corporation Network for describing multimedia information
US7149687B1 (en) 2002-07-29 2006-12-12 At&T Corp. Method of active learning for automatic speech recognition
US20070011150A1 (en) 2005-06-28 2007-01-11 Metacarta, Inc. User Interface For Geographic Search
US20070136246A1 (en) 2005-11-30 2007-06-14 At&T Corp. Answer determination for natural language questioning
US7249013B2 (en) 2002-03-11 2007-07-24 University Of Southern California Named entity translation
US20070233696A1 (en) 2006-04-03 2007-10-04 International Business Machines Corporation Apparatus, Method, and Program Product for Information Processing
US7287026B2 (en) 2002-04-05 2007-10-23 Oommen John B Method of comparing the closeness of a target tree to other trees using noisy sub-sequence tree processing
US7292976B1 (en) 2003-05-29 2007-11-06 At&T Corp. Active learning process for spoken dialog systems
US20080040095A1 (en) 2004-04-06 2008-02-14 Indian Institute Of Technology And Ministry Of Communication And Information Technology System for Multiligual Machine Translation from English to Hindi and Other Indian Languages Using Pseudo-Interlingua and Hybridized Approach
US7346490B2 (en) 2000-09-29 2008-03-18 Axonwave Software Inc. Method and system for describing and identifying concepts in natural language text for information retrieval and processing
US20080215309A1 (en) 2007-01-12 2008-09-04 Bbn Technologies Corp. Extraction-Empowered machine translation
US20090006447A1 (en) 2007-06-28 2009-01-01 International Business Machines Corporation Between matching
US20090024385A1 (en) 2007-07-16 2009-01-22 Semgine, Gmbh Semantic parser
US7496621B2 (en) 2004-07-14 2009-02-24 International Business Machines Corporation Method, program, and apparatus for natural language generation
US20090063473A1 (en) 2007-08-31 2009-03-05 Powerset, Inc. Indexing role hierarchies for words in a search index
US7530020B2 (en) 2000-02-01 2009-05-05 Andrew J Szabo Computer graphic display visualization system and method
US7620538B2 (en) 2002-03-26 2009-11-17 University Of Southern California Constructing a translation lexicon from comparable, non-parallel corpora
US7853444B2 (en) 2005-10-09 2010-12-14 Kabushiki Kaisha Toshiba Method and apparatus for training transliteration model and parsing statistic model, method and apparatus for transliteration
US7890539B2 (en) 2007-10-10 2011-02-15 Raytheon Bbn Technologies Corp. Semantic matching using predicate-argument structure
US7987176B2 (en) 2007-06-25 2011-07-26 Sap Ag Mixed initiative semantic search

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6260036B1 (en) * 1998-05-07 2001-07-10 Ibm Scalable parallel algorithm for self-organizing maps with applications to sparse data mining problems

Patent Citations (111)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4599691A (en) 1982-05-20 1986-07-08 Kokusai Denshin Denwa Co., Ltd. Tree transformation system in machine translation system
US4754326A (en) 1983-10-25 1988-06-28 Keycom Electronic Publishing Method and apparatus for assisting user of information retrieval systems
US4809351A (en) 1985-06-07 1989-02-28 Saba Technologies, Inc. Optical character reader
US4914590A (en) 1988-05-18 1990-04-03 Emhart Industries, Inc. Natural language understanding system
US5062143A (en) 1990-02-23 1991-10-29 Harris Corporation Trigram-based method of language identification
US5418717A (en) 1990-08-27 1995-05-23 Su; Keh-Yih Multiple score language processing system
US5396419A (en) 1991-09-07 1995-03-07 Hitachi, Ltd. Pre-edit support method and apparatus
US5343537A (en) 1991-10-31 1994-08-30 International Business Machines Corporation Statistical mixture approach to automatic handwriting recognition
US5544257A (en) 1992-01-08 1996-08-06 International Business Machines Corporation Continuous parameter hidden Markov model approach to automatic handwriting recognition
US5406480A (en) 1992-01-17 1995-04-11 Matsushita Electric Industrial Co., Ltd. Building and updating of co-occurrence dictionary and analyzing of co-occurrence and meaning
US6278967B1 (en) 1992-08-31 2001-08-21 Logovista Corporation Automated system for generating natural language translations that are domain-specific, grammar rule-based, and/or based on part-of-speech analysis
US5787198A (en) 1992-11-24 1998-07-28 Lucent Technologies Inc. Text recognition using two-dimensional stochastic models
US5438630A (en) 1992-12-17 1995-08-01 Xerox Corporation Word spotting in bitmap images using word bounding boxes and hidden Markov models
US5492473A (en) 1993-12-29 1996-02-20 Shea; James W. Language instructional and fact recognition apparatus
US5752052A (en) 1994-06-24 1998-05-12 Microsoft Corporation Method and system for bootstrapping statistical processing into a rule-based natural language parser
US5757960A (en) 1994-09-30 1998-05-26 Murdock; Michael Chase Method and system for extracting features from handwritten text
US6029195A (en) 1994-11-29 2000-02-22 Herz; Frederick S. M. System for customized electronic identification of desirable objects
US5694559A (en) 1995-03-07 1997-12-02 Microsoft Corporation On-line help method and system utilizing free text query
US5903858A (en) 1995-06-23 1999-05-11 Saraki; Masashi Translation machine for editing a original text by rewriting the same and translating the rewrote one
US5963940A (en) 1995-08-16 1999-10-05 Syracuse University Natural language information retrieval system and method
US6026388A (en) 1995-08-16 2000-02-15 Textwise, Llc User interface and other enhancements for natural language information retrieval system and method
US6006221A (en) 1995-08-16 1999-12-21 Syracuse University Multilingual document retrieval system and method using semantic vector matching
US5926180A (en) 1996-01-16 1999-07-20 Nec Corporation Browsing unit and storage medium recording a browsing program thereon
US5862259A (en) 1996-03-27 1999-01-19 Caere Corporation Pattern recognition employing arbitrary segmentation and compound probabilistic evaluation
US5745113A (en) 1996-04-03 1998-04-28 Institute For Research On Learning Representing work practices
US5933525A (en) 1996-04-10 1999-08-03 Bbn Corporation Language-independent and segmentation-free optical character recognition system and method
US6260035B1 (en) 1996-07-19 2001-07-10 Microsoft Corporation Intelligent user assistance facility for a software program
US6021403A (en) 1996-07-19 2000-02-01 Microsoft Corporation Intelligent user assistance facility
US5822747A (en) 1996-08-23 1998-10-13 Tandem Computers, Inc. System and method for optimizing database queries
US5841895A (en) 1996-10-25 1998-11-24 Pricewaterhousecoopers, Llp Method for learning local syntactic relationships for use in example-based information-extraction-pattern learning
US5839106A (en) 1996-12-17 1998-11-17 Apple Computer, Inc. Large-vocabulary speech recognition using an integrated syntactic and semantic statistical language model
US5963965A (en) 1997-02-18 1999-10-05 Semio Corporation Text processing and retrieval system and method
US6105022A (en) 1997-02-26 2000-08-15 Hitachi, Ltd. Structured-text cataloging method, structured-text searching method, and portable medium used in the methods
US20020007383A1 (en) 1997-03-31 2002-01-17 Naoyuki Yoden Document preparation method and machine translation device
US6442584B1 (en) 1997-05-16 2002-08-27 Sybase, Inc. Methods for resource consolidation in a computing environment
US5940821A (en) 1997-05-21 1999-08-17 Oracle Corporation Information presentation in a knowledge base search and retrieval system
US5926784A (en) 1997-07-17 1999-07-20 Microsoft Corporation Method and system for natural language parsing using podding
US6112168A (en) 1997-10-20 2000-08-29 Microsoft Corporation Automatically recognizing the discourse structure of a body of text
US6304870B1 (en) 1997-12-02 2001-10-16 The Board Of Regents Of The University Of Washington, Office Of Technology Transfer Method and apparatus of automatically generating a procedure for extracting information from textual information sources
US6243670B1 (en) 1998-09-02 2001-06-05 Nippon Telegraph And Telephone Corporation Method, apparatus, and computer readable medium for performing semantic analysis and generating a semantic structure having linked frames
US6615207B1 (en) 1998-12-10 2003-09-02 International Business Machines Corporation Method of formulating and presenting search queries to a tabular database through a user-interactive computer display interface
US6167369A (en) 1998-12-23 2000-12-26 Xerox Company Automatic language identification using both N-gram and word information
US6430552B1 (en) 1998-12-24 2002-08-06 Microsoft Corporation Method for converting queries with logical operators into free text queries
US6278968B1 (en) 1999-01-29 2001-08-21 Sony Corporation Method and apparatus for adaptive speech recognition hypothesis construction and selection in a spoken language translation system
US6243669B1 (en) 1999-01-29 2001-06-05 Sony Corporation Method and apparatus for providing syntactic analysis and data structure for translation knowledge in example-based language translation
US6950753B1 (en) 1999-04-15 2005-09-27 The Trustees Of The Columbia University In The City Of New York Methods for extracting information on interactions between biological entities from natural language text data
US6609087B1 (en) 1999-04-28 2003-08-19 Genuity Inc. Fact recognition system
US6606625B1 (en) 1999-06-03 2003-08-12 University Of Southern California Wrapper induction by hierarchical data analysis
US20030078766A1 (en) 1999-09-17 2003-04-24 Douglas E. Appelt Information retrieval by natural language querying
US6853992B2 (en) 1999-12-14 2005-02-08 Fujitsu Limited Structured-document search apparatus and method, recording medium storing structured-document searching program, and method of creating indexes for searching structured documents
US20030093613A1 (en) 2000-01-14 2003-05-15 David Sherman Compressed ternary mask system and method
US7530020B2 (en) 2000-02-01 2009-05-05 Andrew J Szabo Computer graphic display visualization system and method
US6785673B1 (en) 2000-02-09 2004-08-31 At&T Corp. Method for converting relational data into XML
US6681044B1 (en) 2000-03-29 2004-01-20 Matsushita Electric Industrial Co., Ltd. Retrieval of cursive Chinese handwritten annotations based on radical model
US20010029455A1 (en) 2000-03-31 2001-10-11 Chin Jeffrey J. Method and apparatus for providing multilingual translation over a network
US6600501B1 (en) * 2000-05-18 2003-07-29 Microsoft Corporation Method and system for generating a dynamic timeline
US7062483B2 (en) 2000-05-18 2006-06-13 Endeca Technologies, Inc. Hierarchical data-driven search and navigation system and method for information retrieval
US20020035466A1 (en) 2000-07-10 2002-03-21 Syuuzi Kodama Automatic translator and computer-readable storage medium having automatic translation program recorded thereon
US6839714B2 (en) 2000-08-04 2005-01-04 Infoglide Corporation System and method for comparing heterogeneous data sources
US6795825B2 (en) 2000-09-12 2004-09-21 Naphtali David Rishe Database querying system and method
US7346490B2 (en) 2000-09-29 2008-03-18 Axonwave Software Inc. Method and system for describing and identifying concepts in natural language text for information retrieval and processing
US7146349B2 (en) 2000-11-06 2006-12-05 International Business Machines Corporation Network for describing multimedia information
US6892189B2 (en) 2001-01-26 2005-05-10 Inxight Software, Inc. Method for learning and combining global and local regularities for information extraction and classification
US20020143537A1 (en) 2001-03-30 2002-10-03 Fujitsu Limited Of Kawasaki, Japan Process of automatically generating translation- example dictionary, program product, computer-readable recording medium and apparatus for performing thereof
US6856992B2 (en) * 2001-05-15 2005-02-15 Metatomix, Inc. Methods and apparatus for real-time business visibility using persistent schema-less data storage
US20030120640A1 (en) 2001-12-21 2003-06-26 Hitachi. Ltd. Construction method of substance dictionary, extraction of binary relationship of substance, prediction method and dynamic viewer
US20030182310A1 (en) * 2002-02-04 2003-09-25 Elizabeth Charnock Method and apparatus for sociological data mining
US7249013B2 (en) 2002-03-11 2007-07-24 University Of Southern California Named entity translation
US7620538B2 (en) 2002-03-26 2009-11-17 University Of Southern California Constructing a translation lexicon from comparable, non-parallel corpora
US20030189933A1 (en) 2002-04-03 2003-10-09 Timucin Ozugur Shared wavelength group to differentiate label switched paths for congestion control in optical burst switching networks
US7287026B2 (en) 2002-04-05 2007-10-23 Oommen John B Method of comparing the closeness of a target tree to other trees using noisy sub-sequence tree processing
US20030208499A1 (en) * 2002-05-03 2003-11-06 David Bigwood Methods and apparatus for visualizing relationships among triples of resource description framework (RDF) data sets
US20030212543A1 (en) 2002-05-07 2003-11-13 International Business Machines Corporation Integrated development tool for building a natural language understanding application
US20040039734A1 (en) 2002-05-14 2004-02-26 Judd Douglass Russell Apparatus and method for region sensitive dynamically configurable document relevance ranking
CA2485554A1 (en) 2002-05-14 2003-11-27 Verity, Inc. Searching structured, semi-structured, and unstructured content
US20030216905A1 (en) 2002-05-20 2003-11-20 Ciprian Chelba Applying a structured language model to information extraction
US7146030B2 (en) 2002-05-22 2006-12-05 Agilent Technologies, Inc. System and methods for extracting semantics from images
US7149687B1 (en) 2002-07-29 2006-12-12 At&T Corp. Method of active learning for automatic speech recognition
US20040049495A1 (en) 2002-09-11 2004-03-11 Chung-I Lee System and method for automatically generating general queries
US20040054521A1 (en) 2002-09-13 2004-03-18 Fuji Xerox Co., Ltd. Text sentence comparing apparatus
US20040162806A1 (en) 2002-09-13 2004-08-19 Fuji Xerox Co., Ltd. Text sentence comparing apparatus
US20040098670A1 (en) 2002-11-15 2004-05-20 Carroll Jeremy John Processing of data
US20040107118A1 (en) 2002-11-27 2004-06-03 Hugh Harnsberger Electronic clinical reference and education system and method of use
US20040111253A1 (en) 2002-12-10 2004-06-10 International Business Machines Corporation System and method for rapid development of natural language understanding using active learning
US7031970B2 (en) 2002-12-16 2006-04-18 Palo Alto Research Center Incorporated Method and apparatus for generating summary information for hierarchically related information
US7081834B2 (en) 2003-03-21 2006-07-25 Rockwell Scientific Licensing Llc Aviation weather awareness and reporting enhancements (AWARE) system using a temporal-spatial weather database and a Bayesian network model
US20040243531A1 (en) 2003-04-28 2004-12-02 Dean Michael Anthony Methods and systems for representing, using and displaying time-varying information on the Semantic Web
US7292976B1 (en) 2003-05-29 2007-11-06 At&T Corp. Active learning process for spoken dialog systems
US20050039123A1 (en) 2003-08-14 2005-02-17 Kuchinsky Allan J. Method and system for importing, creating and/or manipulating biological diagrams
US20080040095A1 (en) 2004-04-06 2008-02-14 Indian Institute Of Technology And Ministry Of Communication And Information Technology System for Multiligual Machine Translation from English to Hindi and Other Indian Languages Using Pseudo-Interlingua and Hybridized Approach
US20050283365A1 (en) 2004-04-12 2005-12-22 Kenji Mizutani Dialogue supporting apparatus
US20060015320A1 (en) 2004-04-16 2006-01-19 Och Franz J Selection and use of nonstatistical translation components in a statistical machine translation framework
US20050278325A1 (en) 2004-06-14 2005-12-15 Rada Mihalcea Graph-based ranking algorithms for text processing
US7496621B2 (en) 2004-07-14 2009-02-24 International Business Machines Corporation Method, program, and apparatus for natural language generation
US20060036592A1 (en) 2004-08-11 2006-02-16 Oracle International Corporation System for ontology-based semantic matching in a relational database system
US20060116866A1 (en) 2004-11-02 2006-06-01 Hirokazu Suzuki Machine translation system, method and program
US20060242101A1 (en) 2005-04-21 2006-10-26 Rama Akkiraju Method and system for semantic matching of Web Service policies
US20060245641A1 (en) 2005-04-29 2006-11-02 Microsoft Corporation Extracting data from semi-structured information utilizing a discriminative context free grammar
US20060253274A1 (en) 2005-05-05 2006-11-09 Bbn Technologies Corp. Methods and systems relating to information extraction
US20060253476A1 (en) 2005-05-09 2006-11-09 Roth Mary A Technique for relationship discovery in schemas using semantic name indexing
US20070011150A1 (en) 2005-06-28 2007-01-11 Metacarta, Inc. User Interface For Geographic Search
US7853444B2 (en) 2005-10-09 2010-12-14 Kabushiki Kaisha Toshiba Method and apparatus for training transliteration model and parsing statistic model, method and apparatus for transliteration
US20070136246A1 (en) 2005-11-30 2007-06-14 At&T Corp. Answer determination for natural language questioning
US20070233696A1 (en) 2006-04-03 2007-10-04 International Business Machines Corporation Apparatus, Method, and Program Product for Information Processing
US20080215309A1 (en) 2007-01-12 2008-09-04 Bbn Technologies Corp. Extraction-Empowered machine translation
US7987176B2 (en) 2007-06-25 2011-07-26 Sap Ag Mixed initiative semantic search
US20090006447A1 (en) 2007-06-28 2009-01-01 International Business Machines Corporation Between matching
US20090024385A1 (en) 2007-07-16 2009-01-22 Semgine, Gmbh Semantic parser
US20090063473A1 (en) 2007-08-31 2009-03-05 Powerset, Inc. Indexing role hierarchies for words in a search index
US7890539B2 (en) 2007-10-10 2011-02-15 Raytheon Bbn Technologies Corp. Semantic matching using predicate-argument structure
US20110153673A1 (en) 2007-10-10 2011-06-23 Raytheon Bbn Technologies Corp. Semantic matching using predicate-argument structure

Non-Patent Citations (107)

* Cited by examiner, † Cited by third party
Title
ACE (Automatic Content Extraction) English Annotation Guidelines for Entities, Ver.5.6.1, Linguistic Data Consortium, 34 pages. May 2005. http://www.Idc.upenn.edu/Projects/ACE/.
Agazzi, O.E., et al., "Hidden Markov Model Based Optical Character Recognition in the Presence of Deterministic Transformations," Pattern Recognition, vol. 26, No. 12, pp. 1813-1826, Dec. 1993.
Al-Badr, B., et al., "Survey and bibliography of Arabic optical text recognition," Signal Processing, vol. 41, No. 1, pp. 49-77, Jan. 1995.
Andreevskaia, A., et al., "Can Shallow Predicate Argument Structures Determine Entailment?," Proceedings from the 1st PASCAL Recognising Textual Entailment Challenge (RTE I), 4 pages, Southampton, UK, Apr. 2005.
Anigbogu, J.C., et al., "Performance Evaluation of an HMM Based OCR System," Proceedings of the 11th International Conference on Pattern Recognition, The Hague, The Netherlands, pp. 565-568, Aug. 1992.
Aone, C., et al., "SRA: Description of the IE2 System Used for MUC-7," Proceedings of the 7th Message Understanding Conference (MUC-7), pp. 1-14, 1998. Available at: http://www.itl.nist.gov/iaui/894.02/related-projects/muc/proceedings/muc-7-proceedings/sra-muc7.pdf.
Barzilay, R., et al., "Sentence Fusion for Multidocument News Summarization," Association for Computational Linguistics, vol. 31, No. 3, pp. 297-327, Sep. 2005.
Bellegarda, J., et al., "Tied Mixture Continuous Parameter Models for Large Vocabulary Isolated Speech Recognition," IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 13-16, May 23-26, 1989.
Bennett, S.W., et al., "Learning to Tag Multilingual Texts Through Observation," Proceedings of the Second Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, pp. 109-116, 1997.
Bippus, et al., "Cursive Script Recognition Using Semi Continuous Hidden Markov Models in Combination with Simple Features," IEE European Workshop on Handwriting Analysis and Recognition, pp. 6/1-6, Brussels, Jul. 1994.
Bock, J., et al., "Conceptual accessibility and syntactic structure in sentence formulation," Cognition 21, pp. 47-67, 1985.
Bose, et al., "Connected and Degraded Text Recognition Using Hidden Markov Model," Proceedings of the 11th International Conference on Pattern Recognition, vol. II, pp. 116-119, Aug. 3-Sep. 2, 1992.
Brill, E., "Automatic Grammar Induction and Parsing Free Text: A Transformation-Based Approach," Proceedings of the 31st Annual Meeting of the Association for Computational Linguistics, pp. 259-265, 1993.
Buraga et al. A RDF-based Model for Expressing Spatio-Temporal Relations Between Web Sites, Published by IEEE 2002. *
Cardie, C., "Empirical Methods in Information Extraction," American Association of Artificial Intelligence (AAAI), vol. 18, No. 4, pp. 65-80, 1997.
Collins, M., "Three Generative, Lexicalised Models for Statistical Parsing," Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and 8th Conference of the European Chapter of the Association for Computational Linguistics, pp. 16-23, 1997.
Conrad, J.G., "A system for Discovering Relationships by Feature Extraction from Text Databases," Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR-94), pp. 260-270, 1994.
Cowie, J., "Information Extraction," Communications of the ACM, vol. 39, Issue 1, pp. 80-91, Jan. 1996.
De Marneffe, M.-C., et al., "Generating Typed Dependency Parses from Phrase Structure Parses"; Proceedings of 5th International Conference on Language Resources and Evaluation, pp. 1-6, Genoa, Italy, 2006.
De Salvo Braz, R., et al., "Knowledge Representation for Semantic Entailment and Question-Answering," Department of Computer Science, University of Illinois, pp. 1-10, 2005.
Dowding, J., et al., "Gemini: A Natural Language System for Spoken-Language Understanding," Annual Meeting of the Association for Computational Linguistics, pp. 54-61, Columbus, OH, 1993.
Fellbaum, C., "WordNet, an Electronic Lexical Database," MIT Press, 422 pages, Cambridge, MA, 1998.
Finn, A., et al., "Active Learning Selection Strategies for Information Extraction," Proceedings of the International Workshop on Adaptive Text Extraction and Mining, pp. 1-8, 2003.
Florian, R., et al., "A Statistical Model for Multilingual Entity Detection and Tracking," Proceedings of Human Language Technology Conference North American Association for Computational Linguistics, pp. 1-8, Boston, MA, 2004.
Forney, G.D., et al., "The Viterbi Algorithm," Proceedings of the IEEE, vol. 61, No. 3, pp. 268-278, 1973.
Gerevini et al. Qualitative Spatio-Temoral Reasoning with RCC-8 and Allen's Interval Calculus: Computation Complexity, published 2002 CiteSeerx. *
Gildea, D., "Loosely Tree-Based Alignment for Machine Translation," Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pp. 80-87, Supporo, Japan, 2003.
Goldman, S., et al., "Enhancing Supervised Learning with Unlabeled Data," Proceedings of the 17th International Conference on Machine Learning (ICML-00), pp. 327-334, San Francisco, CA, 2000.
Gonzalez, et al., "Digital Image Processing," Addison-Wesley Pub Co., pp. 416-418, 1992.
Grisham, R., "Discovery Methods for Information Extraction," Proceedings of the ISCA & IEEE Workshop on Spontaneous Speech Processing and Recognition, Tokyo Institute of Technology, pp. 1-5, Tokyo, Japan, Apr. 2003.
Grishman, R., "Adaptive Information Extraction and Sublanguage Analysis" Proceedings of the Workshop on Adaptive Text Extraction and Mining, 17th International Joint Conference on Artificial Intelligence (IJCAI-2001), pp. 1-4, Seattle, Washington, Aug. 2001.
Grishman, R., "Information Extraction," Handbook of Computational Linguistics, pp. 1-11, 2003.
Grishman, R., et al., "NYU's English ACE 2005 System Description," ACE 05 Evaluation Workshop, 2005. Online at http://nlp.cs.nyu.edu/publication.
Hasegawa, T., et al., "Discovering Relations among Named Entities from Large Corpora," Proceedings of the 42nd Annual Meeting of Association of Computational Linguistics (ACL-04), pp. 415-422, Barcelona, Spain, 2004.
Herrera, J., et al., "Textual Entailment Recognition Based on Dependency Analysis and WordNet," Proceedings of the 1st PASCAL Challenges Workshop on Recognising Textual Entailment, pp. 21-24, Southampton, UK, Apr. 2005.
Hoffmann C.M., et al., "Pattern Matching in Trees"; Journal of the Association for Computer Machinery, vol. 29, No. 1, pp. 68-95, Jan. 1982.
Humphreys, K., et al., "University of Sheffield: Description of the LaSIE-II System as Used for MUC-7," Proceedings of the 7th Message Understanding Conference (MUC-7), pp. 1-20, 1998. Available at: http://www.itl.nist.gov/iaui/894.02/related-projects/muc/proceedings/muc-7-proceedings/sheffield-muc7.pdf.
Ji, H., et al., "Applying Coreference to Improve Name Recognition," Proceedings of the ACL 2004 Workshop on Reference Resolution and Its Applications, pp. 1-8, Barcelona, Spain, Jul. 2004.
Jones, R., et al., "Active Learning for Information Extraction with Multiple View Feature Sets," 20th International Workshop on Adaptive Text Extraction and Mining, pp. 1-8, Washington, DC, Aug. 21-24, 2003.
Kaltenmeier, et al., "Sophisticated Topology of Hidden Markov Models for Cursive Script Recognition," Proceedings of the Second International Conference on Document Analysis and Recognition, pp. 139-142, Tsukuba, Japan, Oct. 1993.
Kambhatla, N., "Combining Lexical, Syntactic, and Semantic Features with Maximum Entropy Models for Extracting Relations," Proceedings of the 42nd Anniversary Meeting of the Association for Computational Linguistics, pp. 1-4, 2004.
Karov, Y., et al., "Similarity-based Word Sense Disambiguation," Association for Computational Linguistics, vol. 24, Issue 1, pp. 1-26, Mar. 1998.
Kehler, A. "Probabilistic Coreference in Information Extraction," Proceeding of the 2nd Conference on Empirical Methods in Natural Language Processing (EMNLP-2), pp. 163-173, Providence, RI, Aug. 1-2, 1997.
Kehler, A., "Current Theories of Centering for Pronoun Interpretation: A Critical Evaluation," Computational Linguistics, vol. 23, No. 3, pp. 467-475, 1997.
Kehler, A., et al., "Competitive Self-Trained Pronoun Interpretation," Proceedings of the Human Language Technology Conference, North American Chapter of the Association for Computational Linguistics, pp. 33-36, May 2004.
Kehler, A., et al., "The (Non) Utility of Predicate-Argument Frequencies for Pronoun Interpretation" Proceedings of Human Language Technology Conference, pp. 289-296, 2004.
Kilpeläinen, P., "Tree Matching Problems with Applications to Structure Text Databases," PhD thesis, Department of Computer Science, University of Helsinki, 113 pages, Finland, Nov. 1992.
Kingsbury, P., et al., "Adding Semantic Annotation to the Penn TreeBank"; Proceedings of the Human Language Technology Conference, pp. 1-5, San Diego, CA, 2002.
Klapsing et al. (Semantics in web engineering: Applying the resource description framework, http://ieeexplore.ieee.org/xpls/abs-all.jsp?arnumber=917972, 2001). *
Kopec, G., et al., "Document Image Decoding Using Markov Source Models," IEEE. Transactions on Pattern Analysis and Machine Intelligence, vol. 16, pp. 1-13, 1994.
Kouylekov, M., et al., "Recognizing Textual Entailment with Tree Edit Distance Algorithms," Proceedings of PASCAL Challenges Workshop on Recognising Textual Entailment, pp. 17-20, Southampton, UK, Apr. 2005.
Kundu, A., et al., "Recognition of Handwritten Script: a Hidden Markov Model Based Approach," Journal of the Pattern Recognition Society, Pergamon Press, vol. 22, No. 3, 283-297, 1989.
Lapata, M., "Probabilistic Text Structuring: Experiments with Sentence Ordering," Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pp. 545-552, Jul. 2003.
Lehnert, W., et al., "UMass/Hughes: Description of the Circus System Used for MUC-5," Proceedings of the Fifth Message Understanding Conference (MUC-5), pp. 1-16, 1993.
Levin, E., et al., "Dynamic Planar Warping for Optical Character Recognition," Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, vol. III, pp. 149-152, Mar. 1992.
Levit, M., "Spoken Language Understanding without Transcriptions in a Call Canter Scenario," PhD thesis, 249 pages, Logos Verlag, Berlin, Germany, 2005.
Makhoul, J., et al., "Vector Quantization in Speech Coding," Proceedings of IEEE, vol. 73, No. 11, pp. 1551-1588, Nov. 1985.
Marcus, M.P., et al., "Building a Large Annotated Corpus of English: The Penn Treebank," Computational Linguistics, vol. 19, No. 2, pp. 313-330, 1993.
Miller, S., et al., "Name Tagging with Word Clusters and Discriminative Training," Proceedings of the Human Language Technology Conference and Meeting of the North American Association for Computational Linguistics, pp. 337-342, 2004.
Moldovan, D., et al., "COGEX: A Logic Prover for Question Answering," Proceedings of the Human Language Technology and North American Chapter of the Association of Computational Linguistics Conference, vol. 1, pp. 87-93, Edmonton, Canada, 2003.
Narayanan S., et al., "Question Answering Based on Semantic Structures"; Proceedings of the 20th International Conference on Computational Linguistics (COLING-2004), Geneva, Switzerland, Aug. 2004.
Nguyen, L., et al., "The 1994 BBN/BYBLOS Speech Recognition System," Proceedings of the ARPA Spoken Language Systems Technology Workshop, Morgan Kaufmann Publishers, pp. 77-81, Jan. 1995.
Nigam, K., et al., "Text Classification from Labeled and Unlabeled Documents using EM, " Machine Learning, vol. 39, Issue 2-3, pp. 103-134, 2000.
Office Action issued in U.S. Appl. No. 10/806,406 on Apr. 29, 2008.
Office Action issued in U.S. Appl. No. 10/806,406 on Jan. 19, 2007.
Office Action issued in U.S. Appl. No. 10/806,406 on Sep. 5, 2007.
Office Action issued in U.S. Appl. No. 11/411,206 on Aug. 13, 2009.
Office Action issued in U.S. Appl. No. 11/411,206 on Dec. 19, 2008.
Office Action issued in U.S. Appl. No. 11/974,022 on Jun. 10, 2010.
Office Action issued in U.S. Appl. No. 11/974,022 on Nov. 24, 2009.
Office Action issued in U.S. Appl. No. 11/998,663 on May 11, 2011.
Office Action issued in U.S. Appl. No. 13/012,225 on Sep. 29, 2011.
Pang, B., et al., "Syntax-Based Alignment of Multiple Translations: Extracting Paraphrases and Generating New Sentences," Proceedings of the Human Language Technology and North American Chapter of the Association of Computational Linguistics Conference, pp. 102-109, Edmonton, Canada, 2003.
Park, H.-S., et al., "Off-line Recognition of Large-set Handwritten Characters with Multiple Hidden Markov Models," Pattern Recognition, vol. 29, No. 2, pp. 231-244, Elsevier Science Ltd, Great Britain, 1996.
Patten, T., et al., "Description of the TASC System Used for MUC-7," Proceedings of the 7th Message Understanding Conference (MUC-7), pp. 1-5, Fairfax, VA, 1998. Available at: http://www.itl.nist.gov/iaui/894.02/related-projects/muc/proceedings/muc-7-proceedings/tasc-muc7.pdf.
Pereira, F.C.N., et al., "Prolog and Natural-Language Analysis," Microtome Publishing, 204 pages, 2002.
Phillips, I.T., et al., "CD-ROM document database standard," Proceedings of the 2nd International Conference Document Analysis and Recognition, Tsukuba Science City, Japan, pp. 478-483, 1993.
Pustejovsky et al. (http://www.timeml.org/site/publications/timeMLpubs/IWCS-v4.pdf, 2003). *
Quirk, C., et al., "Dependency Treelet Translation: Syntactically Informed Phrasal SMT," Proceedings from the 43rd Annual Meeting of the Association for Computational Linguistics, pp. 271-279, Jun. 2005.
Rabiner, L., "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proceedings of the IEEE, vol. 77, No. 2, pp. 257-286, Feb. 1989.
Radev, D.R., et al., "Generating Natural Language Summaries from Multiple On-line Sources", Computational Linguistics, vol. 24, No. 3, pp. 469-500, 1998.
Ramshaw, "Statistical Models for Information Extraction", JHU Summer School on Human Language Technology, Jun. 2004.
Ramshaw, L., et al., "Experiments in Multi-Modal Automatic Content Extraction," Proceedings of the 1st International Conference on Human Language Technology Research, pp. 1-4, San Diego, CA, 2001.
Reggiori et al. (http://www.w3.org/2001/sw/Europe/events/20031113-storage/positions/asemantics.html, Oct. 2003). *
Riloff, E., "Automatically Generating Extraction Patterns from Untagged Text," Proceedings of the 13th National Conference on Artificial Intelligence (AAAI-96), pp. 1044-1049.
Schwartz, R.M., et al., "Improved Hidden Markov Modeling of Phonemes for Continuous Speech Recognition," Proceedings of the ICASSP, vol. 9, pp. 21-24, 1984.
Sekine. S., "Named Entity: History and Future," Proteus Project Report, 2004.
Shinyama, Y., et al., "Named Entity Discovery Using Comparable News Articles," Proceedings of the International Conference on Computational Linguistics (COLING); pp. 848-853, 2004.
Shwartz, R., "A Comparison of Several Approximate Algorithms for Finding Multiple (N-BEST) Sentence Hypotheses," Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 1, pp. 701-704, May 1993.
Sin, et al., "A Statistical Approach with HMMs for On-Line Cursive Hangul (Korean Script) Recognition," Proceedings of the Second International Conference on Document Analysis and Recognition, pp. 147-150, Oct. 1993.
Starner, T., et al., "On-Line Cursive Handwriting Recognition Using Speech Recognition Methods," IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 5, pp. V/125-V/128, Apr. 19-22, 1994.
Stone, M., et al., "Sentence Planning as Description Using Tree Adjoining Grammar," Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics, pp. 198-205, Madrid, Spain, 1997.
Sudo, K., et al., "An Improved Extraction Pattern Representation Model for Automatic IE Pattern Acquisition" Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pp. 2224-2231, Jul. 2003.
Sudo, K., et al., "Cross-lingual Information Extraction System Evaluation," Proceedings from the International Conference on Computational Linguistics (COLING); pp. 882-888, 2004.
Thompson, et al., "Active learning for natural language parsing and information extraction", Proc. of 6th International Machine Learning Conference, Jun. 1999.
Uchimoto, K., et al. "Word Translation by Combining an Example-Based Method and Machine Learning Models" J. Natural Language Processing, vol. 10, No. 3, pp. 87-114, 2003.
Vishwanathan, S.V.N., et al., "Fast Kernels for String and Tree Matching," Neural Information Processing Systems, 8 pages, MIT Press, 2004.
Vlontzos, J.A., et al., "Hidden Markov Models for Character Recognition," IEEE Transactions on Image Processing, vol. 1, Issue 4, pp. 539-543, Oct. 1992.
Wang, J.T.-L., et al., "A System for Approximate Tree Matching," IEEE Transactions on Knowledge and Data Engineering, vol. 6, No. 4, pp. 559-571, Aug. 1994.
Wu, D., "Stochastic Inversion Transduction Grammars and Bilingual Parsing of Parallel Corpora," Association for Computational Linguistics, vol. 23, No. 3, pp. 377-403, Sep. 1997.
Yangarber, R., "Counter-Training in Discovery of Semantic Patterns," Proceedings of the 41st Annual Meeting for Computational Linguistics, pp. 343-350, Japan, 2003.
Yangarber, R., et al., "NYU: Description of the Proteus/PET System as Used for MUC-7 ST," Proceedings of the 7th Message Understanding Conference (MUC-7), pp. 1-7, 1998. Available at: http://www.itl.nist.gov/iaui/894.02/related-projects/muc/proceedings/muc-7-proceedings/nyu-st-paper.pdf.
Yangarber, R., et al., "Unsupervised Learning of Generalized Names," Proceedings of the 19th International Conference on Computational Linguistics (COLING-02), pp. 1-7, 2002.
Younger, D.H., "Recognition and Parsing of Context-Free Languages in Time n3," Information and Control, vol. 10, pp. 189-208, 1967.
Zelenko, D., et al., "Kernel Methods for Relation Extraction," Journal of Machine Learning Research, vol. 3, pp. 1083-1106, Mar. 2003.
Zhao, S., et al., "Discriminative Slot Detection Using Kernel Methods," Proceedings of the 20th International Conference on Computational Linguistics (COLING-04), pp. 1-7, Geneva, Switzerland, 2004.
Zhao, S., et al., "Extracting Relations with Integrated Information Using Kernel Methods," Proceedings of the 43rd Annual Meeting of ACL, pp. 419-426, Jun. 2005.

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9760566B2 (en) 2011-03-31 2017-09-12 Microsoft Technology Licensing, Llc Augmented conversational understanding agent to identify conversation context between two humans and taking an agent action thereof
US9244984B2 (en) 2011-03-31 2016-01-26 Microsoft Technology Licensing, Llc Location based conversational understanding
US9298287B2 (en) 2011-03-31 2016-03-29 Microsoft Technology Licensing, Llc Combined activation for natural user interface systems
US9842168B2 (en) 2011-03-31 2017-12-12 Microsoft Technology Licensing, Llc Task driven user intents
US9858343B2 (en) 2011-03-31 2018-01-02 Microsoft Technology Licensing Llc Personalization of queries, conversations, and searches
US10049667B2 (en) 2011-03-31 2018-08-14 Microsoft Technology Licensing, Llc Location-based conversational understanding
US10296587B2 (en) 2011-03-31 2019-05-21 Microsoft Technology Licensing, Llc Augmented conversational understanding agent to identify conversation context between two humans and taking an agent action thereof
US10585957B2 (en) 2011-03-31 2020-03-10 Microsoft Technology Licensing, Llc Task driven user intents
US9454962B2 (en) * 2011-05-12 2016-09-27 Microsoft Technology Licensing, Llc Sentence simplification for spoken language understanding
US20170011025A1 (en) * 2011-05-12 2017-01-12 Microsoft Technology Licensing, Llc Sentence simplification for spoken language understanding
US20120290290A1 (en) * 2011-05-12 2012-11-15 Microsoft Corporation Sentence Simplification for Spoken Language Understanding
US10061843B2 (en) 2011-05-12 2018-08-28 Microsoft Technology Licensing, Llc Translating natural language utterances to keyword search queries
US9064006B2 (en) 2012-08-23 2015-06-23 Microsoft Technology Licensing, Llc Translating natural language utterances to keyword search queries

Also Published As

Publication number Publication date
US20040243531A1 (en) 2004-12-02
US20100281045A1 (en) 2010-11-04

Similar Documents

Publication Publication Date Title
US8595222B2 (en) Methods and systems for representing, using and displaying time-varying information on the semantic web
US8095553B2 (en) Sequence support operators for an abstract database
US10097597B2 (en) Collaborative workbench for managing data from heterogeneous sources
US7689580B2 (en) Search based application development framework
US7865491B2 (en) Model entity operations in query results
US8122012B2 (en) Abstract record timeline rendering/display
US7689555B2 (en) Context insensitive model entity searching
US6490581B1 (en) System and method for providing an object-oriented interface to a relational database
US7321895B2 (en) Timeline condition support for an abstract database
US20040103073A1 (en) System for and method of using component-based development and web tools to support a distributed data management system
US7472116B2 (en) Method for filtering query results using model entity limitations
US7844623B2 (en) Method to provide management of query output
US20060235836A1 (en) Query conditions on related model entities
US20060161528A1 (en) Method for regenerating selected rows for an otherwise static result set
WO2005008369A2 (en) Abstract data linking and joining interface
US20070136262A1 (en) Polymorphic result sets
US8458200B2 (en) Processing query conditions having filtered fields within a data abstraction environment
JP5192634B2 (en) Declaration order report parameterization
US20060294066A1 (en) Visual display of information using historical condition support and event profiles
US20170109341A1 (en) Method of Data Capture, Storage and Retrieval Through User Created Form Templates and Data Item Templates by Executing Computer-Executable Instructions Stored On a Non-Transitory Computer-Readable Medium
US20080168042A1 (en) Generating summaries for query results based on field definitions
US20060161573A1 (en) Logical record model entity switching
US8090737B2 (en) User dictionary term criteria conditions
US20060106776A1 (en) Utilizing mathematical operations with abstract queries
US20160179476A1 (en) Method Of Operating A Software Engine For Storing, Organizing And Reporting Data In An Organizational Environment Through User Created Templates And Data Items By Executing Computer-Executable Instructions Stored On A Non-Transitory Computer-Readable Medium

Legal Events

Date Code Title Description
AS Assignment

Owner name: RAYTHEON BBN TECHNOLOGIES CORP., MASSACHUSETTS

Free format text: CHANGE OF NAME;ASSIGNOR:BBN TECHNOLOGIES CORP.;REEL/FRAME:024456/0537

Effective date: 20091027

AS Assignment

Owner name: BBNT SOLUTIONS LLC, MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DEAN, MICHAEL ANTHONY;REEL/FRAME:024865/0418

Effective date: 20040729

AS Assignment

Owner name: BBN TECHNOLOGIES CORP., MASSACHUSETTS

Free format text: MERGER;ASSIGNOR:BBNT SOLUTIONS LLC;REEL/FRAME:027234/0913

Effective date: 20051122

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8