EP1993446A2 - System for and method for psychological assessment - Google Patents

System for and method for psychological assessment

Info

Publication number
EP1993446A2
EP1993446A2 EP07753053A EP07753053A EP1993446A2 EP 1993446 A2 EP1993446 A2 EP 1993446A2 EP 07753053 A EP07753053 A EP 07753053A EP 07753053 A EP07753053 A EP 07753053A EP 1993446 A2 EP1993446 A2 EP 1993446A2
Authority
EP
European Patent Office
Prior art keywords
subject
assessment
client
stimuli
stimulus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP07753053A
Other languages
German (de)
French (fr)
Other versions
EP1993446A4 (en
Inventor
W. Michael Sturm
Melissa Meredith Wells
Bruce Holt
Edward M. Yokley
John Murphy
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Spherical Dynamics Inc
Original Assignee
Spherical Dynamics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Spherical Dynamics Inc filed Critical Spherical Dynamics Inc
Publication of EP1993446A2 publication Critical patent/EP1993446A2/en
Publication of EP1993446A4 publication Critical patent/EP1993446A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00Teaching not covered by other main groups of this subclass

Definitions

  • the present invention relates generally to the field of psychological assessment of individuals and teams of individuals.
  • the present invention provides systems, methods and program products relating to the assessment, evaluation, training and coaching of subjects such as individuals, groups of individuals, and entities.
  • the invention provides a variety of descriptions of an individual based on the strengths and weaknesses (i.e., energy) of the individual as measured in discrete psychological categories. In some instances, there are four categories, e.g., strategize, motivate, analyze, and active. These categories have multiple names in the art. The starting point for the descriptions is an assessment, which determines the strength of the individual in each of the psychological categories. In some instances, the energy is represented by a numerical value, with a larger numerical value corresponding to a greater energy.
  • the strength is represented by an ordering of the categories, for example from “least like” to “most like.”
  • the numbers representing the strengths of the individual when taken together can form a process map, which maps out the processes that the individual uses to complete a task.
  • the energy of each category can be determined by presenting the individual with a series of plurality of stimuli (e.g., pairs of words) which have been found to correspond to the categories, and asking the individual to choose one stimulus from among the plurality of stimuli. Based on the responses of the individual, the assessment can be constructed. In some instances, based on the relative strengths represented in the assessment, specific evaluations which include narrative descriptions of the individual can be created. These narrative descriptions can include how the individual prefers to work, learn, and work with others.
  • an assessment can be further expanded to embrace a virtual (i.e., ideal) individual that would be best suited to perform a task, and based on a comparison of the virtual and individual assessments, a narrative description of how well an individual would perform a specific task can be constructed.
  • an assessment describing a team of individuals can be created by overlaying the individual assessments of the team members, for example.
  • assessments can be compared between individuals to determine how best the individuals can work together, and based on the resulting assessment, a description of how the individuals work together can be constructed.
  • the assessments, and the narrative description based on them can be used to coach an individual to better perform a task.
  • the invention provides a method of conducting an assessment of a subject comprising: a) presenting to the subject a first set of two or more stimuli, for example two, three, four or more stimuli, wherein at least two of the stimuli correspond to different characteristic categories; and, b) receiving a selection by the subject of one of the stimuli corresponding to a first characteristic category.
  • assert refers to an evaluation, a categorization or other determination of a subject, such as an individual.
  • An assessment may include characteristic categories describing the subject.
  • an assessment may include a psychological assessment.
  • a "subject” may be an individual, a group of individuals or an entity, for example, a team.
  • an assessment includes stimuli selected by the subject.
  • the terms “presentation” or “presenting” refer to displaying as graphics, text, audio, video, or the like.
  • a display may include the use of computer or other electronic device and may be accomplished through a communication network, such as the Internet.
  • the term “stimulus” refers to a word- pair or other device, such as photo, image, graphic, sketch, or the like, selected to elicit a response from the subject.
  • word-pair refers to two words or phrases taken together. In one embodiment, the separate words or phrases of a word- pair are separated by a comma.
  • Non-limiting examples of word-pairs include the following: "aggressive, boisterous,” “well prepared, conceptual,” “self disciplined, firm,” “explores options, sensitive.”
  • characteristic category refers to a characteristic, a phase or other feature of a subject or an assessment. Each characteristic category may correspond to a characteristic or feature associated with an emotional, physical, biological or intelligence characteristic, for example.
  • receiving refers to acquiring a signal or an input, for example.
  • receiving a selection refers to acquiring or otherwise accepting as input from the subject an indication in the form of a response choosing one of the stimuli in preference to other stimuli.
  • receiving includes a response time criterion (i.e., time limit for response) beyond which a response is not accepted.
  • response time criterion refers to an interval of time after presentation of a stimulus that a subject is allotted for providing a response.
  • the response time criterion can be for example 1 , 2, 3, 4, 5, 10, 15, 20, 30, 45 seconds, 1 , 2, 3, 4,5 minutes, or even longer.
  • the response time criterion is in the range 1 -10, 1-20, 1-30, and 1 -45 seconds.
  • the response time criterion is in the range 1-45 seconds.
  • receiving includes recording the time taken by the subject to respond to each of a plurality of stimuli and using a response time consistency criterion calculated from a statistical analysis of the elapsed time so recorded.
  • Response time consistency criterion refers to a statistical factor which is calculated from the time taken by a subject in responding to each of a plurality of stimuli. If a response is not received within the response time consistency criterion, then the response is discarded. Optionally, the subject may be presented an additional stimulus.
  • a response time consistency criterion is a multiple of the average time required by the subject to respond to a plurality of stimuli.
  • the multiple of the average time is in the range 0.01 to 100 (e.g., 0.1 to 10, 0.1 to 5, and the like).
  • the response time consistency criterion can be a multiple thereof (e.g., 1, 2, 3, 4, 5, 10, 15, 20, 30, 40, 50, 60, 70, 80, 90, 100, or even 1000 sec).
  • the response time consistency criterion is calculated by adding a multiple of the standard deviation of the response time for a plurality of stimuli to the average time taken to respond to the plurality of stimuli.
  • the multiple is in the range 0.01 to 100, e.g., 0.1 , 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 15, 20, 30, 40, 50, or even 100).
  • the response time consistency criterion could be 10-sec plus some multiple of 3-sec, providing a time consistency criterion of 13-sec, 16-sec, 19-sec, 22-sec, 25-sec, for multiples of 1-5, respectively).
  • the term "response" refers to an indication of a preference or a selection by the subject.
  • the response may be "yes” or “no,” a number between two extremes, for example, without limitation, 1-2, 1-3, 1-5, 1-10, 1-100, or a selection of one option from a plurality of options. Furthermore, the response may be selection or non-selection by the subject.
  • first characteristic category refers to the characteristic category corresponding to the first stimulus selected by the subject (i.e., step b).
  • step a three or four or more stimuli are presented in step a), or four stimuli are presented in step a) wherein each characteristic category corresponds to a different phase in a success/satisfaction cycle.
  • phase phase in a success/satisfaction cycle
  • success/satisfaction cycle are elaborated below.
  • an inquiry is presented to the subject in step a), and the selection received in step b) is in response to the inquiry.
  • the terms "inquiry” and “query” refer to a solicitation for a response, for example, a question presented to the subject. Accordingly, the subject may be asked to respond to the stimuli to indicate a preference or a selection.
  • the requested response may be either "yes” or “no” to a query such as "DOES THIS OBJECT DESCRIBE YOU?”
  • the requested response may be a number between two extremes, for example, 1-2, 1-3, 1-5, 1-10, 1-100.
  • the query may be "ON A SCALE OF 1 TO 10, WHAT IS THE LEVEL AT WHICH THIS OBJECT DESCRIBES YOU?”
  • the query may ask the subject to select an option from a plurality of options.
  • the query maybe "PLEASE SELECT ONE OF THE FOLLOWING TO INDICATE HOW WELL THIS OBJECT DESCRIBES YOU,” and the subject may be presented with two or more options, for example: “STRONGLY AGREE,” “AGREE,” “NEUTRAL,” “DISAGREE,” and “STRONGLY DISAGREE.”
  • OBJECT in this context refers to a presented stimulus.
  • the method includes the following steps: c) presenting to the subject a second set of two or more stimuli corresponding to characteristic categories different from the first characteristic category; and d) receiving a selection from the subject of one of the second set of two or more stimuli corresponding to a second characteristic category.
  • second characteristic category refers to the characteristic category corresponding to the stimulus selected by the subject in step d).
  • the method further includes the following steps: e) presenting to the subject a third set of two or more stimuli corresponding to characteristic categories different from the first and second characteristic categories; and f) receiving a selection by the subject of one of the third set of two or more stimuli corresponding to a third characteristic category.
  • third characteristic category refers to the characteristic category corresponding to the stimulus selected by the subject in step f).
  • the method further includes obtaining an order of selection of the characteristic categories.
  • the characteristic categories are the first, second, and third characteristic categories corresponding to the selections made in steps b), d) and f), in combination with any characteristic categories not selected in steps b), d) or f).
  • order of selection and “stack order” refer to an ordering according to rank and is synonymous with the term “rank order” in the usual statistical sense.
  • rank refers to a preference, for example, without limitation, "most like” through “least like.” Accordingly, an order of selection may indicate a hierarchical relationship of selected characteristic categories of the subject.
  • the method is repeated (i.e., steps a) through f)) with additional sets of stimuli.
  • the additional sets of stimuli may include stimuli not previously presented to the subject.
  • the stimuli are selected for presentation at random from a database of stimuli.
  • random refers to an equal probability of selection among a plurality of possibilities, e.g., equal probability of selection of any possible stimulus from a plurality of stimuli.
  • non-random and “partially random” refer to an unequal probability of selection of any one or more possible selections from a plurality of possible selections.
  • database of stimuli refers to a computer database which contains entries of stimuli comprising graphics, text, audio, video, or the like.
  • the entries in the database of stimuli may be referenced by characteristic category.
  • the stimuli in the database of stimuli are text.
  • the stimuli in the database of stimuli are word-pairs.
  • steps a) to c) include communication with the subject through a network.
  • the network may be the Internet.
  • each stimulus is a word-pair.
  • a further aspect of the invention relates to a method of conducting an assessment of a subject and comprises: a) presenting to the subject two to four stimuli, for example two, three, or four stimuli, and an inquiry, each stimulus corresponding to a phase in a success/satisfaction cycle; b) receiving a selection by the subject of one of the stimuli in response to the inquiry; and c) repeating steps a) and b) until an order of selection of each phase in a success/satisfaction cycle is determined.
  • the terms "phase in a success/satisfaction cycle” and "success/satisfaction cycle” are elaborated below.
  • the method further includes step d), processing the order of selection to determine an assessment of the individual.
  • processing the order of selection refers to providing an assessment based on the hierarchical order of the phases in a success/satisfaction cycle.
  • each stimulus of the method is a word-pair.
  • receiving further includes a response time criterion beyond which a response is not accepted.
  • the response time criterion is in the range 1-45 seconds.
  • receiving further includes recording the time required to respond to each of a plurality of stimuli, and calculating a response time consistency criterion, as described herein, which determines whether a particular response is accepted.
  • a response time consistency criterion is a multiple of the average time required by the subject to respond to a plurality of stimuli.
  • the multiple of the average time is in the range 0.01 to 100 (e.g., 0.1 to 10, 0.1 to 5, and the like).
  • the response time consistency criterion can be a multiple thereof (e.g., I 5 2, 3, 4, 5, 10, 15, 20, 30, 40, 50, 60, 70, 80, 90, 100 sec, or even longer).
  • the invention provides a program product.
  • the program product comprises machine readable program code for causing a machine to perform the following method steps: a) presenting to the subject a first set of two or more stimuli, for example two, three, four or more stimuli, wherein at least two of the stimuli correspond to different characteristic categories; and, b) receiving a selection by the subject of one of the stimuli corresponding to a first characteristic category.
  • the program product further includes machine readable program code for causing a machine to present four stimuli in step a), wherein each different characteristic category corresponds to a different phase in a success/satisfaction cycle, as elaborated below.
  • the program product further includes machine readable program code for causing a machine to present an inquiry to the subject in step a) and receive a selection by the subject in response to the inquiry in step b).
  • the program product further includes machine readable program code for causing a machine to c) present to the subject a second set of two or more stimuli corresponding to characteristic categories different from the first characteristic category; and d) receive a selection from the subject of one of the second set of two or more stimuli corresponding to a second characteristic category.
  • the program product further includes machine readable program code for causing a machine to e) present to the subject a third set of two or more stimuli corresponding to characteristic categories different from the first and second characteristic categories; and f) receive a selection by the subject of one of the third set of two or more stimuli corresponding to a third characteristic category.
  • the program product further includes machine readable program code for causing a machine to obtain an order of selection of the characteristic categories.
  • the program product further includes machine readable program code for causing a machine to repeat steps a) through f) with additional sets of stimuli.
  • steps a) to b) further include communication with the subject through a network.
  • this network is the Internet.
  • each stimulus of the program product includes a word-pair.
  • any embodiment can further include machine readable program code for causing a machine to calculate and use a response time criterion or response time consistency criterion, as described herein.
  • the invention provides a program product comprising machine readable program code for causing a machine to perform the following method steps: a) presenting to the subject two to four stimuli, for example two, three, or four stimuli, and an inquiry, each stimulus corresponding to a phase in a success/satisfaction cycle; b) receiving a selection by the subject of one of the stimuli in response to the inquiry; and c) repeating steps a) and b) until an order of selection of each phase in a success/satisfaction cycle is determined.
  • the program product includes machine readable program code for causing a machine to perform the following method step: d) processing the order of selection to determine an assessment of the subject.
  • each stimulus of the program product includes a word-pair.
  • any embodiment can further include machine readable program code for causing a machine to calculate and use a response time criterion or response time consistency criterion, as described herein.
  • a system for conducting an assessment of a subject, which system comprises a server adapted to present two or more stimuli to the subject on a computer, each stimulus corresponding to a different characteristic category, wherein the server is further adapted to receive a selection by the subject of one of the stimuli.
  • a "server” may include a computer or a computing device provided with software to allow the computer or computing device to communicate with another computer or computing device in a server-client relationship as understood by one of skill in the art.
  • each stimulus includes a word-pair.
  • a computer-implemented method of evaluating an assessment of a subject comprises: a) presenting to a subject at least one stimulus, for example one, two, three, four, or more stimuli, wherein at least one stimulus is selected in real time and corresponds to a characteristic category; and b) evaluating an assessment of the subject based on a response received from the subject to each stimulus presented.
  • the term "evaluating an assessment” refers to assigning numeric value scores to the characteristic categories of an assessment.
  • the numeric value scores may be the sum of weighted stimulus scores corresponding to particular stimuli.
  • weighted stimulus score refers to a number in the range 1-100, for example without limitation, 1 , 2, 3, 4, 5, 6, 7, 8, 9, 10, 20, 30, 40 , 50, 100, associated with each stimulus.
  • the weighted stimulus score may be associated with a stimulus in a database of stimuli by methods commonly known in the art. Specific examples of weighted stimulus scores associated with particular stimuli are provided herein, for example, Figure 6.
  • response received from the subject refers to a selection of one or more of the stimuli presented in step a).
  • the subject has a time limit (i.e., response time criterion) within which to respond, after which the response is not accepted.
  • a response time criterion is in the range 1-45 seconds.
  • receiving includes recording the time taken by the subject to respond to each of a plurality of stimuli, and using a response time consistency criterion calculated from a statistical analysis of the elapsed time so recorded. "If a response is not received within the response time consistency criterion, then the response is discarded. Optionally, the subject may be presented an additional stimulus.
  • a response time consistency criterion is a multiple of the average time required by the subject to respond to a plurality of stimuli, as described herein. In some embodiments, the multiple is in the range 0.1 to 10.
  • step a) further includes randomly selecting at least one stimulus from a database of stimuli.
  • selecting refers to choosing, picking or singling out one or more stimuli from a list, table or database, for example. In other preferred embodiments, each stimulus is a word-pair.
  • step a) further includes formulating an entire assessment by presenting a plurality of stimuli to a subject.
  • the term "formulating” refers to selection of an entire set of stimuli to be presented to the subject for an assessment.
  • the plurality of stimuli may include at least one stimulus corresponding to each of a plurality of different characteristic categories.
  • the method further includes: c) determining whether the assessment evaluated in step b) requires refinement between two or more characteristic categories.
  • refinement refers to a discrimination process required in borderline instances.
  • borderline refers to the case wherein the difference in the numeric value scores of two categories is not greater than a required minimum.
  • the terms “required minimum” and “refinement criterion” refer to a number, for example, 1 , 2, 3, 4, 5, or greater. For example, if the numeric value scores of two characteristic categories were less than 3, and the required minimum were 4, refinement would be necessary.
  • the method includes the following step: d) presenting an additional stimulus corresponding to each of the two or more characteristic categories. Other embodiments include: e) repeating steps b) through d) until a desired level of refinement is achieved.
  • the term “desired level of refinement” refers to the required minimum in the difference in the numeric value scores of two categories of the assessment, as elaborated above.
  • the method further includes the following steps: d) presenting to the subject two or more stimuli, wherein each stimulus corresponds to a different characteristic category; e) receiving a selection by the subject of one of the stimuli; and f) repeating steps d) and e) to obtain an order of selection of each different characteristic categories.
  • the method further includes: g) repeating steps c) to f) until a desired level of refinement is achieved.
  • the invention provides a program product.
  • the program product comprises machine readable program code for causing a machine to perform the following method steps: a) presenting, when an assessment of a subject requires refinement between two or more characteristic categories of the assessment, to a subject a first set of three or more stimuli, wherein each stimulus in the first set of three or more stimuli corresponds to a different characteristic category; b) receiving a selection by the subject of one of the stimuli; c) presenting to the subject a second set of two or more stimuli, wherein each stimulus of the second set of two or more stimuli corresponds to a different characteristic category; and d) repeating steps b) and c) to obtain an order of selection of each of the different characteristic categories.
  • any embodiment can further include machine readable program code for causing a machine to calculate and use a response time criterion or response time consistency criterion, as described herein.
  • the invention provides a method of conducting an assessment of a team comprised of members, comprising the following steps: a) providing the process maps of the members of the team; b) overlaying the process maps of the members of the team; and c) assessing the team by providing a process map comprising the overlaid process maps of the members of the team.
  • process map and “overlaying” are elaborated below.
  • the term “team” refers to a plurality of individuals (i.e., "members” or “constituents") with common goals (i.e., "missions") and tasks by which the goals are achieved.
  • a team depends on the success of the individual constituents thereof.
  • the team further includes a manager (e.g., coach or representative of the entity employing the team member(s).)
  • a team can include as few as two members.
  • a team of two members includes an individual and a coach.
  • the method further includes constructing a process map of a virtual member of the team (i.e., "virtual team member”) wherein the method comprises the following steps: d) identifying deficiencies or excesses in each characteristic category of the team assessment; and e) constructing a process map of the virtual member of the team by ascribing to each characteristic category of the process map of the virtual member of the team a value which compensates for the deficiencies or excesses of the overlaid process maps of the members of the team.
  • the terms "deficiency” and “excess” in the context of team assessment refer to a difference in the numeric value score of a particular characteristic category with respect to the corresponding value of an ideal team member.
  • ideal team member refers to a hypothetical team member having numeric value scores associated with each characteristic category that compensate for the deficiencies and excesses of the corresponding characteristic categories of the assessment of the team.
  • an ideal team member does not necessarily dominate in all or even any characteristic category of the team process map.
  • a "deficiency" in a team member could refer to a predominate phase if that dominance distracts from the overall performance of the team.
  • An ideal process map i.e., the process map of a hypothetical team member with the optimal energy levels at each phase of the team process
  • the terms "virtual member of the team” and “virtual team member” refer to a hypothetical team member having an ideal process map.
  • the virtual team member has a process map which fulfills a specific role or relationship within the team.
  • the method further includes a method for identifying candidate team members comprising the following steps: f) comparing the process map of a virtual team member with a plurality of stored assessment data obtained for candidate team members; g) identifying a match between the virtual team member process map and the stored assessment data; and h) identifying the candidate team members associated with the stored assessment data.
  • candidate team member refers to an individual or even another team which may be joined with the team for which the team assessment was conducted.
  • stored assessment data refers to entries in a database comprising assessments.
  • the method of comparison of step f) may be conducted in a variety of manners known to those of skill in the art.
  • the absolute values of the numerical difference between the numeric value scores of the ideal process map and the process maps of candidate team members can be summed to provide a composite comparison.
  • the differences are squared prior to summation.
  • identifying a match refers to the identification within the stored assessment data of a process map of a candidate team member, or a set of candidate team members, which is similar or identical to the process map of the virtual team member.
  • identifying the candidate team member refers to the database management step of providing the identification of the candidate team member by methods well known in the art.
  • the invention provides a system for conducting an assessment of a subject, which system comprises a server adapted to present to a subject at least one stimulus and to receive a response by the subject to each stimulus presented, wherein the at least one stimulus is selected in real time and corresponds to a characteristic category; and wherein the server is further adapted to determine an assessment of the subject based on the responses.
  • the server is further adapted to determine whether the assessment requires refinement between two or more characteristic categories, wherein the server is further adapted to present, when refinement is required, an additional stimulus corresponding to each of two or more characteristic categories.
  • the invention provides a method for improving the performance (i.e., "coaching") of current or potential team members in the furtherance of the team mission.
  • coaching is conducted by a "coach” who is an individual responsible for training individual clients.
  • client refers to an individual receiving coaching.
  • the method provides for the following steps: a) evaluating a client current process map to provide a client evaluation; and b) reciting the client evaluation to the client.
  • client current process map refers to a process map of the client determined by methods of the invention, and which assessment is currently valid, i.e., represents the client now.
  • a client current process map can be obtained contemporaneously with the coaching, or can be the result of a previous assessment of the client.
  • the previous assessment of the client can have occurred, for example without limitation, 1-day, 1-week, 1 -month, 2-months, 3 -months, 6-months, or even longer, prior to the coaching.
  • client evaluation refers to the level of energy the client has, or can bring to bear, to the phases of a success/satisfaction cycle as elaborated below, and can include a narrative description of the client in view of the client current process map.
  • the invention further includes comparing the client current process map and a coach process map in order to provide a coach/client evaluation to determine for example how the client and coach would naturally prefer to work together.
  • the term "coach process map” refers to a process map, as provided by the invention, resulting from an assessment of the coach.
  • the term "coach/client evaluation” refers to the differences in the level of energy between the client and coach in the phases of a success/satisfaction cycle as elaborated below, and can include a narrative description of the client and coach comprising the strengths and weaknesses thereof, as measured by differences in the energy levels within the categories of the client current and coach process maps.
  • the coach/client evaluation may contain a narrative description of changes in the behavior of the client and the coach to improve the coach/client relationship. Additionally, the coach/client evaluation may contain a learning report, described below, of the client and a teaching report, described below, for the coach. In other embodiments, the coach/client evaluation is recited to the client by the coach. In yet other embodiments, the method provides an explicit list of changes in behavior which the client and coach can make to improve their ongoing working relationship.
  • the method further includes reciting to the client the learning report of the client and the teaching report of the coach.
  • learning report of the client refers to a written narrative describing the learning style of the client which is the manner in which the client would most naturally prefer to learn, as determined in view of the client current process map.
  • the learning report of the client can include a written description of changes in the behavior of the client to achieve more efficient task completion.
  • the suggested changes in the behavior of the client are written from the perspective of the coach; i.e., the suggestions provide the coach with specific tasks and goals to give the client.
  • the term "teaching report of the coach” refers to a written narrative describing the teaching style of the coach which is the manner in which the coach would most naturally prefer to teach (i.e., coach,) as determined in view of the coach process map. Additionally, the teaching report of the coach can include a written description of changes in the behavior of the coach to achieve more efficient task completion by the client. In other embodiments, the method further includes reciting to the client changes in the learning style of the client or changes in the teaching style of the coach to achieve more efficient task completion by the client. For example without limitation, if the client current process map indicated a predominant level in the analyze phase, the coach might advise the client to reduce the level of analysis activity in order to devote more focused energy, as defined below, to other phases.
  • the method further includes comparing the client current process map and a client aspiration map to provide an ideal client evaluation.
  • client aspiration map refers to a process map describing what dynamic strengths (i.e., energy levels within the phases of a success/satisfaction cycle) a client ideally desires.
  • the client aspiration map can be created by the methods of the invention for assessment, further including an inquiry directed to the client's desires. Accordingly, the subject may be asked to respond to the stimuli to indicate a preference or a selection.
  • the requested response may be either "yes” or “no” to a query such as "DOES THIS OBJECT DESCRIBE WHAT YOU WOULD IDEALLY LIKE TO BE?"
  • the requested response may be a number between two extremes, for example, 1-2, 1-3, 1-5, 1-10, 1- 100.
  • the query may be "ON A SCALE OF 1 TO 10, WHAT IS THE LEVEL AT WHICH THIS OBJECT DESCRIBES WHAT YOU WOULD IDEALLY LIKE TO BE?"
  • the query may ask the subject to select an option from a plurality of options.
  • the query may be "PLEASE SELECT ONE OF THE FOLLOWING TO INDICATE HOW WELL THIS OBJECT DESCRIBES WHAT YOU WOULD IDEALLY LIKE TO BE,” and the subject may be presented with two or more options, for example: “STRONGLY AGREE,” “AGREE,” “NEUTRAL,” “DISAGREE 5 “ and “STRONGLY DISAGREE.”
  • OBJECT in this context refers to a presented stimulus.
  • ideal client evaluation refers to the level of energy the client desires to bring to bear to the phases of a success/satisfaction cycle as elaborated below, and can include a narrative description of the client in view of the client aspiration map.
  • the ideal client evaluation is recited to the client by the coach.
  • the method further includes reciting to the client changes in the behavior of the client to minimize the difference between the client current process map and the client aspiration map.
  • the method further includes comparing the client current process map and a colleague process map to provide a colleague/client evaluation to determine how the client and the colleague prefer to work as a team.
  • the term “colleague process map” refers to a process map, as provided by the invention, resulting from an assessment of the colleague.
  • the term “colleague/client evaluation” refers to the differences in the level of energy between the colleague and client in the phases of a success/satisfaction cycle as elaborated below, and can include a narrative description of the colleague and client including the strengths and weaknesses thereof, as measured by differences in the energy levels within the categories of the client current process map and colleague process map.
  • the colleague/client evaluation is recited to the client by the coach.
  • the coach recites to the client changes in the behavior of the client and the colleague to increase success and satisfaction in the fulfillment of a task by the client or colleague.
  • the method further includes comparing the client current process map with a task/project process map in order to provide a task/client evaluation.
  • task/project refers to a task undertaken by a client as part of a project assigned to the client.
  • task/project process map refers to a process map of an idealized client, which idealized client would be ideally suited to the performance of a specified task as part of a specific project.
  • the requirements of a task/project for a sales manager could include preferred motivate and activate energy levels and lower energy levels (e.g., select energy levels) in the analyze and strategize categories. Such a combination of energy levels would allow the idealized client to perform the duties of sales manager without wasting time.
  • task/client evaluation refers to the differences in the level of energy between the client and task/project in the phases of a success/satisfaction cycle as elaborated below, and can include a narrative description of the client and task/project comprising the strengths and weaknesses thereof, as measured by differences in the energy levels within the categories of the process maps.
  • the task/project process map is constructed by arithmetically averaging the individual corresponding numerical components (i.e., numeric value scores) of the phases of process maps of a plurality of real individuals who well perform the task.
  • the term "well perform” refers to successful accomplishment of the subject task by the idealized client or plurality of real individuals with respect to any of a plurality of criteria of importance to management, including, for example without limitation, minimized time expenditure, minimized resource expenditure, maximized profit, and other criteria important to management and well known in the art.
  • the invention provides a method for constructing a task/project process map wherein an individual well skilled in the subject task creates the task/project process map based on personal experience.
  • the individual well skilled in the subject task may determine that a specific task requires high motivate and analyze energies, and lower activate and strategize energies.
  • the numeric value scores assigned to each phase of the task/project process map by the individual well skilled in the subject task is subject to a compensating correction (e.g.,
  • an individual well skilled in the subject task may have a very high energy (i.e., predominant) in a particular phase, e.g., analytic.
  • the analytic energy level of the idealized process map created by the individual well skilled in the subject task may require compensation downward (e.g., by 1 , 2, 3, or 4 points) in order to compensate for the inherent energy level of the individual well skilled in the subject task.
  • a plurality of individuals well skilled in the subject task each create an idealized process map, and the individual corresponding numerical components of the phases of the resulting process maps are arithmetically averaged to create the task/project process map.
  • management may decide to compensate the individual energy levels within the task/project process map constructed by the method by a compensation factor (e.g., 1,
  • the method further includes reciting the task/client evaluation to the client by the coach. In other embodiments, the method further includes reciting to the client changes to the behavior of the client to minimize the difference in energy levels between the client current process map and the task/project process map.
  • the method further includes reciting to the client the working preferences of the client.
  • working preferences of the client refers to how the client most naturally prefers to get things done.
  • the classes of information provided thereby may include, without limitation, the ideal work environment of the client, the interaction skills of the client, client's ability to take direction and stay orientated to the task at hand, client's leadership abilities, client's decision making and risk taking preferences, and client's persuasive and sales ability.
  • the coach and client in view of the client's working preferences, set mutual expectations and goals, and predict and improve performance.
  • the method further includes reciting to the client the learning preferences of the client.
  • learning preferences of the client refers to how the client most naturally prefers to learn.
  • the classes of information provided thereby may include, without limitation, the ideal learning environment of the client, and the interaction skills of the client with a manager, teacher, or coach provided training.
  • the method further includes visualizing how the client prefers to spend time on any task or role.
  • this visualization is used by the coach and client to set mutual expectations, and predict and improve performance.
  • the method further includes visualization of how the client prefers to spend focused energy on a task.
  • focused energy is elaborated below.
  • this visualization is used by the coach and client to set mutual expectations, and predict and improve performance.
  • the method further includes incorporating the client evaluation and the coach/client evaluation within an archive database.
  • archive database refers to a computer data structure adapted to hold subject information (e.g., name, address, job position, and the like,) task information, assessments, process maps, evaluations, editing feedback, annotated responses, and comments by the client and coach. Separate entries in the database, i.e., client archive and coach archive, are maintained for client and coach, respectively.
  • the client archive is adapted so that the client cannot change an entry without permission of the coach or the employer of the client (i.e., management.)
  • the archive database is configured and maintained by methods well known in the art.
  • the method further includes annotating responses of the coach and the client within an archive database.
  • annotating refers to providing written text for inclusion in the archive database to accompany a response.
  • the method further includes receiving editing feedback by the client prior to entry of such feedback into the archive database.
  • editing feedback by the client refers to editing entries provided by the client.
  • the editing entries may include comments by the client which are incorporated into the client evaluation and stored in the archive database.
  • the editing entries further may include a choice by the client regarding which elements of the client evaluation and client learning report that the client feels most correctly describe the client.
  • the client may be presented with a plurality of elements of a client evaluation and given the opportunity to classify (i.e., mark) each element with a designation, for example without limitation, a) very much like me most of the time, b) somewhat like me some of the time, and c) not like me at all.
  • Client evaluation elements marked as "a)" or b)" are retained in the client evaluation, and the client evaluation is re-written and stored in the client archive. All of the elements, irrespective of how marked by the client, are retained in the coach archive.
  • the designations a), b) and c) can be replaced by a color code, for example green, yellow, and red, respectively.
  • the client may be presented with a plurality of elements of a client learning report and given the opportunity to classify each element with the following designations: a) very much like me most of the time, b) somewhat like me some of the time, and c) not like me at all.
  • client learning report elements marked as "a)" are retained in the client evaluation, and the client evaluation is re-written and stored in the client archive. All of the elements of the learning report, irrespective of how marked by the client, are retained in the coach archive.
  • the designations a), b) and c) can be replaced by a color code, for example green, yellow, and red, respectively.
  • the method further includes reviewing the archive database by the coach and the client in order to identify success and failure in a coach- client relationship.
  • the term "success and failure in a coach-client relationship" refers to how well the coach and client work together (i.e., whether stress or anxiety are present in either coach or client,) how well the client responds to the teaching style of the coach (e.g., as measured by changes in the behavior of the client,) how well the coach responds to interaction with the client (e.g., as measured by changes in the teaching style of the coach in response to the client,) and how well the client ultimately performs the task forming the basis of the coaching.
  • the method further includes repeating steps a) and b) and comparing the client evaluation so obtained with a client evaluation within the archive database to provide an updated client evaluation.
  • updated client evaluation refers to a description of changes in the client evaluation. An updated client evaluation is useful for comparing possible changes in the client current process map over time, or to determine how a client performs in a different task at a later time, for example.
  • the invention provides a program product comprising machine readable program code for causing a machine to evaluate a client current process map to provide a client evaluation.
  • the program product further includes machine readable program code for causing a machine to compare the client current process map and a coach process map to provide a coach/client evaluation.
  • the program product further includes machine readable program code for causing a machine to compare the client current process map and a client aspiration map to provide an ideal client evaluation.
  • the program product further includes machine readable program code for causing a machine to compare a client current process map and a colleague process map to provide a colleague/client evaluation.
  • the program product further includes machine readable program code for causing a machine to compare a client current process map and a task/project process map to provide a task/client evaluation.
  • a system for conducting an assessment of a subject comprises a server adapted to present to a subject at least one stimulus and to receive a response by said subject to each said stimulus presented.
  • the at least one stimulus is selected in real time and corresponds to a characteristic category.
  • the server is further adapted to determine an assessment of said subject based on said responses.
  • the assessment is determined based at least partly on elapsed time for said responses.
  • the assessment is determined based on comparison of elapsed time for each response to a mean elapsed time for all responses from the subject.
  • the server is adapted to assign a value to each response based on the elapsed time for that response.
  • the value may be determined by applying a multiplier to a base value, the multiplier being dependent on the elapsed time.
  • the server may be adapted to perform a statistical analysis on the values of the responses to determine the assessment.
  • the server is adapted to perform a statistical analysis on the elapsed times of the responses to determine the assessment.
  • the system further comprises a database of narratives corresponding to one or more assessments.
  • the server is adapted to output a narrative from the database corresponding to the assessment determined.
  • the invention includes a method of conducting an assessment of a subject.
  • the method comprises: a) presenting to a subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category; c)repeating steps a) and b) as necessary with additional sets of stimuli; and d) outputting an assessment of the subject based on said responses.
  • the assessment is determined based at least partly on elapsed time for said responses.
  • a program product comprises machine readable program code for causing a machine to perform the following method steps: a) presenting to a subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category; c) repeating steps a) and b) as necessary with additional sets of stimuli; and d) outputting an assessment of the subject based on said responses. The assessment is determined based at least partly on elapsed time for said responses.
  • a system for conducting a relationship assessment of two or more subjects comprises a server adapted to present to each subject at least one stimulus and to receive a response by each subject to each stimulus presented, wherein the at least one stimulus is selected in real time and corresponds to a characteristic category.
  • the server is further adapted to determine a characteristic category assessment of each subject based on the responses for one or more characteristic categories.
  • the system further comprises a database of dyads, each dyad based on a characteristic category assessment of each subject and corresponding to a relationship assessment of a relationship between the subjects.
  • the database of dyads includes narratives corresponding to one or more relationship assessments.
  • the server is adapted to output a narrative from the database corresponding to the relationship assessment.
  • each dyad includes a characteristic category assessment for at least one of the following characteristic categories: strategize, motivate, anal yze and activate.
  • a method of conducting a relationship assessment of two or more subjects comprises: a) presenting to a subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category; c) repeating steps a) and b) as necessary with additional sets of stimuli; d)determining a characteristic category assessment of the subject based on said responses for one or more characteristic categories; e) repeating steps a)-d) for each remaining subject; and f) outputting a relationship assessment of a relationship between the subjects based on the characteristic category assessments determined for each subject.
  • a program product comprises machine readable program code for causing a machine to perform the following method steps:a) presenting to a subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category; c) repeating steps a) and b) as necessary with additional sets of stimuli; d) determining a characteristic category assessment of the subject based on said responses for one or more characteristic categories; e) repeating steps a)-d) for each remaining subject; and f) outputting a relationship assessment of a relationship between the subjects based on the characteristic category assessments determined for each subject.
  • FIG. 1 is a diagrammatic representation of a conventional Gestalt cycle of experience.
  • Figure 2 is a diagrammatic representation of a success/satisfaction cycle derived from the Gestalt cycle of experience.
  • Figure 3 is a table of exemplary word-pairs in four phases of the success/satisfaction cycle.
  • Figure 4 is a flow chart illustrating a method for assessing a subject according to an embodiment of the invention.
  • Figures 5A, 5B 5 and 5C are screen shots illustrating an exemplary assessment process.
  • Figure 6 is a table of exemplary word-pairs in four categories for use as stimuli in an assessment.
  • Figure 7 is a flow chart illustrating a method for assessing a subject according to an embodiment of the invention.
  • Figure 8 is a flow chart illustrating one embodiment of a method for refinement between categories.
  • Figure 9 is a flow chart illustrating another embodiment of a method for refinement between categories.
  • Figure 10 is a schematic illustration of a front end of a system according to an embodiment of the invention.
  • Figure 11 is a schematic illustration of a back end of a system according to an embodiment of the invention.
  • Figure 12 illustrates an exemplary dyad database according to embodiments of the present invention.
  • the present invention provides assessment systems, methods and program products that are based on a combination of the Method of Paired Comparisons and Task Completion from a Gestalt framework. Forced choice comparisons may be administered to a user either physically or electronically through software, for example, Flash, PHP, and other interactive software designed by products well known in the art.
  • the assessments may be applied to individuals, groups of individuals, or to idealized individuals or teams to create a template for subsequent screening of individuals.
  • the Method of Paired Comparisons is based on Thurstone's Law of Comparative Judgment.
  • a stimulus such as a word- pair or a picture
  • the distal stimuli are patterned on the retina, then transferred into electrical signals and delivered to the brain.
  • the brain sets up mental representations bio-chemically using separate groups of neurons, one group for each stimulus. These events are massively parallel and can involve tens of thousands of neurons along with the electrochemical interactions between them.
  • a neurological mechanism triggers two mental representations — one for each of the stimuli.
  • the representation that the individual most prefers will create the highest neurological signal strength, causing that pair to be selected.
  • the stimuli are word-pairs to be selected by the subject.
  • the words used in the word-pairs are derived from descriptive words attributed to specific phases found in the success/satisfaction cycle derived from the Gestalt Framework and in the descriptors of significant brain processes.
  • the term "success/satisfaction cycle" refers to a process by which a subject completes or processes a task, for example.
  • the success/satisfaction cycle may include a plurality of phases through which a task is processed by the subject. The processing may be in sequential order or may be in parallel.
  • the success/satisfaction cycle assesses a subject's experience through five phases of the success/satisfaction cycle: strategize, motivate, analyze, activate, and assess.
  • phase refers Io a discrete component of the success/satisfaction cycle, as illustrated for example in Figure 2.
  • phase in a success/satisfaction cycle refers to a discrete component of the success/satisfaction cycle, as illustrated for example in Figure 2.
  • dynamic is used synonymously with the term "phase” in referring to the success/satisfaction cycle.
  • the cycle is envisaged as a linear sequence of dynamics in the order explore, excite, examine, and execute, wherein the execute and explore dynamics are connected by the "evaluate" dynamic.
  • the names of the phases of the success/satisfaction cycle are alternatively named within the art. Such alternative names can describe a characteristic category of the phase.
  • the strategize phase may also be known as the "synthesize” or “explore” phase or dynamic; the motivate phase may also be known as the “interactive” or “excite” phase or dynamic; the analyze phase may also be known as the “analytical,” “articulate,” or “examine” phase or dynamic; the activate phase may also be known as the “conclude” or “execute” phase or dynamic, and the assess phase may also be known as the "evaluate” phase or dynamic.
  • the phases can be referred to by reference to one who performs the function of the phase.
  • the strategize phase can be referenced by the terms “strategizer,” “synthesizer,” “ articulator,” or “explorer;” the motivate phase can be referenced by the terms “motivator,” “interactor,” or “excitor;” the analyze phase can be referenced by the terms “analyzer” or “examiner;” and the activate phase can be referenced by the term “concluder.”
  • Each assess (e.g., evaluate) phase of the success/satisfaction cycle has two parts to it: success and satisfaction.
  • the process of measurement within this phase is different for each individual or group and may be based on many factors (e.g., cultural, educational, timelines for completion, past experiences with this specific process, etc.). Some subjects may place more emphasis on the external process measurements of success and others on the internal measurement of satisfaction, for example.
  • Each phase has a characteristic level of energy, focus or time associated with it for each subject. In some embodiments, the characteristic level of energy is represented by a numeric value score. These levels vary from subject to subject, but are generally robust for the same subject.
  • the levels of energy are divided into four categories in descending order and exemplarily named, without limitation, energy: predominant, preferred, select and stress/avoid.
  • a phase categorized as "predominant” dominates the subject's process. Most time and energy is spent in this phase, while other phases of the cycle are given little credence or are ignored, and moving the subject to other phases of the cycle can be difficult and sometimes stressful for associates or colleagues.
  • a phase that is categorized as "preferred” is used often, naturally and most comfortably. This phase operates at the lowest stress, both for the subject and for those around the subject.
  • a phase categorized as "select” can be consciously engaged by the individual to adapt to a particular task or relationship. The subject can spend long periods of time in this phase of select intensity and not become stressed. Extended time spent in a phase categorized as "stress/avoid” can cause stress to the subject and usually is avoided by the subject when possible. This phase can be engaged for limited periods of time, but will lead to stress effects and exhaustion.
  • each characteristic energy level is a preference for the amount of time which a subject would naturally prefer to spend on a task or project.
  • focused energy refers to the level of energy which a subject would naturally prefer to spend on a task or project.
  • the extreme, effortless, deliberate, and stress energy levels may be associated, without limitation, with the terms “prolonged,” “appropriate,” “short,” and “too much/too little,” respectively.
  • process profile refers to the data forming an assessment, i.e., to the natural levels of energy, as described herein, which a subject can bring to bear on the accomplishment of a task.
  • a process map is a description of the energy, focus, or time which is associated in a subject with each phase of the Gestalt success/satisfaction cycle as illustrated in Figure 2.
  • the term "ideal process profile,” “ideal process style,” and “ideal process map” refer to an idealized process profile as described herein.
  • a team facilitator helps accomplish team goals as needed, is a teacher and builder of consensus within the team, is a problem solver and conflict-resolver, and is an expert in the means by which the team accomplishes its goal.
  • the facilitator looks at the group, perceives problems, and identifies routes by which problems can be circumvented.
  • the scribe records the minutes of team meetings, reconstructs the meeting in written form, submits the written minutes for review, and distributes the minutes.
  • the liaison serves as the point of contact with other entities, for example, without limitation, other teams, management, and entities external to the organization of which the team is part.
  • the energizer fulfills the role of liaison, and provides additional motivation and positive energy focus for the team and its members.
  • a diverse, high respect team wherein “diverse” refers to the breadth of ability of the team taken as a whole, and “high respect” is a subjective designation assigned to the team by external entities including, without limitation, other teams, management, and entities external to the organization of which the subject team is a member, is well described by the overlay of the process maps of the individual constituents of the team.
  • the assessments provided by the instant invention for individual team constituents are viewed as a process map, exemplified, for example, by Figure 2. Accordingly, the overlay of the individual process maps (i.e., the "team process map") of the constituents of the team represents the process map of the team taken as a whole, i.e., the "team assessment”.
  • Figure 3 illustrates a table 300 of exemplary sets of word-pairs for use with embodiments of the present invention.
  • the table 300 comprises six sets of word- pairs, but additional sets may also be provided, for example Figure 6.
  • the set When a set is presented to the subject, the set may be selected according to a predetermined order or randomly from the available sets.
  • each set includes a word- pair for each of the four phases in the success/satisfaction cycle.
  • additional categories or phases may be included and be provided with a word-pair for each set.
  • FIG 4 is a flow chart illustrating an exemplary assessment method according to certain embodiments of the invention.
  • the method 400 begins with the presentation of a set of stimuli to the subject (block 410).
  • the presentation may be physical, electronic or verbal.
  • the stimuli may include photographs, diagrams, sketches or other vehicles.
  • the stimuli are word-pairs.
  • the set of stimuli includes two or more stimuli for selection by the subject. In the exemplary embodiment described below with reference to Figures 3 and 5A, each set includes four word-pairs.
  • a query is presented to the subject.
  • the presentation may be physical, electronic or verbal.
  • the presentation of the query and the presentation of the set of stimuli may be simultaneous or reversed in order.
  • the query is designed to elicit a selection by the subject of one stimulus from the set of stimuli (block 430).
  • the method 400 proceeds to block 460, and a stack order is determined for the subject.
  • a stack order is indicative of the assessment of the subject.
  • the method 400 then terminates at block 470.
  • the stack order is indicative of the relative ordering of the various categories or phases of the success/satisfaction cycle.
  • the stack order may be a direct mapping of the word-pair selections.
  • a scoring method may be used to determine an overall stack order.
  • Figures 5A-5C are screen shots that may be presented to the subject on, for example, the user device 510 of Figure 5 by the web server 520.
  • Figure 5A includes the initial presentation of a set of stimuli including four word-pairs, each corresponding to a category or phase of the success/satisfaction cycle.
  • the illustrated set of stimuli corresponds to Set number 6 in the table 300 of Figure 3.
  • a query asks the subject to select the word-pair which most accurately describes the subject.
  • the screen is updated to the screen shot illustrated in Figure 5B.
  • the user has selected the word-pair "Punctual, objective", which corresponds to the analytical phase.
  • the analytical phase is placed at the top of the stack order.
  • the subject is then presented with the remaining stimuli in the set, along with a query asking the subject to select, from the remaining stimuli, the word-pair which is least accurately describes the subject.
  • the screen is updated to the screen shot illustrated in Figure 5C.
  • the user has selected the word-pair "Conceptual, aware-of-feeling", which corresponds to the strategize phase.
  • the strategize phase is placed at the bottom of the stack order.
  • the subject is presented with the remaining two word-pairs and a query to complete the stack order, as illustrated in Figure 5C.
  • the query asks the subject to select the word-pair which more accurately describes the subject.
  • the phase corresponding to the word-pair selected by the subject is placed second on the stack order, with the category or phase corresponding to the non-selected word-pair being placed third.
  • Figure 5A-5C The exemplary assessment illustrated in Figure 5A-5C is achieved with a single set of stimuli and a mere three clicks or selections by the subject. Thus, an assessment can be obtained in a rapid manner. For additional confidence in the assessment, the process of Figures 5A-5C may be repeated with additional sets of stimuli, each set requiring only three additional clicks by the subject.
  • Figure 6 illustrates another exemplary table of stimuli to be presented to a subject as part of an assessment.
  • each stimulus is a word-pair corresponding to a characteristic category.
  • the embodiment illustrated in Figure 6 includes four characteristic categories. In other embodiments, more or fewer categories may be used.
  • Each category refers to a characteristic, a phase or other feature of a subject or an assessment, and each characteristic category may correspond to a characteristic or feature associated with an emotional, physical, biological and/or intelligence characteristic, for example.
  • each characteristic category corresponds to a phase of the success/satisfaction cycle of Figure 2.
  • the method 700 begins with the selection of a stimulus in real time.
  • the stimulus may be selected from a list, a table or a database, for example.
  • the selection of the stimulus may be completely or partially random.
  • a selection may be completely random by selecting any word-pair in any of the four categories, or may be partially random by selecting a word-pair from a selected category, such as the "SYNTHESIZER" category.
  • the selection of the stimulus may be guided by information relating to the subject and/or the client with which the subject is associated. Such information may be obtained from the user database 1040 of Figure 10. For example, the information obtained from the user database 1040 may indicate that the subject has already been assessed and may include the specific stimuli presented to the subject. Accordingly, the selection of the stimuli at block 710 of Figure 7 may be guided to avoid the stimuli already presented to the present subject.
  • the stimulus may be any device, such as photos, images, graphics, sketches or the like, selected to elicit a response from the subject.
  • each stimulus is a word-pair, such as the word-pairs illustrated in Figure 6.
  • the selection of the stimulus in real time is facilitated by implementing the assessment as a computer-based method.
  • the selected stimulus is presented to the subject.
  • the stimulus may be presented by displaying the stimulus as graphics, text, audio, video, or the like.
  • the display may include the use of a computer or other electronic device by the subject, such as a standalone or a networked computer.
  • the communication resulting in display is conducted through a communication network, such as the Internet.
  • the subject may be asked to respond to the stimulus to indicate a preference or a selection.
  • the required response may be either a "yes” or a "no” to a query such as "DOES THIS WORD-PAIR DESCRIBE YOU?”
  • the response may be a number between two extremes, for example, 0- 100, 0-10, 1-10, 1-5.
  • the query may be "ON A SCALE OF 1 TO 10, THE LEVEL AT WHICH THIS WORD-PAIR DESCRIBES YOU?”
  • the query may ask the subject to select an option from a choice of options.
  • the query may be "PLEASE SELECT ONE OF THE FOLLOWING TO INDICATE HOW WELL THIS WORD-PAIR DESCRIBES YOU,” and the subject may be presented with the following options: “STRONGLY AGREE,” “AGREE,” “NEUTRAL,” “DISAGREE,” and “STRONGLY DISAGREE.”
  • the response from the subject is received.
  • a signal or an input may be acquired from the subject.
  • the assessment may require a minimum number of stimuli to be presented for each characteristic category, for example. In this regard, if a sufficient number of stimuli has not been presented, the method 700 returns to block 710 to select another stimulus to be presented. In certain embodiments, as illustrated by block 750, a characteristic category for the next stimulus may be selected to facilitate a complete assessment. [0098] Alternatively, if the determination is made at block 740 that no more stimuli are required for the assessment, the method 700 proceeds to block 760, and an assessment of the subject is determined. In this regard, responses of the subject to the stimuli presented may be evaluated.
  • a scoring method may be used to determine an overall stack order for the subject. For example, each "STRONGLY AGREE" response may be assigned five points, an "AGREE” response assigned four points, etc.
  • the numeric value score for each characteristic category may determine the position of that category in the stack order.
  • a stack order is indicative of the assessment of the subject. In the exemplary embodiment described above, the stack order is indicative of the relative ordering of the various categories or phases of the success/satisfaction cycle.
  • a determination may be made as to whether a refinement of the stack order is required with respect to two or more characteristic categories.
  • the assessment may require a minimum difference (i.e., refinement criterion) in the numeric value scores to distinguish between two categories and, if the numeric value scores of two categories differ by less than that required minimum, a refinement may be required to accurately determine their respective positions in the stack order.
  • the numeric value score for each characteristic category is calculated by assigning a weight to each stimulus (e.g., word-pair of Figure 6,) accumulating the weights as the assessment is conducted, and finally presenting the accumulated weights as the numeric value score for each characteristic category.
  • equal weight i.e., 1 point
  • variable weight is afforded each word-pair.
  • the word-pairs below line "A" of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line "A" are accorded a lower value.
  • the word-pairs below line “B” of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line “B” are accorded a lower value.
  • the word-pairs below line “C” of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line “C” are accorded a lower value.
  • the word-pairs below line “D” of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line “D” are accorded a lower value.
  • the word-pairs below line “E” of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line “E” are accorded a lower value.
  • the word-pairs below line “F” of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line “F” are accorded a lower value.
  • the word-pairs below line “G” of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line “G” are accorded a lower value.
  • the process 700 proceeds to block 790 to generate an assessment report.
  • the report may be generated by a report generator 1150 based on the responses to the stimuli and the determination of the assessment for the subject in block 760 of Figure 7. The method 700 then terminates at block 799.
  • the refinement required by the determination at block 770 may be performed in a variety of manners. Two refinement methods according to embodiments of the invention are illustrated in Figures 8 and 9, described below.
  • One embodiment of the refinement method 780a illustrated in Figure 8 begins with the determination of the categories to be refined at block 810.
  • the categories may be received from the assessment determined at block 760 of Figure 7, for example.
  • Refinement may be required between any number of the categories, including two categories, three categories or four categories in the above- illustrated example with four characteristic categories of the assessment.
  • stimuli are selected from the categories to be refined.
  • the stimuli may be selected, for example, from the table of stimuli illustrated in Figure 6 or from another database.
  • the stimuli are presented to the subject, and responses are received.
  • Blocks 820, 830 and 840 are illustrated in Figure 8 as being performed in batch form (i.e., all stimuli are first selected, then presented and all responses received). However, it is also contemplated that the functions of these blocks may be performed for one stimulus at a time, and the blocks repeated for each stimulus.
  • an assessment of the subject is determined for the categories to be refined as a sub-assessment.
  • the assessment may be determined using the same or a different scoring method as the determination of an assessment at block 760 of Figure 7.
  • the refinement criterion may require a certain differential (i.e., required minimum) in the numeric value scores for the categories to be refined, for example, similar to the minimum differential required at block 770 of Figure 7.
  • the differential may be a fixed value of may be a function of the number of stimuli presented in the refinement method 780a, for example.
  • the method 780a returns to block 820, and additional stimuli are selected from the categories to be refined. This process may be repeated as often as necessary to satisfy the refinement criterion. It is noted that with increasing number of stimuli presented, the accuracy of the assessment increases.
  • FIG 9 is a flow chart illustrating another exemplary refinement method according to an embodiment of the invention.
  • the method 780b begins with the electronic presentation of a set of stimuli to the subject (block 910).
  • the stimuli may include photographs, diagrams, sketches or other vehicles.
  • the stimuli are word-pairs.
  • the set of stimuli includes two or more stimuli for selection by the subject. In the exemplary embodiment described below with reference to Figures 3 and 5A, each set includes four word-pairs.
  • a query is presented to the subject.
  • the presentation of the query and the presentation of the set of stimuli may be simultaneous or reversed in order.
  • the query is designed to elicit a selection by the subject of one stimulus from the set of stimuli (block 930).
  • the assessment of the subject for the categories to be refined is determined.
  • the determination of the assessment may include determining a stack order for the subject.
  • a stack order is indicative of the assessment of the subject.
  • the stack order is indicative of the relative ordering of the various categories or phases of the success/satisfaction cycle.
  • the stack order may be a direct mapping of the word-pair selections.
  • the relative placement of those categories in the stack order may be used as the assessment of the subject for those categories.
  • the refinement criterion may require a certain relative placement of the categories to be refined in the stack order or a reproducibility of a relative placement in consecutive stack orders, for example.
  • the refinement criterion may require that the categories to be refined be in the same relative placement in two consecutive stack orders. For example, if a refinement was required between "INTERACTOR” and "CONCLUDER" categories, the refinement criterion may be satisfied if the "INTERACTOR" category places higher than the "CONCLUDER" category in three consecutive stack orders.
  • method 780b If the determination is made at block 960 that the refinement criterion has not been satisfied, the method 780b returns to block 910, and an additional set of stimuli is presented. On the other hand, if the refinement criterion is determined to have been satisfied at block 960, method 780b proceeds to block 999 and returns to block 760 of Figure 7.
  • the set of stimuli of the invention maybe presented to a subject on a remote computer by a web server.
  • a web server One such system is illustrated in Figure 10.
  • the system 1000 includes a user device 1010 adapted to communicate with a web server 1020 through a communication network 1030.
  • the user device may be any of a variety of devices, such as a desktop or a laptop computer.
  • the user device 1010 may be a portable or wireless device such as a wireless phone, a personal digital assistant (PDA) or other handheld device.
  • PDA personal digital assistant
  • the web server 1020 may be any computing device provided with server software, for example. Thus, the user device 1010 and the web server 1020 may communicate via a server-client relationship.
  • the web server 1020 may be provided with software adapted to present the user device 1010 with the stimuli and the queries for display on a monitor connected to or part of the user device 1010.
  • the communication between the user device 1010 and the web server 1020 may be facilitated via a direct link.
  • the user device 1010 and the web server 1020 communicate through a communication network 1030.
  • the communication network 1030 may be private or public.
  • the communication network 1030 is the public switched telephone network (PSTN).
  • PSTN public switched telephone network
  • the communication network 1030 is a network of computers, such as the Internet.
  • the communication between the user device 1010 and the web server 1020 is encrypted by means well known in the art, for example, secure hypertext transfer protocol.
  • Figure 10 provides a front-end system 1000 for allowing a subject to access the assessment software through the web server 1020.
  • Figure 11 illustrates a complementary back-end system 1100 for conducting the assessment of the subject.
  • the back-end system 1100 includes an assessment engine 1110 for controlling the administration of the assessment.
  • the assessment engine 1 1 10 includes the software for administration and evaluation of the assessment. Components of the software are exemplarily illustrated in Figures 7-9 and are described herein in greater detail.
  • the back-end system 1 100 includes a user interface 1120 for providing an interface through which the subject can interact with the assessment engine 1110.
  • the user interface 1 120 may be adapted to present the subject with a graphical user interface on the user device 1010 of Figure 10.
  • the user interface 1120 may be adapted to provide graphics, text, data, audio or video data to the subject and may be adapted to receive input from the user through one or more input devices, such as a keyboard, mouse, microphone or camera, for example.
  • FIG. 1 illustrates a two-way communication link between the web server 1020 and the assessment engine 1110. Such communication link may be direct, indirect or through a network.
  • the back-end system 1100 includes a stimulus database 1 130 for storing stimuli to be presented to the subject.
  • the stimulus database 1130 may include stimuli in the form of a table, list or a database. Further, the stimulus database 1130 may be adapted to be updated or modified through an administrator input, for example. Such updates or modifications may be necessary to include additional stimuli or to delete existing stimuli.
  • a user database 1 140 is provided to store information relating to subjects or clients. In this regard, the subjects may include individuals, groups of individuals or entities. Similarly, clients may include individuals, groups of individuals or entities, such as a company. Each client may be associated with one or more subjects.
  • the database may include information relating to subjects or clients that have been assessed or have registered for an assessment, for example.
  • the back-end system 1100 may also include a report generator 1 150.
  • the report generator 1150 is adapted to receive the assessment results or the raw responses from the subject and to generate an assessment report tailored for the subject and/or the client, for example.
  • the report may include text, graphics or other forms of information related to the assessment.
  • subject material provided by the report generator is identified by comparing the assessment results from the subject to a library of subject material referenced by characteristic energy levels of the phases of the success/satisfaction cycle.
  • the various modules illustrated in Figure 11, including the assessment engine 1 110, the user interface 1120, and the report generator 1150 may be implemented in a single software module or may be further separated into additional sub-modules. Further the various modules may be implemented as software, hardware or firmware. Further, the stimulus database 1130 and the user database 1 140 may be implemented as lists, tables or databases, for example, and may be stored on various memory devices well known in the art.
  • the assessment of a subject may incorporate the time it takes for the subject to respond to a stimulus.
  • the system e.g., server administrating the assessment
  • the elapsed time may be of interest as it may reflect the accuracy of the response. For example, a short elapsed time may indicate the subject was very confident of the response, while a longer elapsed time may indicate a lower level of confidence.
  • the elapsed time may be incorporated into the assessment in numerous ways.
  • the elapsed time for each response may be compared to the mean elapsed time for all responses by the subject.
  • the elapsed time factor is normalized to account for any issues related to the ability of the subject to respond to stimuli quicker or slower.
  • a value may be assigned to each response, and the value may be influenced by the elapsed time for that response.
  • the value may be determined by applying a multiplier to a base value for that response, the multiplier being dependent on the elapsed time.
  • the multiplier is between 0 and 1. For shorter elapsed times, the multiplier will be close to 1, while for longer elapsed times, the multiplier will be close to 0. In this regard, responses with lower confidence are substantially reduced in importance, while responses with higher confidence are weighted accordingly.
  • a statistical analysis may then be performed to determine the assessment.
  • the statistical analysis may be performed on the values of the responses to determine the assessment or on the elapsed times for each response.
  • the server administering the assessment may access a database of narratives corresponding to various assessments.
  • the narrative corresponding to the determined assessment for the subject is then selected and may be stored in memory, displayed to the subject or sent to another individual or entity through, for example, electronic mail.
  • embodiments of the present invention can provide an assessment of a relationship between two or more individuals.
  • the interaction between a husband and a wife may be assessed based on assessments of the individuals.
  • a variety of relationships may be addressed.
  • the relationship may be of two or more partners in a business venture, a coach and a student, or any number of other relationships.
  • this relationship assessment may be applied for specific environments for the roles. For example, a relationship assessment may be provided for a husband and a wife in a romantic environment (as a couple) or in a business environment (business partners).
  • two or more subjects may be presented with an assessment as described above. Specifically, each subject is presented with a set of two or more stimuli, as shown in Figures 5A-C. The subject makes his selection, and the response is received by the server administering the assessment, for example. This is repeated with additional stimuli for the subject until assessments for the subject can be determined in one or more characteristic categories, or phases. The same is done for each other subject.
  • Subject B has been determined to be: Strategize phase: Predominant Motivate phase: Low Select
  • the administering server accesses a database containing dyads and corresponding narratives.
  • An exemplary chart of dyads is illustrated in Figure 12.
  • the chart 1200 lists a partial list of dyads for two-party relationships. It will be understood by those skilled in the art that such dyads may be adaptable for relationships involving any number of parties. Further, the term "dyad” is used herein in a generic manner to refer to a set of descriptors for two or more parties.
  • the chart 1200 includes a list of dyads, such as dyad 1210, each dyad containing two descriptors 1212, 1214.
  • Each descriptor includes four position slots, each corresponding to a different characteristic category.
  • the first set of dyads 1202 corresponds to the Strategy phase and, accordingly, each descriptor includes an entry in the first slot.
  • the second set of dyads 1204 corresponds to the Motivate phase and, accordingly, each descriptor includes an entry in the second slot.
  • the third set of dyads 1206 corresponds to the Analyze phase
  • the fourth set of dyads 1208 corresponds to the Activate phase.
  • each dyad corresponds to a narrative developed by experts.
  • the appropriate narratives for each characteristic category can be retrieved from the database and output to the subjects, a manager or any other entity. Alternatively, they may be stored for future reference.
  • the database may contain separate dyads for different relationships. For example, one set of dyads may be appropriate for a manager-employee relationship, while another set may be appropriate for a mentor-mentee relationship.

Abstract

In systems, methods and program products relating to the assessment of individuals, a subject can be provided with an assessment through software and a computer for improved functionality. The software may be directly installed on the subject's computer or may be on a remote server accessible through a communication network, such as a local network or the Internet. Stimuli to be presented to subject are selected in real time and may be selected randomly from a database of stimuli. Further, in the event of borderline cases, a refinement process may be used to provide an accurate assessment of the subject. Methods for the assessment of teams, comprising subject individuals, for the construction of ideal process profiles, and for coaching individuals are provided.

Description

SYSTEM FORAND METHOD FOR PSYCHOLOGICAL
ASSESSMENT
FIELD OF THE INVENTION
[0001] The present invention relates generally to the field of psychological assessment of individuals and teams of individuals.
BACKGROUND OF THE INVENTION
[0002] Much time and effort is expended in the practical application of various psychological instruments in efforts to determine reproducible methods of assessing how individuals and groups of individuals (e.g., teams) make decisions, learn, and accomplish tasks. Conventional assessments require that an individual endure a lengthy evaluation which requires complex processing to determine a personality, knowledge or other type of assessment. Such conventional assessments are typically administered by a psychometrist following a predetermined set of stimuli, and seek to describe psychological characteristics of the individual.
SUMMARY OF THE INVENTION
[0003] The present invention provides systems, methods and program products relating to the assessment, evaluation, training and coaching of subjects such as individuals, groups of individuals, and entities.
[0004] All of the terms in this summary are elaborated below. The invention provides a variety of descriptions of an individual based on the strengths and weaknesses (i.e., energy) of the individual as measured in discrete psychological categories. In some instances, there are four categories, e.g., strategize, motivate, analyze, and active. These categories have multiple names in the art. The starting point for the descriptions is an assessment, which determines the strength of the individual in each of the psychological categories. In some instances, the energy is represented by a numerical value, with a larger numerical value corresponding to a greater energy. In other instances, the strength is represented by an ordering of the categories, for example from "least like" to "most like." The numbers representing the strengths of the individual when taken together can form a process map, which maps out the processes that the individual uses to complete a task. In some instances, the energy of each category can be determined by presenting the individual with a series of plurality of stimuli (e.g., pairs of words) which have been found to correspond to the categories, and asking the individual to choose one stimulus from among the plurality of stimuli. Based on the responses of the individual, the assessment can be constructed. In some instances, based on the relative strengths represented in the assessment, specific evaluations which include narrative descriptions of the individual can be created. These narrative descriptions can include how the individual prefers to work, learn, and work with others. The concept of an assessment can be further expanded to embrace a virtual (i.e., ideal) individual that would be best suited to perform a task, and based on a comparison of the virtual and individual assessments, a narrative description of how well an individual would perform a specific task can be constructed. In some instances, an assessment describing a team of individuals can be created by overlaying the individual assessments of the team members, for example. Furthermore, assessments can be compared between individuals to determine how best the individuals can work together, and based on the resulting assessment, a description of how the individuals work together can be constructed. Furthermore, the assessments, and the narrative description based on them, can be used to coach an individual to better perform a task.
[0005] In a first aspect, the invention provides a method of conducting an assessment of a subject comprising: a) presenting to the subject a first set of two or more stimuli, for example two, three, four or more stimuli, wherein at least two of the stimuli correspond to different characteristic categories; and, b) receiving a selection by the subject of one of the stimuli corresponding to a first characteristic category. The term "assessment" refers to an evaluation, a categorization or other determination of a subject, such as an individual. An assessment may include characteristic categories describing the subject. Furthermore, an assessment may include a psychological assessment. A "subject" may be an individual, a group of individuals or an entity, for example, a team. In particular embodiments, an assessment includes stimuli selected by the subject. The terms "presentation" or "presenting" refer to displaying as graphics, text, audio, video, or the like. A display may include the use of computer or other electronic device and may be accomplished through a communication network, such as the Internet. The term "stimulus" refers to a word- pair or other device, such as photo, image, graphic, sketch, or the like, selected to elicit a response from the subject. The term "word-pair" refers to two words or phrases taken together. In one embodiment, the separate words or phrases of a word- pair are separated by a comma. Non-limiting examples of word-pairs include the following: "aggressive, boisterous," "well prepared, conceptual," "self disciplined, firm," "explores options, sensitive." The term "characteristic category" refers to a characteristic, a phase or other feature of a subject or an assessment. Each characteristic category may correspond to a characteristic or feature associated with an emotional, physical, biological or intelligence characteristic, for example. The term "receiving" refers to acquiring a signal or an input, for example. The term "receiving a selection" refers to acquiring or otherwise accepting as input from the subject an indication in the form of a response choosing one of the stimuli in preference to other stimuli. In certain embodiments, receiving includes a response time criterion (i.e., time limit for response) beyond which a response is not accepted. The term "response time criterion" refers to an interval of time after presentation of a stimulus that a subject is allotted for providing a response. The response time criterion can be for example 1 , 2, 3, 4, 5, 10, 15, 20, 30, 45 seconds, 1 , 2, 3, 4,5 minutes, or even longer. In some embodiments, the response time criterion is in the range 1 -10, 1-20, 1-30, and 1 -45 seconds. In preferred embodiments, the response time criterion is in the range 1-45 seconds. In certain embodiments, if a response is not accepted then the method returns to the previous step. In certain embodiments, receiving includes recording the time taken by the subject to respond to each of a plurality of stimuli and using a response time consistency criterion calculated from a statistical analysis of the elapsed time so recorded. "Response time consistency criterion" refers to a statistical factor which is calculated from the time taken by a subject in responding to each of a plurality of stimuli. If a response is not received within the response time consistency criterion, then the response is discarded. Optionally, the subject may be presented an additional stimulus. In some embodiments, a response time consistency criterion is a multiple of the average time required by the subject to respond to a plurality of stimuli. In some embodiments, the multiple of the average time is in the range 0.01 to 100 (e.g., 0.1 to 10, 0.1 to 5, and the like). For example without limitation, if the average time taken by a subject to respond to a stimuli were 10-sec, the response time consistency criterion can be a multiple thereof (e.g., 1, 2, 3, 4, 5, 10, 15, 20, 30, 40, 50, 60, 70, 80, 90, 100, or even 1000 sec). In some embodiments, the response time consistency criterion is calculated by adding a multiple of the standard deviation of the response time for a plurality of stimuli to the average time taken to respond to the plurality of stimuli. In some embodiments, the multiple is in the range 0.01 to 100, e.g., 0.1 , 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 15, 20, 30, 40, 50, or even 100). For example without limitation, if the average time to respond were 10 sec, and the standard deviation of the response times were 3-sec, the response time consistency criterion could be 10-sec plus some multiple of 3-sec, providing a time consistency criterion of 13-sec, 16-sec, 19-sec, 22-sec, 25-sec, for multiples of 1-5, respectively). The term "response" refers to an indication of a preference or a selection by the subject. The response may be "yes" or "no," a number between two extremes, for example, without limitation, 1-2, 1-3, 1-5, 1-10, 1-100, or a selection of one option from a plurality of options. Furthermore, the response may be selection or non-selection by the subject. The term "first characteristic category" refers to the characteristic category corresponding to the first stimulus selected by the subject (i.e., step b).)
[0006] In preferred embodiments, three or four or more stimuli are presented in step a), or four stimuli are presented in step a) wherein each characteristic category corresponds to a different phase in a success/satisfaction cycle. The terms "phase," "phase in a success/satisfaction cycle," and "success/satisfaction cycle" are elaborated below.
[0007] In other preferred embodiments, an inquiry is presented to the subject in step a), and the selection received in step b) is in response to the inquiry. The terms "inquiry" and "query" refer to a solicitation for a response, for example, a question presented to the subject. Accordingly, the subject may be asked to respond to the stimuli to indicate a preference or a selection. In some embodiments, the requested response may be either "yes" or "no" to a query such as "DOES THIS OBJECT DESCRIBE YOU?" In other embodiments, the requested response may be a number between two extremes, for example, 1-2, 1-3, 1-5, 1-10, 1-100. For example, the query may be "ON A SCALE OF 1 TO 10, WHAT IS THE LEVEL AT WHICH THIS OBJECT DESCRIBES YOU?" In still another embodiment, the query may ask the subject to select an option from a plurality of options. For example, the query maybe "PLEASE SELECT ONE OF THE FOLLOWING TO INDICATE HOW WELL THIS OBJECT DESCRIBES YOU," and the subject may be presented with two or more options, for example: "STRONGLY AGREE," "AGREE," "NEUTRAL," "DISAGREE," and "STRONGLY DISAGREE." The term "OBJECT" in this context refers to a presented stimulus.
[0008] In yet other embodiments, the method includes the following steps: c) presenting to the subject a second set of two or more stimuli corresponding to characteristic categories different from the first characteristic category; and d) receiving a selection from the subject of one of the second set of two or more stimuli corresponding to a second characteristic category. The term "second characteristic category" refers to the characteristic category corresponding to the stimulus selected by the subject in step d).
[0009] In still other embodiments, the method further includes the following steps: e) presenting to the subject a third set of two or more stimuli corresponding to characteristic categories different from the first and second characteristic categories; and f) receiving a selection by the subject of one of the third set of two or more stimuli corresponding to a third characteristic category. The term "third characteristic category" refers to the characteristic category corresponding to the stimulus selected by the subject in step f).
[0010] In other embodiments, the method further includes obtaining an order of selection of the characteristic categories. In yet other embodiments, the characteristic categories are the first, second, and third characteristic categories corresponding to the selections made in steps b), d) and f), in combination with any characteristic categories not selected in steps b), d) or f). The terms "order of selection" and "stack order" refer to an ordering according to rank and is synonymous with the term "rank order" in the usual statistical sense. The term "rank" refers to a preference, for example, without limitation, "most like" through "least like." Accordingly, an order of selection may indicate a hierarchical relationship of selected characteristic categories of the subject.
[0011] In yet other embodiments, the method is repeated (i.e., steps a) through f)) with additional sets of stimuli. The additional sets of stimuli may include stimuli not previously presented to the subject. In other embodiments, the stimuli are selected for presentation at random from a database of stimuli. The term "random" refers to an equal probability of selection among a plurality of possibilities, e.g., equal probability of selection of any possible stimulus from a plurality of stimuli. In contrast, the terms "non-random" and "partially random" refer to an unequal probability of selection of any one or more possible selections from a plurality of possible selections. The term "database of stimuli" refers to a computer database which contains entries of stimuli comprising graphics, text, audio, video, or the like. The entries in the database of stimuli may be referenced by characteristic category. In particular embodiments, the stimuli in the database of stimuli are text. In other particular embodiments, the stimuli in the database of stimuli are word-pairs. In other embodiments, steps a) to c) include communication with the subject through a network. The network may be the Internet. In yet other embodiments, each stimulus is a word-pair.
[0012] A further aspect of the invention relates to a method of conducting an assessment of a subject and comprises: a) presenting to the subject two to four stimuli, for example two, three, or four stimuli, and an inquiry, each stimulus corresponding to a phase in a success/satisfaction cycle; b) receiving a selection by the subject of one of the stimuli in response to the inquiry; and c) repeating steps a) and b) until an order of selection of each phase in a success/satisfaction cycle is determined. The terms "phase in a success/satisfaction cycle" and "success/satisfaction cycle" are elaborated below. In preferred embodiments, the method further includes step d), processing the order of selection to determine an assessment of the individual. The term "processing the order of selection" refers to providing an assessment based on the hierarchical order of the phases in a success/satisfaction cycle. In preferred embodiments, each stimulus of the method is a word-pair. In certain embodiments, receiving further includes a response time criterion beyond which a response is not accepted. In certain embodiments, if a response is not accepted then the method returns to the previous step. In preferred embodiments, the response time criterion is in the range 1-45 seconds. In certain embodiments, receiving further includes recording the time required to respond to each of a plurality of stimuli, and calculating a response time consistency criterion, as described herein, which determines whether a particular response is accepted. If a response is not received within the response time consistency criterion, then the response is discarded. Optionally, the subject may be presented an additional stimulus. In some embodiments, a response time consistency criterion is a multiple of the average time required by the subject to respond to a plurality of stimuli. In some embodiments, the multiple of the average time is in the range 0.01 to 100 (e.g., 0.1 to 10, 0.1 to 5, and the like). For example without limitation, if the average time taken by a subject to respond to a stimuli were 10-sec, the response time consistency criterion can be a multiple thereof (e.g., I5 2, 3, 4, 5, 10, 15, 20, 30, 40, 50, 60, 70, 80, 90, 100 sec, or even longer).
[0013] In another aspect, the invention provides a program product. The program product comprises machine readable program code for causing a machine to perform the following method steps: a) presenting to the subject a first set of two or more stimuli, for example two, three, four or more stimuli, wherein at least two of the stimuli correspond to different characteristic categories; and, b) receiving a selection by the subject of one of the stimuli corresponding to a first characteristic category.
[0014] In preferred embodiments, the program product further includes machine readable program code for causing a machine to present four stimuli in step a), wherein each different characteristic category corresponds to a different phase in a success/satisfaction cycle, as elaborated below. In other embodiments, the program product further includes machine readable program code for causing a machine to present an inquiry to the subject in step a) and receive a selection by the subject in response to the inquiry in step b). In other embodiments, the program product further includes machine readable program code for causing a machine to c) present to the subject a second set of two or more stimuli corresponding to characteristic categories different from the first characteristic category; and d) receive a selection from the subject of one of the second set of two or more stimuli corresponding to a second characteristic category. In yet other embodiments, the program product further includes machine readable program code for causing a machine to e) present to the subject a third set of two or more stimuli corresponding to characteristic categories different from the first and second characteristic categories; and f) receive a selection by the subject of one of the third set of two or more stimuli corresponding to a third characteristic category. In other embodiments, the program product further includes machine readable program code for causing a machine to obtain an order of selection of the characteristic categories. In other embodiments, the program product further includes machine readable program code for causing a machine to repeat steps a) through f) with additional sets of stimuli. In still other embodiments, steps a) to b) further include communication with the subject through a network. In particular embodiments, this network is the Internet. In other embodiments, each stimulus of the program product includes a word-pair. Further this aspect, any embodiment can further include machine readable program code for causing a machine to calculate and use a response time criterion or response time consistency criterion, as described herein.
[0015] In another aspect, the invention provides a program product comprising machine readable program code for causing a machine to perform the following method steps: a) presenting to the subject two to four stimuli, for example two, three, or four stimuli, and an inquiry, each stimulus corresponding to a phase in a success/satisfaction cycle; b) receiving a selection by the subject of one of the stimuli in response to the inquiry; and c) repeating steps a) and b) until an order of selection of each phase in a success/satisfaction cycle is determined. In preferred embodiments, the program product includes machine readable program code for causing a machine to perform the following method step: d) processing the order of selection to determine an assessment of the subject. In other embodiments, each stimulus of the program product includes a word-pair. Further this aspect, any embodiment can further include machine readable program code for causing a machine to calculate and use a response time criterion or response time consistency criterion, as described herein.
[0016] In another aspect of the invention, a system is provided for conducting an assessment of a subject, which system comprises a server adapted to present two or more stimuli to the subject on a computer, each stimulus corresponding to a different characteristic category, wherein the server is further adapted to receive a selection by the subject of one of the stimuli. A "server" may include a computer or a computing device provided with software to allow the computer or computing device to communicate with another computer or computing device in a server-client relationship as understood by one of skill in the art. In other embodiments of the system, each stimulus includes a word-pair.
[0017] In another aspect, a computer-implemented method of evaluating an assessment of a subject is provided which comprises: a) presenting to a subject at least one stimulus, for example one, two, three, four, or more stimuli, wherein at least one stimulus is selected in real time and corresponds to a characteristic category; and b) evaluating an assessment of the subject based on a response received from the subject to each stimulus presented. The term "evaluating an assessment" refers to assigning numeric value scores to the characteristic categories of an assessment. The numeric value scores may be the sum of weighted stimulus scores corresponding to particular stimuli. The term "weighted stimulus score" refers to a number in the range 1-100, for example without limitation, 1 , 2, 3, 4, 5, 6, 7, 8, 9, 10, 20, 30, 40 , 50, 100, associated with each stimulus. The weighted stimulus score may be associated with a stimulus in a database of stimuli by methods commonly known in the art. Specific examples of weighted stimulus scores associated with particular stimuli are provided herein, for example, Figure 6. The term "response received from the subject" refers to a selection of one or more of the stimuli presented in step a). In certain embodiments, the subject has a time limit (i.e., response time criterion) within which to respond, after which the response is not accepted. In certain embodiments, if a response is not accepted then the method returns to the previous step. In preferred embodiments, the response time criterion is in the range 1-45 seconds. In certain embodiments, receiving includes recording the time taken by the subject to respond to each of a plurality of stimuli, and using a response time consistency criterion calculated from a statistical analysis of the elapsed time so recorded. "If a response is not received within the response time consistency criterion, then the response is discarded. Optionally, the subject may be presented an additional stimulus. In some embodiments, a response time consistency criterion is a multiple of the average time required by the subject to respond to a plurality of stimuli, as described herein. In some embodiments, the multiple is in the range 0.1 to 10. The term "real time" refers to the time period during which the assessment is conducted. Real time may include delays associated with processing, communicating or accessing data or devices, for example. "Real time" may be less than one microsecond, less than ten microseconds, less than one second, less than ten seconds, less than one minute or less than 10 minutes before the presentation of the stimulus to the subject. In preferred embodiments, step a) further includes randomly selecting at least one stimulus from a database of stimuli. The term "selecting" refers to choosing, picking or singling out one or more stimuli from a list, table or database, for example. In other preferred embodiments, each stimulus is a word-pair. In other embodiments, step a) further includes formulating an entire assessment by presenting a plurality of stimuli to a subject. The term "formulating" refers to selection of an entire set of stimuli to be presented to the subject for an assessment. In particular embodiments, the plurality of stimuli may include at least one stimulus corresponding to each of a plurality of different characteristic categories. In other embodiments, the method further includes: c) determining whether the assessment evaluated in step b) requires refinement between two or more characteristic categories. The term "refinement" refers to a discrimination process required in borderline instances. The term "borderline" refers to the case wherein the difference in the numeric value scores of two categories is not greater than a required minimum. The terms "required minimum" and "refinement criterion" refer to a number, for example, 1 , 2, 3, 4, 5, or greater. For example, if the numeric value scores of two characteristic categories were less than 3, and the required minimum were 4, refinement would be necessary. In other embodiments, the method includes the following step: d) presenting an additional stimulus corresponding to each of the two or more characteristic categories. Other embodiments include: e) repeating steps b) through d) until a desired level of refinement is achieved. The term "desired level of refinement" refers to the required minimum in the difference in the numeric value scores of two categories of the assessment, as elaborated above. In other embodiments of this aspect, the method further includes the following steps: d) presenting to the subject two or more stimuli, wherein each stimulus corresponds to a different characteristic category; e) receiving a selection by the subject of one of the stimuli; and f) repeating steps d) and e) to obtain an order of selection of each different characteristic categories. In yet other embodiments, the method further includes: g) repeating steps c) to f) until a desired level of refinement is achieved.
[0018] In another aspect, the invention provides a program product. The program product comprises machine readable program code for causing a machine to perform the following method steps: a) presenting, when an assessment of a subject requires refinement between two or more characteristic categories of the assessment, to a subject a first set of three or more stimuli, wherein each stimulus in the first set of three or more stimuli corresponds to a different characteristic category; b) receiving a selection by the subject of one of the stimuli; c) presenting to the subject a second set of two or more stimuli, wherein each stimulus of the second set of two or more stimuli corresponds to a different characteristic category; and d) repeating steps b) and c) to obtain an order of selection of each of the different characteristic categories. Further this aspect, any embodiment can further include machine readable program code for causing a machine to calculate and use a response time criterion or response time consistency criterion, as described herein.
[0019] In another aspect, the invention provides a method of conducting an assessment of a team comprised of members, comprising the following steps: a) providing the process maps of the members of the team; b) overlaying the process maps of the members of the team; and c) assessing the team by providing a process map comprising the overlaid process maps of the members of the team. The terms "process map" and "overlaying" are elaborated below. The term "team" refers to a plurality of individuals (i.e., "members" or "constituents") with common goals (i.e., "missions") and tasks by which the goals are achieved. A team depends on the success of the individual constituents thereof. In certain embodiments, the team further includes a manager (e.g., coach or representative of the entity employing the team member(s).) A team can include as few as two members. In certain embodiments, a team of two members includes an individual and a coach.
[0020] In preferred embodiments, the method further includes constructing a process map of a virtual member of the team (i.e., "virtual team member") wherein the method comprises the following steps: d) identifying deficiencies or excesses in each characteristic category of the team assessment; and e) constructing a process map of the virtual member of the team by ascribing to each characteristic category of the process map of the virtual member of the team a value which compensates for the deficiencies or excesses of the overlaid process maps of the members of the team. The terms "deficiency" and "excess" in the context of team assessment refer to a difference in the numeric value score of a particular characteristic category with respect to the corresponding value of an ideal team member. The term "ideal team member" refers to a hypothetical team member having numeric value scores associated with each characteristic category that compensate for the deficiencies and excesses of the corresponding characteristic categories of the assessment of the team. For example, an ideal team member does not necessarily dominate in all or even any characteristic category of the team process map. For example, a "deficiency" in a team member could refer to a predominate phase if that dominance distracts from the overall performance of the team. An ideal process map (i.e., the process map of a hypothetical team member with the optimal energy levels at each phase of the team process) can be constructed in view of the team assessment described above, which process map complements deficiencies or excesses identified by the team assessment. Accordingly, the terms "virtual member of the team" and "virtual team member" refer to a hypothetical team member having an ideal process map. In other embodiments, the virtual team member has a process map which fulfills a specific role or relationship within the team.
[0021] In other embodiments, the method further includes a method for identifying candidate team members comprising the following steps: f) comparing the process map of a virtual team member with a plurality of stored assessment data obtained for candidate team members; g) identifying a match between the virtual team member process map and the stored assessment data; and h) identifying the candidate team members associated with the stored assessment data. The term "candidate team member" refers to an individual or even another team which may be joined with the team for which the team assessment was conducted. The term "stored assessment data" refers to entries in a database comprising assessments. The method of comparison of step f) may be conducted in a variety of manners known to those of skill in the art. For example, the absolute values of the numerical difference between the numeric value scores of the ideal process map and the process maps of candidate team members can be summed to provide a composite comparison. In other embodiments, the differences are squared prior to summation. The term "identifying a match" refers to the identification within the stored assessment data of a process map of a candidate team member, or a set of candidate team members, which is similar or identical to the process map of the virtual team member. The term "identifying the candidate team member" refers to the database management step of providing the identification of the candidate team member by methods well known in the art.
[0022] In another aspect, the invention provides a system for conducting an assessment of a subject, which system comprises a server adapted to present to a subject at least one stimulus and to receive a response by the subject to each stimulus presented, wherein the at least one stimulus is selected in real time and corresponds to a characteristic category; and wherein the server is further adapted to determine an assessment of the subject based on the responses. In other embodiments, the server is further adapted to determine whether the assessment requires refinement between two or more characteristic categories, wherein the server is further adapted to present, when refinement is required, an additional stimulus corresponding to each of two or more characteristic categories.
[0023] In a further aspect, the invention provides a method for improving the performance (i.e., "coaching") of current or potential team members in the furtherance of the team mission. In this context, coaching is conducted by a "coach" who is an individual responsible for training individual clients. The term "client" refers to an individual receiving coaching. In preferred embodiments, the method provides for the following steps: a) evaluating a client current process map to provide a client evaluation; and b) reciting the client evaluation to the client. The term "client current process map" refers to a process map of the client determined by methods of the invention, and which assessment is currently valid, i.e., represents the client now. A client current process map can be obtained contemporaneously with the coaching, or can be the result of a previous assessment of the client. The previous assessment of the client can have occurred, for example without limitation, 1-day, 1-week, 1 -month, 2-months, 3 -months, 6-months, or even longer, prior to the coaching. The term "client evaluation" refers to the level of energy the client has, or can bring to bear, to the phases of a success/satisfaction cycle as elaborated below, and can include a narrative description of the client in view of the client current process map.
[0024] In other embodiments, the invention further includes comparing the client current process map and a coach process map in order to provide a coach/client evaluation to determine for example how the client and coach would naturally prefer to work together. The term "coach process map" refers to a process map, as provided by the invention, resulting from an assessment of the coach. The term "coach/client evaluation" refers to the differences in the level of energy between the client and coach in the phases of a success/satisfaction cycle as elaborated below, and can include a narrative description of the client and coach comprising the strengths and weaknesses thereof, as measured by differences in the energy levels within the categories of the client current and coach process maps. Additionally, the coach/client evaluation may contain a narrative description of changes in the behavior of the client and the coach to improve the coach/client relationship. Additionally, the coach/client evaluation may contain a learning report, described below, of the client and a teaching report, described below, for the coach. In other embodiments, the coach/client evaluation is recited to the client by the coach. In yet other embodiments, the method provides an explicit list of changes in behavior which the client and coach can make to improve their ongoing working relationship.
[0025] In other embodiments, the method further includes reciting to the client the learning report of the client and the teaching report of the coach. The term "learning report of the client" refers to a written narrative describing the learning style of the client which is the manner in which the client would most naturally prefer to learn, as determined in view of the client current process map. Additionally, the learning report of the client can include a written description of changes in the behavior of the client to achieve more efficient task completion. The suggested changes in the behavior of the client are written from the perspective of the coach; i.e., the suggestions provide the coach with specific tasks and goals to give the client. The term "teaching report of the coach" refers to a written narrative describing the teaching style of the coach which is the manner in which the coach would most naturally prefer to teach (i.e., coach,) as determined in view of the coach process map. Additionally, the teaching report of the coach can include a written description of changes in the behavior of the coach to achieve more efficient task completion by the client. In other embodiments, the method further includes reciting to the client changes in the learning style of the client or changes in the teaching style of the coach to achieve more efficient task completion by the client. For example without limitation, if the client current process map indicated a predominant level in the analyze phase, the coach might advise the client to reduce the level of analysis activity in order to devote more focused energy, as defined below, to other phases.
J0026] In other embodiments, the method further includes comparing the client current process map and a client aspiration map to provide an ideal client evaluation. The term "client aspiration map" refers to a process map describing what dynamic strengths (i.e., energy levels within the phases of a success/satisfaction cycle) a client ideally desires. The client aspiration map can be created by the methods of the invention for assessment, further including an inquiry directed to the client's desires. Accordingly, the subject may be asked to respond to the stimuli to indicate a preference or a selection. In some embodiments, the requested response may be either "yes" or "no" to a query such as "DOES THIS OBJECT DESCRIBE WHAT YOU WOULD IDEALLY LIKE TO BE?" In other embodiments, the requested response may be a number between two extremes, for example, 1-2, 1-3, 1-5, 1-10, 1- 100. For example, the query may be "ON A SCALE OF 1 TO 10, WHAT IS THE LEVEL AT WHICH THIS OBJECT DESCRIBES WHAT YOU WOULD IDEALLY LIKE TO BE?" In still other embodiments, the query may ask the subject to select an option from a plurality of options. For example, the query may be "PLEASE SELECT ONE OF THE FOLLOWING TO INDICATE HOW WELL THIS OBJECT DESCRIBES WHAT YOU WOULD IDEALLY LIKE TO BE," and the subject may be presented with two or more options, for example: "STRONGLY AGREE," "AGREE," "NEUTRAL," "DISAGREE5" and "STRONGLY DISAGREE." The term "OBJECT" in this context refers to a presented stimulus. The term "ideal client evaluation" refers to the level of energy the client desires to bring to bear to the phases of a success/satisfaction cycle as elaborated below, and can include a narrative description of the client in view of the client aspiration map.
f 0027] In other embodiments, the ideal client evaluation is recited to the client by the coach. In yet other embodiments, the method further includes reciting to the client changes in the behavior of the client to minimize the difference between the client current process map and the client aspiration map.
[0028] In other embodiments, the method further includes comparing the client current process map and a colleague process map to provide a colleague/client evaluation to determine how the client and the colleague prefer to work as a team. The term "colleague process map" refers to a process map, as provided by the invention, resulting from an assessment of the colleague. The term "colleague/client evaluation" refers to the differences in the level of energy between the colleague and client in the phases of a success/satisfaction cycle as elaborated below, and can include a narrative description of the colleague and client including the strengths and weaknesses thereof, as measured by differences in the energy levels within the categories of the client current process map and colleague process map. In other embodiments, the colleague/client evaluation is recited to the client by the coach. In other embodiments, the coach recites to the client changes in the behavior of the client and the colleague to increase success and satisfaction in the fulfillment of a task by the client or colleague.
[0029] In other embodiments, the method further includes comparing the client current process map with a task/project process map in order to provide a task/client evaluation. The term "task/project" refers to a task undertaken by a client as part of a project assigned to the client. The term "task/project process map" refers to a process map of an idealized client, which idealized client would be ideally suited to the performance of a specified task as part of a specific project. For example, the requirements of a task/project for a sales manager could include preferred motivate and activate energy levels and lower energy levels (e.g., select energy levels) in the analyze and strategize categories. Such a combination of energy levels would allow the idealized client to perform the duties of sales manager without wasting time. The term "task/client evaluation" refers to the differences in the level of energy between the client and task/project in the phases of a success/satisfaction cycle as elaborated below, and can include a narrative description of the client and task/project comprising the strengths and weaknesses thereof, as measured by differences in the energy levels within the categories of the process maps.
[0030] In other embodiments, the task/project process map is constructed by arithmetically averaging the individual corresponding numerical components (i.e., numeric value scores) of the phases of process maps of a plurality of real individuals who well perform the task. In this context, the term "well perform" refers to successful accomplishment of the subject task by the idealized client or plurality of real individuals with respect to any of a plurality of criteria of importance to management, including, for example without limitation, minimized time expenditure, minimized resource expenditure, maximized profit, and other criteria important to management and well known in the art. In other embodiments, the invention provides a method for constructing a task/project process map wherein an individual well skilled in the subject task creates the task/project process map based on personal experience. In a specific example without limitation, the individual well skilled in the subject task may determine that a specific task requires high motivate and analyze energies, and lower activate and strategize energies. In other embodiments, the numeric value scores assigned to each phase of the task/project process map by the individual well skilled in the subject task is subject to a compensating correction (e.g.,
1, 2, 3 or 4 points up or down) in order to compensate for bias of the individual well skilled in the subject task. In other embodiments, the compensation is provided at the discretion of the individual well skilled in the subject task. For example, an individual well skilled in the subject task may have a very high energy (i.e., predominant) in a particular phase, e.g., analytic. In this case, the analytic energy level of the idealized process map created by the individual well skilled in the subject task may require compensation downward (e.g., by 1 , 2, 3, or 4 points) in order to compensate for the inherent energy level of the individual well skilled in the subject task. In other embodiments, a plurality of individuals well skilled in the subject task (i.e., "assay group") each create an idealized process map, and the individual corresponding numerical components of the phases of the resulting process maps are arithmetically averaged to create the task/project process map. In other embodiments, management may decide to compensate the individual energy levels within the task/project process map constructed by the method by a compensation factor (e.g., 1,
2, 3, or 4 points up or down) depending on the statistics of the numerical values for each energy level supplied by the assay group. For example, if each member of the assay specified a high analytic energy level in the idealized process map, the resulting analytic energy level may not require compensation. In contrast, if the assay group provided a range of values for analytic energy in the idealized process map, as measured by a large variance or standard deviation, the corresponding analytic energy level in the task/project process map may require compensation downward.
[0031 J In other embodiments, the method further includes reciting the task/client evaluation to the client by the coach. In other embodiments, the method further includes reciting to the client changes to the behavior of the client to minimize the difference in energy levels between the client current process map and the task/project process map.
[0032] In other embodiments, the method further includes reciting to the client the working preferences of the client. The term "working preferences of the client" refers to how the client most naturally prefers to get things done. The classes of information provided thereby may include, without limitation, the ideal work environment of the client, the interaction skills of the client, client's ability to take direction and stay orientated to the task at hand, client's leadership abilities, client's decision making and risk taking preferences, and client's persuasive and sales ability. In other embodiments, the coach and client, in view of the client's working preferences, set mutual expectations and goals, and predict and improve performance.
[0033] In other embodiments, the method further includes reciting to the client the learning preferences of the client. The term "learning preferences of the client" refers to how the client most naturally prefers to learn. The classes of information provided thereby may include, without limitation, the ideal learning environment of the client, and the interaction skills of the client with a manager, teacher, or coach provided training.
[0034] In other embodiments, the method further includes visualizing how the client prefers to spend time on any task or role. In yet other embodiments, this visualization is used by the coach and client to set mutual expectations, and predict and improve performance. And in still other embodiments, the method further includes visualization of how the client prefers to spend focused energy on a task. The term "focused energy" is elaborated below. In yet other embodiments, this visualization is used by the coach and client to set mutual expectations, and predict and improve performance.
[0035] In other embodiments, the method further includes incorporating the client evaluation and the coach/client evaluation within an archive database. The term "archive database" refers to a computer data structure adapted to hold subject information (e.g., name, address, job position, and the like,) task information, assessments, process maps, evaluations, editing feedback, annotated responses, and comments by the client and coach. Separate entries in the database, i.e., client archive and coach archive, are maintained for client and coach, respectively. The client archive is adapted so that the client cannot change an entry without permission of the coach or the employer of the client (i.e., management.) The archive database is configured and maintained by methods well known in the art.
[0036] In other embodiments, the method further includes annotating responses of the coach and the client within an archive database. The term "annotating" refers to providing written text for inclusion in the archive database to accompany a response.
[0037] In other embodiments, the method further includes receiving editing feedback by the client prior to entry of such feedback into the archive database. The term "editing feedback by the client" refers to editing entries provided by the client. The editing entries may include comments by the client which are incorporated into the client evaluation and stored in the archive database. The editing entries further may include a choice by the client regarding which elements of the client evaluation and client learning report that the client feels most correctly describe the client. The client may be presented with a plurality of elements of a client evaluation and given the opportunity to classify (i.e., mark) each element with a designation, for example without limitation, a) very much like me most of the time, b) somewhat like me some of the time, and c) not like me at all. Client evaluation elements marked as "a)" or b)" are retained in the client evaluation, and the client evaluation is re-written and stored in the client archive. All of the elements, irrespective of how marked by the client, are retained in the coach archive. Alternatively, the designations a), b) and c) can be replaced by a color code, for example green, yellow, and red, respectively. Additionally, the client may be presented with a plurality of elements of a client learning report and given the opportunity to classify each element with the following designations: a) very much like me most of the time, b) somewhat like me some of the time, and c) not like me at all. Then, client learning report elements marked as "a)" are retained in the client evaluation, and the client evaluation is re-written and stored in the client archive. All of the elements of the learning report, irrespective of how marked by the client, are retained in the coach archive. The designations a), b) and c) can be replaced by a color code, for example green, yellow, and red, respectively.
[0038] In further embodiments, the method further includes reviewing the archive database by the coach and the client in order to identify success and failure in a coach- client relationship. The term "success and failure in a coach-client relationship" refers to how well the coach and client work together (i.e., whether stress or anxiety are present in either coach or client,) how well the client responds to the teaching style of the coach (e.g., as measured by changes in the behavior of the client,) how well the coach responds to interaction with the client (e.g., as measured by changes in the teaching style of the coach in response to the client,) and how well the client ultimately performs the task forming the basis of the coaching.
[0039] In other embodiments, the method further includes repeating steps a) and b) and comparing the client evaluation so obtained with a client evaluation within the archive database to provide an updated client evaluation. The term "updated client evaluation" refers to a description of changes in the client evaluation. An updated client evaluation is useful for comparing possible changes in the client current process map over time, or to determine how a client performs in a different task at a later time, for example.
[0040] In another aspect, the invention provides a program product comprising machine readable program code for causing a machine to evaluate a client current process map to provide a client evaluation. In other embodiments, the program product further includes machine readable program code for causing a machine to compare the client current process map and a coach process map to provide a coach/client evaluation. In other embodiments, the program product further includes machine readable program code for causing a machine to compare the client current process map and a client aspiration map to provide an ideal client evaluation. In other embodiments, the program product further includes machine readable program code for causing a machine to compare a client current process map and a colleague process map to provide a colleague/client evaluation. In other embodiments, the program product further includes machine readable program code for causing a machine to compare a client current process map and a task/project process map to provide a task/client evaluation.
[0041] In another aspect of the invention, a system for conducting an assessment of a subject comprises a server adapted to present to a subject at least one stimulus and to receive a response by said subject to each said stimulus presented. The at least one stimulus is selected in real time and corresponds to a characteristic category. The server is further adapted to determine an assessment of said subject based on said responses. The assessment is determined based at least partly on elapsed time for said responses.
[0042] In one embodiment, the assessment is determined based on comparison of elapsed time for each response to a mean elapsed time for all responses from the subject.
[0043] In another embodiment, the server is adapted to assign a value to each response based on the elapsed time for that response. The value may be determined by applying a multiplier to a base value, the multiplier being dependent on the elapsed time. The server may be adapted to perform a statistical analysis on the values of the responses to determine the assessment.
[0044] In another embodiment, the server is adapted to perform a statistical analysis on the elapsed times of the responses to determine the assessment.
[0045] In one embodiment, the system further comprises a database of narratives corresponding to one or more assessments. The server is adapted to output a narrative from the database corresponding to the assessment determined.
[0046] In another aspect, the invention includes a method of conducting an assessment of a subject. The method comprises: a) presenting to a subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category; c)repeating steps a) and b) as necessary with additional sets of stimuli; and d) outputting an assessment of the subject based on said responses. The assessment is determined based at least partly on elapsed time for said responses.
[0047] In another aspect, a program product comprises machine readable program code for causing a machine to perform the following method steps: a) presenting to a subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category; c) repeating steps a) and b) as necessary with additional sets of stimuli; and d) outputting an assessment of the subject based on said responses. The assessment is determined based at least partly on elapsed time for said responses.
[0048] In another aspect of the invention, a system for conducting a relationship assessment of two or more subjects comprises a server adapted to present to each subject at least one stimulus and to receive a response by each subject to each stimulus presented, wherein the at least one stimulus is selected in real time and corresponds to a characteristic category. The server is further adapted to determine a characteristic category assessment of each subject based on the responses for one or more characteristic categories. The system further comprises a database of dyads, each dyad based on a characteristic category assessment of each subject and corresponding to a relationship assessment of a relationship between the subjects.
[0049] In one embodiment, the database of dyads includes narratives corresponding to one or more relationship assessments. The server is adapted to output a narrative from the database corresponding to the relationship assessment.
[0050] In another embodiment, each dyad includes a characteristic category assessment for at least one of the following characteristic categories: strategize, motivate, anal yze and activate.
[0051] In another aspect of the invention, a method of conducting a relationship assessment of two or more subjects comprises: a) presenting to a subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category; c) repeating steps a) and b) as necessary with additional sets of stimuli; d)determining a characteristic category assessment of the subject based on said responses for one or more characteristic categories; e) repeating steps a)-d) for each remaining subject; and f) outputting a relationship assessment of a relationship between the subjects based on the characteristic category assessments determined for each subject.
[0052] In another aspect of the invention, a program product comprises machine readable program code for causing a machine to perform the following method steps:a) presenting to a subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category; c) repeating steps a) and b) as necessary with additional sets of stimuli; d) determining a characteristic category assessment of the subject based on said responses for one or more characteristic categories; e) repeating steps a)-d) for each remaining subject; and f) outputting a relationship assessment of a relationship between the subjects based on the characteristic category assessments determined for each subject.
BRIEF DESCRIPTION OF THE FIGURES
[0053J Figure 1 is a diagrammatic representation of a conventional Gestalt cycle of experience.
[0054] Figure 2 is a diagrammatic representation of a success/satisfaction cycle derived from the Gestalt cycle of experience.
[0055] Figure 3 is a table of exemplary word-pairs in four phases of the success/satisfaction cycle.
[0056] Figure 4 is a flow chart illustrating a method for assessing a subject according to an embodiment of the invention.
[0057] Figures 5A, 5B5 and 5C are screen shots illustrating an exemplary assessment process. [0058] Figure 6 is a table of exemplary word-pairs in four categories for use as stimuli in an assessment.
[0059] Figure 7 is a flow chart illustrating a method for assessing a subject according to an embodiment of the invention.
[0060] Figure 8 is a flow chart illustrating one embodiment of a method for refinement between categories.
[0061] Figure 9 is a flow chart illustrating another embodiment of a method for refinement between categories.
[0062] Figure 10 is a schematic illustration of a front end of a system according to an embodiment of the invention.
[0063] Figure 11 is a schematic illustration of a back end of a system according to an embodiment of the invention.
[0064] Figure 12 illustrates an exemplary dyad database according to embodiments of the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0065] The present invention provides assessment systems, methods and program products that are based on a combination of the Method of Paired Comparisons and Task Completion from a Gestalt framework. Forced choice comparisons may be administered to a user either physically or electronically through software, for example, Flash, PHP, and other interactive software designed by products well known in the art. The assessments may be applied to individuals, groups of individuals, or to idealized individuals or teams to create a template for subsequent screening of individuals.
[0066] The Method of Paired Comparisons is based on Thurstone's Law of Comparative Judgment. When a person is presented with a stimulus, such as a word- pair or a picture, a sequence of events occurs. The distal stimuli are patterned on the retina, then transferred into electrical signals and delivered to the brain. The brain then sets up mental representations bio-chemically using separate groups of neurons, one group for each stimulus. These events are massively parallel and can involve tens of thousands of neurons along with the electrochemical interactions between them.
10067] In the case of the assessment of embodiments of the present invention, when an individual is presented with stimuli such as word-pairs for comparison, a neurological mechanism triggers two mental representations — one for each of the stimuli. The representation that the individual most prefers will create the highest neurological signal strength, causing that pair to be selected.
[0068] Although an individual believes that they are consciously "choosing" one of the word-pairs, in reality, it is the electrochemical process within the brain that applies certain rules and controls the response.
[0069] In certain embodiments of the invention, the stimuli are word-pairs to be selected by the subject. The words used in the word-pairs are derived from descriptive words attributed to specific phases found in the success/satisfaction cycle derived from the Gestalt Framework and in the descriptors of significant brain processes. The term "success/satisfaction cycle" refers to a process by which a subject completes or processes a task, for example. The success/satisfaction cycle may include a plurality of phases through which a task is processed by the subject. The processing may be in sequential order or may be in parallel. The success/satisfaction cycle had its origin in the systematic approach to the development and application of the Gestalt Figure-Ground model as it relates to the organization of individual and group experiences. Edwin C. Nevis' book entitled Organizational Consulting: A Gestalt Approach (Gardner Press, Incorporated; (December 1, 1987)) was the model and foundation for which the success/satisfaction cycle was derived from the Gestalt Cycle of Experience. Figure 1 diagrammatically illustrates the Gestalt Cycle of Experience 100, and Figure 2 illustrates success/satisfaction cycle 200.
[0070] In illustrated embodiments of the present invention, the success/satisfaction cycle assesses a subject's experience through five phases of the success/satisfaction cycle: strategize, motivate, analyze, activate, and assess. Accordingly, the term "phase" refers Io a discrete component of the success/satisfaction cycle, as illustrated for example in Figure 2. Similarly, the term "phase in a success/satisfaction cycle" refers to a discrete component of the success/satisfaction cycle, as illustrated for example in Figure 2. In certain embodiments, the term "dynamic" is used synonymously with the term "phase" in referring to the success/satisfaction cycle. In certain embodiments, the cycle is envisaged as a linear sequence of dynamics in the order explore, excite, examine, and execute, wherein the execute and explore dynamics are connected by the "evaluate" dynamic.
[0071 J The names of the phases of the success/satisfaction cycle are alternatively named within the art. Such alternative names can describe a characteristic category of the phase. For example, without limitation, the strategize phase may also be known as the "synthesize" or "explore" phase or dynamic; the motivate phase may also be known as the "interactive" or "excite" phase or dynamic; the analyze phase may also be known as the "analytical," "articulate," or "examine" phase or dynamic; the activate phase may also be known as the "conclude" or "execute" phase or dynamic, and the assess phase may also be known as the "evaluate" phase or dynamic. Furthermore, the phases can be referred to by reference to one who performs the function of the phase. For example, without limitation, the strategize phase can be referenced by the terms "strategizer," "synthesizer," " articulator," or "explorer;" the motivate phase can be referenced by the terms "motivator," "interactor," or "excitor;" the analyze phase can be referenced by the terms "analyzer" or "examiner;" and the activate phase can be referenced by the term "concluder."
[0072] Each assess (e.g., evaluate) phase of the success/satisfaction cycle has two parts to it: success and satisfaction. The process of measurement within this phase is different for each individual or group and may be based on many factors (e.g., cultural, educational, timelines for completion, past experiences with this specific process, etc.). Some subjects may place more emphasis on the external process measurements of success and others on the internal measurement of satisfaction, for example. [0073] Each phase has a characteristic level of energy, focus or time associated with it for each subject. In some embodiments, the characteristic level of energy is represented by a numeric value score. These levels vary from subject to subject, but are generally robust for the same subject. In certain embodiments, the levels of energy are divided into four categories in descending order and exemplarily named, without limitation, energy: predominant, preferred, select and stress/avoid. A phase categorized as "predominant" dominates the subject's process. Most time and energy is spent in this phase, while other phases of the cycle are given little credence or are ignored, and moving the subject to other phases of the cycle can be difficult and sometimes stressful for associates or colleagues. A phase that is categorized as "preferred" is used often, naturally and most comfortably. This phase operates at the lowest stress, both for the subject and for those around the subject. A phase categorized as "select" can be consciously engaged by the individual to adapt to a particular task or relationship. The subject can spend long periods of time in this phase of select intensity and not become stressed. Extended time spent in a phase categorized as "stress/avoid" can cause stress to the subject and usually is avoided by the subject when possible. This phase can be engaged for limited periods of time, but will lead to stress effects and exhaustion.
[0074] In will be understood by those of skill in the art that multiple terms describe the characteristic energy levels of the phases of the success/satisfaction cycle as described herein. As an example, without limitation, the term "extreme" may be used synonymously with "predominant," "effortless" with "preferred," "deliberate" with "select," and "stress" with "stress/avoid."
[0075] Associated with each characteristic energy level is a preference for the amount of time which a subject would naturally prefer to spend on a task or project. The term "focused energy" refers to the level of energy which a subject would naturally prefer to spend on a task or project. In this context, the extreme, effortless, deliberate, and stress energy levels may be associated, without limitation, with the terms "prolonged," "appropriate," "short," and "too much/too little," respectively. [0076] The terms "process profile," "process style," and "process map," all of which can be used interchangeably and without limiation, refer to the data forming an assessment, i.e., to the natural levels of energy, as described herein, which a subject can bring to bear on the accomplishment of a task. That is, a process map is a description of the energy, focus, or time which is associated in a subject with each phase of the Gestalt success/satisfaction cycle as illustrated in Figure 2. Similarly, the term "ideal process profile," "ideal process style," and "ideal process map" refer to an idealized process profile as described herein.
[0077] As understood of those of skill in the art, individuals within a team fulfill different roles, which roles have characteristic names, for example, without limitation, "leader", "member", "facilitator", "scribe", "liaison", and "energizer". A team leader provides guidance for the team, performs administrative duties, and ensures that good team practices are followed, wherein "good" in this context refers to the eventual successful completion of tasks assigned to the team, and "practices" refers to the means by which specific goals are achieved. A team member works with other individuals within a team to accomplish the team mission while following good team practices. A team facilitator helps accomplish team goals as needed, is a teacher and builder of consensus within the team, is a problem solver and conflict-resolver, and is an expert in the means by which the team accomplishes its goal. The facilitator looks at the group, perceives problems, and identifies routes by which problems can be circumvented. The scribe records the minutes of team meetings, reconstructs the meeting in written form, submits the written minutes for review, and distributes the minutes. The liaison serves as the point of contact with other entities, for example, without limitation, other teams, management, and entities external to the organization of which the team is part. The energizer fulfills the role of liaison, and provides additional motivation and positive energy focus for the team and its members.
10078] A diverse, high respect team, wherein "diverse" refers to the breadth of ability of the team taken as a whole, and "high respect" is a subjective designation assigned to the team by external entities including, without limitation, other teams, management, and entities external to the organization of which the subject team is a member, is well described by the overlay of the process maps of the individual constituents of the team. The assessments provided by the instant invention for individual team constituents are viewed as a process map, exemplified, for example, by Figure 2. Accordingly, the overlay of the individual process maps (i.e., the "team process map") of the constituents of the team represents the process map of the team taken as a whole, i.e., the "team assessment". In full view of the individual process maps of the team constituents, roles (e.g., leader, facilitator, scribe, or liaison/energizer) for each team member can be recommended. Furthermore, gaps in the team process map become apparent to team members and supervision. The appreciation of such gaps guide the addition or subtraction of team members to optimize the constituents of the team, and hence, the effectiveness of the team as a whole.
[0079] Figure 3 illustrates a table 300 of exemplary sets of word-pairs for use with embodiments of the present invention. The table 300 comprises six sets of word- pairs, but additional sets may also be provided, for example Figure 6. When a set is presented to the subject, the set may be selected according to a predetermined order or randomly from the available sets. In certain embodiments, each set includes a word- pair for each of the four phases in the success/satisfaction cycle. In other embodiments, additional categories or phases may be included and be provided with a word-pair for each set.
[0080] Figure 4 is a flow chart illustrating an exemplary assessment method according to certain embodiments of the invention. The method 400 begins with the presentation of a set of stimuli to the subject (block 410). The presentation may be physical, electronic or verbal. The stimuli may include photographs, diagrams, sketches or other vehicles. In particular embodiments, the stimuli are word-pairs. The set of stimuli includes two or more stimuli for selection by the subject. In the exemplary embodiment described below with reference to Figures 3 and 5A, each set includes four word-pairs.
[0081] At block 420, a query is presented to the subject. Again, the presentation may be physical, electronic or verbal. Furthermore, the presentation of the query and the presentation of the set of stimuli may be simultaneous or reversed in order. The query is designed to elicit a selection by the subject of one stimulus from the set of stimuli (block 430).
[0082] At block 440, a determination is made as to whether additional selections are required from the subject from the set of stimuli. If the determination is made that additional selections are required, the method 400 returns to block 420. For example, in the exemplary embodiment with four word-pairs in the set of stimuli, after the subject selects one stimulus, additional selections may be required to determine a relative ordering of the remaining stimuli. On the other hand, if the determination is made that no additional selections are required, the method 400 continues to block 450. For example, in the exemplary embodiment with four word-pairs in the set of stimuli, after repeated selections, a single stimulus may remain unselected. Thus, no additional selection is required for ordering.
[0083J At block 450, a determination is made as to whether an additional set is to be presented to the subject. If the determination is made that an additional set is to be presented, the method 400 returns to block 410 and presents a new set of stimuli to the subject. In certain embodiments, additional confidence in the final stack order may be achieved by processing of multiple sets of stimuli. In one embodiment, the method 400 includes processing two sets of stimuli. In another embodiment, three or more sets of stimuli are processed for each subject.
[0084] If a determination is made at block 450 that no additional sets are to be presented, the method 400 proceeds to block 460, and a stack order is determined for the subject. A stack order is indicative of the assessment of the subject. The method 400 then terminates at block 470. In the exemplary embodiment described above, the stack order is indicative of the relative ordering of the various categories or phases of the success/satisfaction cycle. In the case of a single set of stimuli presented to the subject, the stack order may be a direct mapping of the word-pair selections. In the case of multiple sets of stimuli presented to the subject, a scoring method may be used to determine an overall stack order. [0085] Figures 5A-5C are screen shots that may be presented to the subject on, for example, the user device 510 of Figure 5 by the web server 520. Figure 5A includes the initial presentation of a set of stimuli including four word-pairs, each corresponding to a category or phase of the success/satisfaction cycle. The illustrated set of stimuli corresponds to Set number 6 in the table 300 of Figure 3. Along with the set of stimuli, a query asks the subject to select the word-pair which most accurately describes the subject. Upon selection by the subject of one of the word- pairs, the screen is updated to the screen shot illustrated in Figure 5B. In this case, the user has selected the word-pair "Punctual, objective", which corresponds to the analytical phase. Thus, the analytical phase is placed at the top of the stack order.
[0086] As illustrated in Figure 5B, the subject is then presented with the remaining stimuli in the set, along with a query asking the subject to select, from the remaining stimuli, the word-pair which is least accurately describes the subject. Upon selection by the subject of one of the remaining word -pairs, the screen is updated to the screen shot illustrated in Figure 5C. In this case, the user has selected the word-pair "Conceptual, aware-of-feeling", which corresponds to the strategize phase. Thus, the strategize phase is placed at the bottom of the stack order.
[0087] Finally, the subject is presented with the remaining two word-pairs and a query to complete the stack order, as illustrated in Figure 5C. The query asks the subject to select the word-pair which more accurately describes the subject. The phase corresponding to the word-pair selected by the subject is placed second on the stack order, with the category or phase corresponding to the non-selected word-pair being placed third.
[0088] The exemplary assessment illustrated in Figure 5A-5C is achieved with a single set of stimuli and a mere three clicks or selections by the subject. Thus, an assessment can be obtained in a rapid manner. For additional confidence in the assessment, the process of Figures 5A-5C may be repeated with additional sets of stimuli, each set requiring only three additional clicks by the subject. [0089] Figure 6 illustrates another exemplary table of stimuli to be presented to a subject as part of an assessment.
[0090] In the illustrated embodiment, each stimulus is a word-pair corresponding to a characteristic category. The embodiment illustrated in Figure 6 includes four characteristic categories. In other embodiments, more or fewer categories may be used. Each category refers to a characteristic, a phase or other feature of a subject or an assessment, and each characteristic category may correspond to a characteristic or feature associated with an emotional, physical, biological and/or intelligence characteristic, for example. In the illustrated embodiment, each characteristic category corresponds to a phase of the success/satisfaction cycle of Figure 2.
[0091] Referring to Figure 7, a method of assessing a subject according to certain embodiments of the invention is illustrated. The method 700 begins with the selection of a stimulus in real time. The stimulus may be selected from a list, a table or a database, for example. The selection of the stimulus may be completely or partially random. For example, with reference to Figure 6, a selection may be completely random by selecting any word-pair in any of the four categories, or may be partially random by selecting a word-pair from a selected category, such as the "SYNTHESIZER" category.
[0092] In other categories, the selection of the stimulus may be guided by information relating to the subject and/or the client with which the subject is associated. Such information may be obtained from the user database 1040 of Figure 10. For example, the information obtained from the user database 1040 may indicate that the subject has already been assessed and may include the specific stimuli presented to the subject. Accordingly, the selection of the stimuli at block 710 of Figure 7 may be guided to avoid the stimuli already presented to the present subject.
[0093] The stimulus may be any device, such as photos, images, graphics, sketches or the like, selected to elicit a response from the subject. In one embodiment, each stimulus is a word-pair, such as the word-pairs illustrated in Figure 6. [0094] The selection of the stimulus in real time is facilitated by implementing the assessment as a computer-based method.
[0095] Referring again to Figure 7, at block 720 the selected stimulus is presented to the subject. In this regard, the stimulus may be presented by displaying the stimulus as graphics, text, audio, video, or the like. The display may include the use of a computer or other electronic device by the subject, such as a standalone or a networked computer. In certain embodiments, the communication resulting in display is conducted through a communication network, such as the Internet. In being presented the stimulus, the subject may be asked to respond to the stimulus to indicate a preference or a selection. The required response may be either a "yes" or a "no" to a query such as "DOES THIS WORD-PAIR DESCRIBE YOU?" In other embodiments, the response may be a number between two extremes, for example, 0- 100, 0-10, 1-10, 1-5. For example, the query may be "ON A SCALE OF 1 TO 10, THE LEVEL AT WHICH THIS WORD-PAIR DESCRIBES YOU?" In still another embodiment, the query may ask the subject to select an option from a choice of options. For example, the query may be "PLEASE SELECT ONE OF THE FOLLOWING TO INDICATE HOW WELL THIS WORD-PAIR DESCRIBES YOU," and the subject may be presented with the following options: "STRONGLY AGREE," "AGREE," "NEUTRAL," "DISAGREE," and "STRONGLY DISAGREE."
[0096] At block 730, the response from the subject is received. In this regard, a signal or an input may be acquired from the subject.
[0097] At block 740, a determination is made as to whether an additional stimulus is to be presented to the subject. The assessment may require a minimum number of stimuli to be presented for each characteristic category, for example. In this regard, if a sufficient number of stimuli has not been presented, the method 700 returns to block 710 to select another stimulus to be presented. In certain embodiments, as illustrated by block 750, a characteristic category for the next stimulus may be selected to facilitate a complete assessment. [0098] Alternatively, if the determination is made at block 740 that no more stimuli are required for the assessment, the method 700 proceeds to block 760, and an assessment of the subject is determined. In this regard, responses of the subject to the stimuli presented may be evaluated. In one embodiment, a scoring method may be used to determine an overall stack order for the subject. For example, each "STRONGLY AGREE" response may be assigned five points, an "AGREE" response assigned four points, etc. The numeric value score for each characteristic category may determine the position of that category in the stack order. A stack order is indicative of the assessment of the subject. In the exemplary embodiment described above, the stack order is indicative of the relative ordering of the various categories or phases of the success/satisfaction cycle.
Ϊ0099] At block 770, a determination may be made as to whether a refinement of the stack order is required with respect to two or more characteristic categories. For example, the assessment may require a minimum difference (i.e., refinement criterion) in the numeric value scores to distinguish between two categories and, if the numeric value scores of two categories differ by less than that required minimum, a refinement may be required to accurately determine their respective positions in the stack order.
[0100] In certain embodiments, the numeric value score for each characteristic category is calculated by assigning a weight to each stimulus (e.g., word-pair of Figure 6,) accumulating the weights as the assessment is conducted, and finally presenting the accumulated weights as the numeric value score for each characteristic category. In some embodiments, equal weight (i.e., 1 point) is accorded to each stimulus. In other embodiments, variable weight is afforded each word-pair. In one embodiment, the word-pairs below line "A" of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line "A" are accorded a lower value. In another embodiment, the word-pairs below line "B" of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line "B" are accorded a lower value. In another embodiment, the word-pairs below line "C" of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line "C" are accorded a lower value. In another embodiment, the word-pairs below line "D" of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line "D" are accorded a lower value. In another embodiment, the word-pairs below line "E" of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line "E" are accorded a lower value. In another embodiment, the word-pairs below line "F" of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line "F" are accorded a lower value. In another embodiment, the word-pairs below line "G" of Figure 6 are accorded a value greater than 1, e.g., 2, 3, 4, 5, 6, 7, 8, 9, or 10, while word-pairs above line "G" are accorded a lower value.
[0101] If the determination is made at block 770 that no refinement is required, the process 700 proceeds to block 790 to generate an assessment report. With reference to Figure 1 1 , the report may be generated by a report generator 1150 based on the responses to the stimuli and the determination of the assessment for the subject in block 760 of Figure 7. The method 700 then terminates at block 799.
[0102] On the other hand, if the determination is made at block 770 that a refinement is required, the process 700 proceeds to block 780 to perform a refinement. Once the refinement is completed, the method 700 returns to block 760 to again determine the assessment of the subject.
[0103] The refinement required by the determination at block 770 may be performed in a variety of manners. Two refinement methods according to embodiments of the invention are illustrated in Figures 8 and 9, described below.
[0104] One embodiment of the refinement method 780a illustrated in Figure 8 begins with the determination of the categories to be refined at block 810. In this regard, the categories may be received from the assessment determined at block 760 of Figure 7, for example. Refinement may be required between any number of the categories, including two categories, three categories or four categories in the above- illustrated example with four characteristic categories of the assessment. [0105] At block 820, stimuli are selected from the categories to be refined. In this regard, the stimuli may be selected, for example, from the table of stimuli illustrated in Figure 6 or from another database. In blocks 830 and 840, the stimuli are presented to the subject, and responses are received. Blocks 820, 830 and 840 are illustrated in Figure 8 as being performed in batch form (i.e., all stimuli are first selected, then presented and all responses received). However, it is also contemplated that the functions of these blocks may be performed for one stimulus at a time, and the blocks repeated for each stimulus.
[0106J At block 850, an assessment of the subject is determined for the categories to be refined as a sub-assessment. In this regard, the assessment may be determined using the same or a different scoring method as the determination of an assessment at block 760 of Figure 7.
[0107] Referring again to Figure 8, at block 860, a determination is made as to whether a refinement criterion has been satisfied. The refinement criterion may require a certain differential (i.e., required minimum) in the numeric value scores for the categories to be refined, for example, similar to the minimum differential required at block 770 of Figure 7. The differential may be a fixed value of may be a function of the number of stimuli presented in the refinement method 780a, for example.
[0108] If the determination is made at block 860 that the refinement criterion is not satisfied, the method 780a returns to block 820, and additional stimuli are selected from the categories to be refined. This process may be repeated as often as necessary to satisfy the refinement criterion. It is noted that with increasing number of stimuli presented, the accuracy of the assessment increases.
[0109] On the other hand, if the determination is made at block 860 that the refinement criterion has been satisfied, the method 780a proceeds to block 899, and the results of the refinement are returned to the method 700 of Figure 7.
[0110] Figure 9 is a flow chart illustrating another exemplary refinement method according to an embodiment of the invention. The method 780b begins with the electronic presentation of a set of stimuli to the subject (block 910). The stimuli may include photographs, diagrams, sketches or other vehicles. In particular embodiments, the stimuli are word-pairs. The set of stimuli includes two or more stimuli for selection by the subject. In the exemplary embodiment described below with reference to Figures 3 and 5A, each set includes four word-pairs.
[0111] At block 920, a query is presented to the subject. The presentation of the query and the presentation of the set of stimuli may be simultaneous or reversed in order. The query is designed to elicit a selection by the subject of one stimulus from the set of stimuli (block 930).
[0112] At block 940, a determination is made as to whether additional selections are required from the subject from the set of stimuli. If the determination is made that additional selections are required, the method 780b returns to block 920. For example, in the exemplary embodiment with four word-pairs in the set of stimuli, after the subject selects one stimulus, additional selections may be required to determine a relative ordering of the remaining stimuli. On the other hand, if the determination is made that no additional selections are required, the method 780b continues to block 950. For example, in the exemplary embodiment with four word- pairs in the set of stimuli, after repeated selections, a single stimulus may remain unselected. Thus, no additional selection is required for ordering.
[0113] At block 950, the assessment of the subject for the categories to be refined is determined. The determination of the assessment may include determining a stack order for the subject. A stack order is indicative of the assessment of the subject. In the exemplary embodiment described above, the stack order is indicative of the relative ordering of the various categories or phases of the success/satisfaction cycle. In the case of a single set of stimuli presented to the subject, the stack order may be a direct mapping of the word-pair selections. Thus, if a refinement was required between "INT ERACTOR" and "CONCLUDER" categories, the relative placement of those categories in the stack order may be used as the assessment of the subject for those categories. [0114] At block 960, a determination is made as to whether a refinement criterion has been satisfied. The refinement criterion may require a certain relative placement of the categories to be refined in the stack order or a reproducibility of a relative placement in consecutive stack orders, for example. In one embodiment, the refinement criterion may require that the categories to be refined be in the same relative placement in two consecutive stack orders. For example, if a refinement was required between "INTERACTOR" and "CONCLUDER" categories, the refinement criterion may be satisfied if the "INTERACTOR" category places higher than the "CONCLUDER" category in three consecutive stack orders.
[0115] If the determination is made at block 960 that the refinement criterion has not been satisfied, the method 780b returns to block 910, and an additional set of stimuli is presented. On the other hand, if the refinement criterion is determined to have been satisfied at block 960, method 780b proceeds to block 999 and returns to block 760 of Figure 7.
[0116] In certain embodiments, the set of stimuli of the invention maybe presented to a subject on a remote computer by a web server. One such system is illustrated in Figure 10. The system 1000 includes a user device 1010 adapted to communicate with a web server 1020 through a communication network 1030. The user device may be any of a variety of devices, such as a desktop or a laptop computer. In other embodiments, the user device 1010 may be a portable or wireless device such as a wireless phone, a personal digital assistant (PDA) or other handheld device.
[0117] The web server 1020 may be any computing device provided with server software, for example. Thus, the user device 1010 and the web server 1020 may communicate via a server-client relationship. The web server 1020 may be provided with software adapted to present the user device 1010 with the stimuli and the queries for display on a monitor connected to or part of the user device 1010.
[0118] The communication between the user device 1010 and the web server 1020 may be facilitated via a direct link. In the illustrated embodiment, the user device 1010 and the web server 1020 communicate through a communication network 1030. The communication network 1030 may be private or public. In one embodiment, the communication network 1030 is the public switched telephone network (PSTN). In another embodiment, the communication network 1030 is a network of computers, such as the Internet. In one embodiment, the communication between the user device 1010 and the web server 1020 is encrypted by means well known in the art, for example, secure hypertext transfer protocol.
[0119] Thus, Figure 10 provides a front-end system 1000 for allowing a subject to access the assessment software through the web server 1020. Figure 11 illustrates a complementary back-end system 1100 for conducting the assessment of the subject. The back-end system 1100 includes an assessment engine 1110 for controlling the administration of the assessment. The assessment engine 1 1 10 includes the software for administration and evaluation of the assessment. Components of the software are exemplarily illustrated in Figures 7-9 and are described herein in greater detail.
[0120] The back-end system 1 100 includes a user interface 1120 for providing an interface through which the subject can interact with the assessment engine 1110. The user interface 1 120 may be adapted to present the subject with a graphical user interface on the user device 1010 of Figure 10. The user interface 1120 may be adapted to provide graphics, text, data, audio or video data to the subject and may be adapted to receive input from the user through one or more input devices, such as a keyboard, mouse, microphone or camera, for example.
[0121] Figure 1 1 illustrates a two-way communication link between the web server 1020 and the assessment engine 1110. Such communication link may be direct, indirect or through a network. The back-end system 1100 includes a stimulus database 1 130 for storing stimuli to be presented to the subject. The stimulus database 1130 may include stimuli in the form of a table, list or a database. Further, the stimulus database 1130 may be adapted to be updated or modified through an administrator input, for example. Such updates or modifications may be necessary to include additional stimuli or to delete existing stimuli. [0122] A user database 1 140 is provided to store information relating to subjects or clients. In this regard, the subjects may include individuals, groups of individuals or entities. Similarly, clients may include individuals, groups of individuals or entities, such as a company. Each client may be associated with one or more subjects. The database may include information relating to subjects or clients that have been assessed or have registered for an assessment, for example.
[0123] The back-end system 1100 may also include a report generator 1 150. The report generator 1150 is adapted to receive the assessment results or the raw responses from the subject and to generate an assessment report tailored for the subject and/or the client, for example. The report may include text, graphics or other forms of information related to the assessment. In one embodiment, subject material provided by the report generator is identified by comparing the assessment results from the subject to a library of subject material referenced by characteristic energy levels of the phases of the success/satisfaction cycle.
[0124] It will be understood by those skilled in the art that the various modules illustrated in Figure 11, including the assessment engine 1 110, the user interface 1120, and the report generator 1150 may be implemented in a single software module or may be further separated into additional sub-modules. Further the various modules may be implemented as software, hardware or firmware. Further, the stimulus database 1130 and the user database 1 140 may be implemented as lists, tables or databases, for example, and may be stored on various memory devices well known in the art.
[0125] In another aspect of the invention, the assessment of a subject may incorporate the time it takes for the subject to respond to a stimulus. In this regard, the system (e.g., server administrating the assessment) may measure the elapsed time between the presentation of the stimulus and receipt of a response from the subject. The elapsed time may be of interest as it may reflect the accuracy of the response. For example, a short elapsed time may indicate the subject was very confident of the response, while a longer elapsed time may indicate a lower level of confidence. [0126] The elapsed time may be incorporated into the assessment in numerous ways. For example, in one embodiment, once the subject has completed responding to all assessment stimuli, the elapsed time for each response may be compared to the mean elapsed time for all responses by the subject. In this manner, the elapsed time factor is normalized to account for any issues related to the ability of the subject to respond to stimuli quicker or slower.
[0127] In another embodiment, a value may be assigned to each response, and the value may be influenced by the elapsed time for that response. For example, the value may be determined by applying a multiplier to a base value for that response, the multiplier being dependent on the elapsed time. In one embodiment, the multiplier is between 0 and 1. For shorter elapsed times, the multiplier will be close to 1, while for longer elapsed times, the multiplier will be close to 0. In this regard, responses with lower confidence are substantially reduced in importance, while responses with higher confidence are weighted accordingly.
[0128] A statistical analysis may then be performed to determine the assessment. The statistical analysis may be performed on the values of the responses to determine the assessment or on the elapsed times for each response.
[0129] Once the assessment has been determined, the server administering the assessment may access a database of narratives corresponding to various assessments. The narrative corresponding to the determined assessment for the subject is then selected and may be stored in memory, displayed to the subject or sent to another individual or entity through, for example, electronic mail.
[0130] In another aspect, embodiments of the present invention can provide an assessment of a relationship between two or more individuals. For example, the interaction between a husband and a wife may be assessed based on assessments of the individuals. In this regard, a variety of relationships may be addressed. In addition to spouses, for example, the relationship may be of two or more partners in a business venture, a coach and a student, or any number of other relationships. Further, this relationship assessment may be applied for specific environments for the roles. For example, a relationship assessment may be provided for a husband and a wife in a romantic environment (as a couple) or in a business environment (business partners).
[0131] In this regard, two or more subjects may be presented with an assessment as described above. Specifically, each subject is presented with a set of two or more stimuli, as shown in Figures 5A-C. The subject makes his selection, and the response is received by the server administering the assessment, for example. This is repeated with additional stimuli for the subject until assessments for the subject can be determined in one or more characteristic categories, or phases. The same is done for each other subject.
[0132] Now, cartelistic category assessments have been determined for each subject. For example, in the case of two subjects, Subject A and Subject B, it may be determined that Subject A is:
Strategize phase: Predominant
Motivate phase: High Select
Analyze phase: Preferred
Activate phase: High Select
Meanwhile, Subject B has been determined to be: Strategize phase: Predominant Motivate phase: Low Select
Analyze phase: Preferred
Activate phase: Stressed
[0133] Based on these characteristic category assessments, the administering server accesses a database containing dyads and corresponding narratives. An exemplary chart of dyads is illustrated in Figure 12. The chart 1200 lists a partial list of dyads for two-party relationships. It will be understood by those skilled in the art that such dyads may be adaptable for relationships involving any number of parties. Further, the term "dyad" is used herein in a generic manner to refer to a set of descriptors for two or more parties.
[0134] Referring now to Figure 12, the chart 1200 includes a list of dyads, such as dyad 1210, each dyad containing two descriptors 1212, 1214. Each descriptor includes four position slots, each corresponding to a different characteristic category. For example, in the chart illustrated in Figure 12, the first set of dyads 1202 corresponds to the Strategy phase and, accordingly, each descriptor includes an entry in the first slot. Similarly, the second set of dyads 1204 corresponds to the Motivate phase and, accordingly, each descriptor includes an entry in the second slot. The third set of dyads 1206 corresponds to the Analyze phase, and the fourth set of dyads 1208 corresponds to the Activate phase.
[0135] In the embodiment illustrated in Figure 12, only one slot in each dyad descriptor is provided with an entry, while the other three are blank. In this manner, the relationship assessment of the relationship between the subjects is assessed using a single characteristic category assessment at a time. As those skilled in the art will understand, and as is contemplated within the scope of the present invention, a multidimensional assessment may be done through analysis of two or more characteristic categories at a time.
[0136] Referring again to the example of Subject A and Subject B, their characteristic category assessments can be used to select a dyad for each of the four characteristic category. With the above-described characteristic category assessments, the dyads 1222, 1224, 1226, 1228 are selected. In the database, each dyad corresponds to a narrative developed by experts. The appropriate narratives for each characteristic category can be retrieved from the database and output to the subjects, a manager or any other entity. Alternatively, they may be stored for future reference.
[0137] The narratives for the relationships provide role-specific, environment- specific descriptions of the assessments. In this regard, the database may contain separate dyads for different relationships. For example, one set of dyads may be appropriate for a manager-employee relationship, while another set may be appropriate for a mentor-mentee relationship.
[0138] The foregoing description of embodiments of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed, and modifications and variation are possible in light of the above teachings or may be acquired from practice of the invention. The embodiments were chosen and described in order to explain the principles of the invention and its practical application to enable one skilled in the art to utilize the invention in various embodiments and with various modification as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the claims appended hereto and their equivalents.

Claims

WHAT IS CLAIMED IS:
1. A system for conducting an assessment of a subject, comprising: a server adapted to present to a subject at least one stimulus and to receive a response by said subject to each said stimulus presented, wherein said at least one stimulus is selected in real time and corresponds to a characteristic category; and said server being further adapted to determine an assessment of said subject based on said responses; wherein said assessment is determined based at least partly on elapsed time for said responses.
2. The system according to Claim 1, wherein said assessment is determined based on comparison of elapsed time for each response to a mean elapsed time for all responses from the subject.
3. The system according to Claim 1, wherein said server is adapted to assign a value to each response based on the elapsed time for that response.
4. The system according to Claim 3, wherein said value is determined by applying a multiplier to a base value, the multiplier being dependent on the elapsed time.
5. The system according to Claim 4, wherein said server is adapted to perform a statistical analysis on the values of the responses to determine the assessment.
6. The system according to Claim 3, wherein said server is adapted to perform a statistical analysis on the values of the responses to determine the assessment.
7. The system according to Claim 1, wherein said server is adapted to perform a statistical analysis on the elapsed times of the responses to determine the assessment.
8. The system according to Claim 1, wherein each stimulus comprises a word- pair.
9. The system according to claim 1, further comprising: a database of narratives corresponding to one or more assessments, wherein said server is adapted to output a narrative from the database corresponding to the assessment determined.
10. A method of conducting an assessment of a subject, said method comprising: a) presenting to a subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category; c) repeating steps a) and b) as necessary with additional sets of stimuli; and d) outputting an assessment of the subject based on said responses, wherein said assessment is determined based at least partly on elapsed time for said responses.
11. The method according to Claim 10, wherein said assessment is determined based on comparison of elapsed time for each response to a mean elapsed time for all responses from the subject.
12. The method according to Claim 10, further comprising: assigning a value to each response based on the elapsed time for that response.
13. The method according to Claim 12, wherein said value is determined by applying a multiplier to a base value, the multiplier being dependent on the elapsed time.
14. The method according to Claim 13, wherein the assessment is determined by performing a statistical analysis on the values of the responses to determine the assessment.
15. The method according to Claim 12, wherein the assessment is determined by performing a statistical analysis on the values of the responses to determine the assessment.
16. The method according to Claim 10, wherein the assessment is determined by performing a statistical analysis on the elapsed times of the responses to determine the assessment.
17. The method according to Claim 10, wherein each stimulus comprises a word- pair.
18. The method according to claim 10, wherein the outputting an assessment comprises: selecting a narrative from a database of narratives corresponding to the assessment determined; and outputting the selected narrative.
19. A program product, comprising machine readable program code for causing a machine to perform the following method steps: a) presenting to a subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category; c) repeating steps a) and b) as necessary with additional sets of stimuli; and d) outputting an assessment of the subject based on said responses, wherein said assessment is determined based at least partly on elapsed time for said responses.
20. The program product according to Claim 19, wherein said assessment is determined based on comparison of elapsed time for each response to a mean elapsed time for all responses from the subject.
21. The program product according to Claim 19, further comprising machine readable program code for causing a machine to perform the following method step: assigning a value to each response based on the elapsed time for that response.
22. The program product according to Claim 21, wherein said value is determined by applying a multiplier to a base value, the multiplier being dependent on the elapsed time.
23. The program product according to Claim 22, wherein the assessment is determined by performing a statistical analysis on the values of the responses to determine the assessment.
24. The program product according to Claim 21, wherein the assessment is determined by performing a statistical analysis on the values of the responses to determine the assessment.
25. The program product according to Claim 19, wherein the assessment is determined by performing a statistical analysis on the elapsed times of the responses to determine the assessment.
26. The program product according to Claim 19, wherein each stimulus comprises a word-pair.
27. The program product according to claim 19, wherein the machine readable program code for causing a machine to perform the outputting an assessment comprises machine readable program code for causing a machine to perform the following steps: selecting a narrative from a database of narratives corresponding to the assessment determined; and outputting the selected narrative.
28. A system for conducting a relationship assessment of two or more subjects, comprising: a server adapted to present to each subject at least one stimulus and to receive a response by each subject to each stimulus presented, wherein said at least one stimulus is selected in real time and corresponds to a characteristic category, said server being further adapted to determine a characteristic category assessment of each subject based on said responses for one or more characteristic categories; and a database of dyads, each dyad based on a characteristic category assessment of each subject and corresponding to a relationship assessment of a relationship between the subjects.
29. The system according to Claim 28, wherein each stimulus comprises a word- pair.
30. The system according to Claim 28, wherein the database of dyads includes narratives corresponding to one or more relationship assessments, and wherein said server is adapted to output a narrative from the database corresponding to the relationship assessment.
31. The system according to Claim 28, wherein each dyad includes a characteristic category assessment for at least one of the following characteristic categories: strategize, motivate, analyze and activate.
32. A method of conducting a relationship assessment of two or more subjects, said method comprising: a) presenting to a subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category; c) repeating steps a) and b) as necessary with additional sets of stimuli; d) determining a characteristic category assessment of the subject based on said responses for one or more characteristic categories; e) repeating steps a)-d) for each remaining subject; and f) outputting a relationship assessment of a relationship between the subjects based on the characteristic category assessments determined for each subject.
33. The method according to Claim 32, wherein each stimulus comprises a word- pair.
34. The method according to Claim 32, wherein the outputting a relationship assessment comprises: selecting a dyad from a database of dyads including narratives corresponding to one or more relationship assessments, and outputting a narrative from the database corresponding to the relationship assessment.
35. The method according to Claim 34, wherein each dyad includes a characteristic category assessment for at least one of the following characteristic categories: strategize, motivate, analyze and activate.
36. A program product, comprising machine readable program code for causing a machine to perform the following method steps: a) presenting to a subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category; c) repeating steps a) and b) as necessary with additional sets of stimuli; d) determining a characteristic category assessment of the subject based on said responses for one or more characteristic categories; e) repeating steps a)-d) for each remaining subject; and f) outputting a relationship assessment of a relationship between the subjects based on the characteristic category assessments determined for each subject.
37. The program product according to Claim 36, wherein each stimulus comprises a word-pair.
38. The program product according to Claim 36, wherein the machine readable program code for causing a machine to perform the outputting a relationship assessment comprises machine readable program code for causing a machine to perform the following method steps: selecting a dyad from a database of dyads including narratives corresponding to one or more relationship assessments, and outputting a narrative from the database corresponding to the relationship assessment.
39. The program product according to Claim 36, wherein each dyad includes a characteristic category assessment for at least one of the following characteristic categories: strategize, motivate, analyze and activate.
40. A method of conducting an assessment of a subject, comprising: a) presenting to said subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; and b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category.
41. The method according to Claim 40, wherein three or more stimuli are presented in step a).
42. The method according to Claim 40, wherein four or more stimuli are presented in step a).
43. The method according to Claim 40, wherein more than four stimuli are presented in step a).
44. The method according to Claim 40, further comprising preseniing four stimuli in step a), wherein each said different characteristic category corresponds to a different phase in a success/satisfaction cycle.
45. The method according to Claim 40, further comprising presenting an inquiry to said subject in step a), and receiving a selection by said subject in response to said inquiry in step b).
46. The method according to Claim 40, further comprising: c) presenting to said subject a second set of two or more stimuli corresponding to characteristic categories different from said first characteristic category; and d) receiving a selection by said subject of one of said second set of two or more stimuli corresponding to a second characteristic category.
47. The method according to Claim 46, further comprising: e) presenting to said subject a third set of two or more stimuli corresponding to characteristic categories different from said first and second characteristic categories; and f) receiving a selection by said subject of one of said third set of two or more stimuli corresponding to a third characteristic category.
48. The method of Claim 47, further comprising obtaining an order of selection of said characteristic categories.
49. The method according to Claim 48, further comprising repeating steps a) to f) with additional sets of stimuli.
50. The method according to Claim 40, wherein said receiving further comprises a response time criterion.
51. The method according to Claim 50, wherein said response time criterion is in the range 1 -45 seconds.
52. The method according to Claim 40, wherein step a) to b) further comprise communication with said subject through a network.
53. The method according to Claim 52, wherein said network is the Internet.
54. The method according to Claim 40, wherein each stimulus comprises a word- pair.
55. A method of conducting an assessment of a subject, comprising: a) presenting to said subject two to four stimuli and an inquiry, wherein each stimulus corresponds to a phase in a success/satisfaction cycle; b) receiving a selection by said subject of one of said stimuli in response to said inquiry; and c) repeating steps a) and b) until an order of selection of each said phase is determined.
56. The method of Claim 55, further comprising: d) processing said order of selection to determine an assessment of said subject.
57. The method according to Claim 55, wherein each stimulus comprises a word- pair.
58. The method according to Claim 55, wherein said receiving further comprises a response time criterion.
59. The method according to Claim 58, wherein said response time criterion is in the range 1-45 seconds.
60. A program product, comprising machine readable program code for causing a machine to perform the following method steps: a) presenting to said subject a first set of two or more stimuli, wherein at least two of said stimuli correspond to different characteristic categories; and b) receiving a selection by said subject of one of said stimuli corresponding to a first characteristic category.
61. The program product according to Claim 60, further comprising machine readable program code for causing a machine to present four stimuli in step a), wherein each said different characteristic category corresponds to a different phase in a success/satisfaction cycle.
62. The program product according to Claim 60, further comprising machine readable program code for causing a machine to present an inquiry to said subject in step a) , and receive a selection by said subject in response to said inquiry in step b).
63. The program product according to Claim 60, further comprising machine readable program code for causing a machine to perform the following method steps: c) presenting to said subject a second set of two or more stimuli corresponding to characteristic categories different from said first characteristic category; and d) receiving a selection by said subject of one of said second set of two or more stimuli corresponding to a second characteristic category.
64. The program product according to Claim 63, further comprising machine readable program code for causing a machine to perform the following method steps: e) presenting to said subject a third set of two or more stimuli corresponding to characteristic categories different from said first and second characteristic categories; and f) receiving a selection by said subject of one of said third set of two or more stimuli corresponding to a third characteristic category.
65. The program product according to Claim 64, further comprising machine readable program code causing a machine to obtain an order of selection of said characteristic categories.
66. The program product according to Claim 65, further comprising machine readable program code for causing a machine to repeat steps a) to f) with additional sets of stimuli.
67. The program product according to Claim 60, wherein step a) to b) further comprise communication with said subject through a network.
68. The program product according to Claim 67, wherein said network is the Internet.
69. The program product according to Claim 60, wherein each stimulus comprises a word-pair.
70. A program product, comprising machine readable program code for causing a machine to perform the following method steps: a) presenting to said subject two to four stimuli and an inquiry, wherein each stimulus corresponds to a phase in a success/satisfaction cycle; b) receiving a selection by said subject of one of said stimuli in response to said inquiry; and c) repeating steps a) and b) until an order of selection of each said phase is determined.
71. The program product of Claim 70, further comprising machine readable program code for causing a machine to perform the following method step: d) processing said order of selection to determine an assessment of said subject.
72. The program product according to Claim 70, wherein each stimulus comprises a word-pair.
73. A system for conducting an assessment of a subject, comprising: a server adapted to present two or more stimuli to said subject on a computer, each said stimulus corresponding to a different characteristic category; said server being further adapted to receive a selection by said subject of one of said stimuli.
74. The system according to Claim 73, wherein each stimulus comprises a word- pair.
75. A computer-implemented method of evaluating an assessment of a subject, comprising: a) presenting to said subject at least one stimulus, wherein said at least one stimulus is selected in real time and corresponds to a characteristic category; and b) evaluating said assessment of said subject based on a response received from said subject to each said stimulus presented.
76. The method according to Claim 75, wherein step a) further comprises randomly selecting said at least one stimulus from a database of stimuli.
77. The method according to Claim 75, wherein said stimulus is a word-pair.
78. The method according to Claim 75, wherein step a) further comprises formulating an entire assessment by selecting a plurality of stimuli.
79. The method according to Claim 78, wherein said plurality of stimuli comprise at least one stimulus corresponding to each of a plurality of different said characteristic categories.
80. The method according to Claim 75, further comprising: c) determining whether said assessment evaluated in step b) requires refinement between two or more said characteristic categories.
81. The method according to Claim 80, further comprising: d) presenting an additional stimulus corresponding to each of said two or more said characteristic categories.
82. The method according to Claim 81, further comprising: e) repeating steps b) to d) until a desired level of refinement is achieved.
83. The method according to Claim 80, further comprising: d) presenting to said subject two or more stimuli, wherein each stimulus corresponds to a different said characteristic category; e) receiving a selection by said subject of one of said stimuli; and f) repeating steps d) and e) to obtain an order of selection of each said different characteristic categories.
84. The method according to Claim 83, further comprising: g) repeating steps c) to f) until a desired level of refinement is achieved.
85. The method according to Claim 75, wherein said response received from said subject further comprises a response time criterion.
86. The method according to Claim 85, wherein said response time criterion is in the range 1 -45 seconds.
87. A program product, comprising machine readable program code for causing a machine to perform the following method steps: a) presenting, when an assessment of a subject requires refinement between two or more characteristic categories of the assessment, to a subject a first set of three or more stimuli, wherein each stimulus in said first set of three or more stimuli corresponds to a different characteristic category; b) receiving a selection by said subject of one of said stimuli; c) presenting to said subject a second set of two or more stimuli, wherein each stimulus of said second set of two or more stimuli corresponds to a different characteristic category; and d) repeating steps b) and c) to obtain an order of selection of each of the different characteristic categories.
88. A method of conducting an assessment of a team comprised of members, said method comprising: a) providing the process maps of said members of said team; b) overlaying said process maps of said members of said team; and c) assessing said team by providing a process map comprising said overlaid process maps of said members of said team.
89. The method of claim 88, further comprising constructing a process map of a virtual member of said team, said method comprising: d) identifying deficiencies or excesses in each characteristic category of said team assessment; and e) constructing said process map of said virtual member of said team by ascribing to each said characteristic category of said process map of said virtual member of said team a value which compensates for said deficiencies or excesses of said overlaid process maps of said members of said team.
90. The method of claim 89 wherein said virtual member of said team fulfills a specific role or relationship within the team.
91. The method of claim 90, further comprising identifying candidate team members, said method comprising: f) comparing said process map of said virtual member of said team with a plurality of stored assessment data obtained for candidate team members; g) identifying a match between said Virtual team member process map with said stored assessment data; and h) identifying the candidate team member associated with said stored assessment data.
92. A system for conducting an assessment of a subject, comprising: a server adapted to present to a subject at least one stimulus and to receive a response by said subject to each said stimulus presented, wherein said at least one stimulus is selected in real time and corresponds to a characteristic category; and said server being further adapted to determine an assessment of said subject based on said responses.
93. The system according to Claim 92, wherein said server is further adapted to determine whether said assessment requires refinement between two or more of said characteristic categories, and wherein said server is further adapted to present, when said refinement is required, an additional stimulus corresponding to each of said two or more said characteristic categories.
94. A method for coaching a client by a coach, comprising: a) evaluating a client current process map to provide a client evaluation; and b) reciting said client evaluation to said client.
95. The method according to Claim 94, further comprising comparing said client current process map and a coach process map to provide a coach/client evaluation to determine how said client and said coach would naturally prefer to work together.
96. The method according to Claim 95, further comprising reciting to said client said coach/client evaluation.
97. The method according to Claim 95, further comprising reciting to said client changes in the behavior of said client and said coach to improve a coach/client relationship.
98. The method according to Claim 95, further comprising reciting to said client the learning report of said client and the teaching report of said coach.
99. The method according to Claim 98, further comprising reciting to said client changes in said learning style of said client and said teaching style of said coach to achieve more efficient task completion of said client.
100. The method according to Claim 94, further comprising comparing said client current process map and a client aspiration map to provide an ideal client evaluation.
101. The method according to Claim 100, further comprising reciting to said client said ideal client evaluation.
102. The method according to Claim 100, further comprising reciting to said client changes to the behavior of said client to minimize the difference between said client current process map and said client ideal process map.
103. The method according to Claim 94, further comprising comparing said client current process map and a colleague process map to provide a colleague/client evaluation to determine how said client and said colleague prefer to work as a team.
104. The method according to Claim 103, further comprising reciting to said client said colleague/client evaluation.
105. The method according to Claim 103, further comprising reciting to said client changes in the behavior of said client and said colleague to increase success and satisfaction in the fulfillment of a task by said client and said colleague.
106. The method according to Claim 94, further comprising comparing said client current process map and a task/project process map to provide a task/client evaluation.
107. The method according to Claim 106, further comprising reciting to said client said task/client evaluation.
108. The method according to Claim 106, further comprising reciting to said client changes to the behavior of said client to minimize the difference in energy levels between said client current process map and said task/project process map.
109. The method according to Claim 94, further comprising reciting to said client the working preferences of said client.
110. The method according to Claim 94, further comprising reciting to said client the learning preferences of said client.
111. The method according to Claim 94, further comprising visualization of how said client prefers to spend time on a task.
112. The method according to Claim 94, further comprising visualization of how said client prefers to spend focused energy on a task.
113. The method according to Claim 95, further comprising incorporating said client evaluation and said coach/client evaluation within an archive database.
114. The method according to Claim 113, further comprising annotating responses of said coach and said client within an archive database.
115. The method according to Claim 113, further comprising receiving editing feedback by the client prior to entry of said client evaluation into said archive database.
116. The method according to Claim 113, further comprising reviewing said archive database by said coach and said client to identify success and failure in a coach-client relationship.
117. The method according to Claim 115, further comprising repeating steps a) and b) and comparing said client evaluation with said client evaluation within said archive database to provide an updated client evaluation.
118. A program product, comprising machine readable program code for causing a machine to evaluate a client current process map to provide a client evaluation.
119. The program product according to Claim 118, further comprising machine readable program code for causing a machine to compare said client current process map and a coach process map to provide a coach/client evaluation.
120. The program product according to Claim 118, further comprising machine readable program code for causing a machine to compare said client current process map and a client aspiration map to provide an ideal client evaluation.
121. The program product according to Claim 118, further comprising machine readable program code for causing a machine to compare said client current process map and a colleague process map to provide a colleague/client evaluation.
122. The program product according to Claim 118, further comprising machine readable program code for causing a machine to compare said client current process map and a task/project process map to provide a task/client evaluation.
EP07753053A 2006-03-14 2007-03-13 System for and method for psychological assessment Withdrawn EP1993446A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
PCT/US2006/009321 WO2007106089A1 (en) 2006-03-14 2006-03-14 System for and method for psychological assessment
PCT/US2007/006398 WO2007106518A2 (en) 2006-03-14 2007-03-13 System for and method for psychological assessment

Publications (2)

Publication Number Publication Date
EP1993446A2 true EP1993446A2 (en) 2008-11-26
EP1993446A4 EP1993446A4 (en) 2011-01-19

Family

ID=38509792

Family Applications (1)

Application Number Title Priority Date Filing Date
EP07753053A Withdrawn EP1993446A4 (en) 2006-03-14 2007-03-13 System for and method for psychological assessment

Country Status (5)

Country Link
EP (1) EP1993446A4 (en)
JP (1) JP2009530711A (en)
KR (1) KR20090010957A (en)
CN (1) CN101500485A (en)
WO (2) WO2007106089A1 (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11263543B2 (en) 2007-11-02 2022-03-01 Ebay Inc. Node bootstrapping in a social graph
CA2753872C (en) 2009-02-27 2017-09-26 David L. Forbes Methods and systems for assessing psychological characteristics
US9558499B2 (en) 2009-02-27 2017-01-31 The Forbes Consulting Group, Llc Methods and systems for assessing psychological characteristics
RU2012100619A (en) * 2009-06-12 2013-07-27 Ибэй Инк. MACHINE READABLE MEDIA FOR USE IN COLLECTIVE KNOWLEDGE SYSTEMS
US9138186B2 (en) 2010-02-18 2015-09-22 Bank Of America Corporation Systems for inducing change in a performance characteristic
US9767470B2 (en) 2010-02-26 2017-09-19 Forbes Consulting Group, Llc Emotional survey
DK3321355T3 (en) 2011-12-30 2021-11-08 Amit Patel PROCEDURES AND COMPOSITIONS FOR CLINICAL DETERMINATION OF AN ALLOGENIC CELL AND THERAPEUTIC APPLICATIONS
KR101322650B1 (en) * 2012-02-06 2013-10-28 주식회사 비엔알아이 System and method for analyzing attribute of object and media that can record computer program sources for method the same
CN104856704B (en) * 2015-03-31 2018-03-23 鲍崇智 The subjective and objective Psychological Evaluation method and system being combined
CA2988858A1 (en) * 2015-07-01 2017-01-05 Thales Canada Inc. Method for providing team-level metrics data and team state monitoring system
WO2017213278A1 (en) * 2016-06-09 2017-12-14 주식회사 비엔알아이 Attribute analysis system and method for analysis target, and recording medium having, stored thereon, computer program for method
KR102268496B1 (en) * 2018-05-29 2021-06-23 주식회사 제네시스랩 Non-verbal Evaluation Method, System and Computer-readable Medium Based on Machine Learning
CN110464367B (en) * 2019-08-06 2021-11-23 合肥工业大学 Psychological anomaly detection method and system based on multi-channel cooperation

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6334778B1 (en) * 1994-04-26 2002-01-01 Health Hero Network, Inc. Remote psychological diagnosis and monitoring system
US20020192624A1 (en) * 2001-05-11 2002-12-19 Darby David G. System and method of testing cognitive function

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4699153A (en) * 1985-04-23 1987-10-13 The University Of Michigan System for assessing verbal psychobiological correlates
JP3200591B2 (en) * 1998-10-27 2001-08-20 株式会社エイ・ティ・アール知能映像通信研究所 Psychological rating device
IL138955A (en) * 2000-10-11 2007-08-19 Shlomo Lampert Reaction measurement method and system
JP2002229796A (en) * 2001-01-31 2002-08-16 Ntt Comware Corp Common community server and common community service providing method with knowledge information by the server
US20040014016A1 (en) * 2001-07-11 2004-01-22 Howard Popeck Evaluation and assessment system
JP2003044597A (en) * 2001-07-26 2003-02-14 Honda Motor Co Ltd Assistance system for comprehensive learning
JP2003150739A (en) * 2001-11-15 2003-05-23 Wyattract Kk Talented person introduction system
US6754874B1 (en) * 2002-05-31 2004-06-22 Deloitte Development Llc Computer-aided system and method for evaluating employees
US6884078B2 (en) * 2002-09-17 2005-04-26 Harcourt Assessment, Inc. Test of parietal lobe function and associated methods
JP2004110502A (en) * 2002-09-19 2004-04-08 Promotion Co Ltd Method and system for providing analysis result
JP2004151966A (en) * 2002-10-30 2004-05-27 Nec Corp Server, server for community service, its system, service method and its program
US20040210661A1 (en) * 2003-01-14 2004-10-21 Thompson Mark Gregory Systems and methods of profiling, matching and optimizing performance of large networks of individuals
JPWO2005010789A1 (en) * 2003-07-24 2006-09-14 株式会社Cskホールディングス Capability evaluation apparatus, capability evaluation method, and capability evaluation program
JP2005196645A (en) * 2004-01-09 2005-07-21 Nippon Hoso Kyokai <Nhk> Information presentation system, information presentation device and information presentation program

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6334778B1 (en) * 1994-04-26 2002-01-01 Health Hero Network, Inc. Remote psychological diagnosis and monitoring system
US20020192624A1 (en) * 2001-05-11 2002-12-19 Darby David G. System and method of testing cognitive function

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2007106518A2 *

Also Published As

Publication number Publication date
CN101500485A (en) 2009-08-05
WO2007106518A3 (en) 2008-07-24
KR20090010957A (en) 2009-01-30
JP2009530711A (en) 2009-08-27
WO2007106518A8 (en) 2009-03-26
EP1993446A4 (en) 2011-01-19
WO2007106518A2 (en) 2007-09-20
WO2007106089A1 (en) 2007-09-20

Similar Documents

Publication Publication Date Title
US20100055658A1 (en) System for and method for psychological assessment
WO2007106518A2 (en) System for and method for psychological assessment
San-Martín et al. The determinants of teachers’ continuance commitment to e-learning in higher education
JP6181559B2 (en) Systems and methods for adaptive knowledge assessment and learning
US5416694A (en) Computer-based data integration and management process for workforce planning and occupational readjustment
Chen Enhancement of student learning performance using personalized diagnosis and remedial learning system
Mumford et al. Item generation procedures and background data scales: Implications for construct and criterion‐related validity
US6341267B1 (en) Methods, systems and apparatuses for matching individuals with behavioral requirements and for managing providers of services to evaluate or increase individuals&#39; behavioral capabilities
CA2425166C (en) Method and system for knowledge assessment and learning
Ying et al. Skeptical judgments and self-construal: A comparative study between Chinese accounting students in Australia and China
JP3883795B2 (en) Attendance class selection device, attendance class selection method, and storage medium
KR20070114869A (en) A system and method for ordered education management service using website
Morgeson et al. A framework of potential sources of inaccuracy in job analysis
Berven Improving evaluation in counselor training and credentialing through standardized simulations
Kansal et al. Educational data mining and indian technical education system: a review
Ünder et al. The Effects of “Transition to Professional Life’’Course on Career Decision-Making Self-Efficacy
US20230325777A1 (en) Position-Resolved, Broad Engagement, Candidate Matching System
JP7435944B1 (en) Training support system, training support method, and training support program
Fisk et al. Co-teaching and collaboration: A qualitative multi-case study
Hird The relationship of sources of efficacy information to career decision-making self-efficacy
Angra Visualizing student calibration by developing tag-enhanced open learner models: towards self-regulated learning
Bogdanova MOODLE SYSTEM TESTING IN TEACING FOREIGN LANGUAGES TO NON-LINGUISTIC UNIVERSITY STUDENTS
Stanescu et al. Medical hybrid learning tools
JPH1184998A (en) Method for forming and providing lessen improving material and its system as well and method for forming and providing school affairs improving material and its system
Matczynski et al. Needs assessment: A means to clarify the goals of secondary schools

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20080912

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK RS

RIN1 Information on inventor provided before grant (corrected)

Inventor name: MURPHY, JOHN

Inventor name: YOKLEY, EDWARD, M.

Inventor name: HOLT, BRUCE

Inventor name: WELLS, MELISSA, MEREDITH

Inventor name: STURM, W., MICHAEL

A4 Supplementary search report drawn up and despatched

Effective date: 20101216

RIC1 Information provided on ipc code assigned before grant

Ipc: G09B 19/00 20060101ALI20101210BHEP

Ipc: A61B 5/16 20060101AFI20071009BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20111104