US20120022343A1 - Systems and methods for detecting deception by measuring brain activity - Google Patents

Systems and methods for detecting deception by measuring brain activity Download PDF

Info

Publication number
US20120022343A1
US20120022343A1 US13/191,925 US201113191925A US2012022343A1 US 20120022343 A1 US20120022343 A1 US 20120022343A1 US 201113191925 A US201113191925 A US 201113191925A US 2012022343 A1 US2012022343 A1 US 2012022343A1
Authority
US
United States
Prior art keywords
brain
activity
response
interest
subject
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/191,925
Inventor
Ananda Shastri
Stephen J. Nelson
Daryl E. Bohning
Mark S. George
Frank Andrew Kozel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MUSC Foundation for Research Development
Original Assignee
MUSC Foundation for Research Development
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from PCT/US2002/040142 external-priority patent/WO2003049605A2/en
Application filed by MUSC Foundation for Research Development filed Critical MUSC Foundation for Research Development
Priority to US13/191,925 priority Critical patent/US20120022343A1/en
Publication of US20120022343A1 publication Critical patent/US20120022343A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
    • A61B5/055Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves  involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/164Lie detection
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/389Electromyography [EMG]

Definitions

  • the invention relates to the detection of deception by measuring brain activity which is associated with or characteristic of acts of deception.
  • Polygraph devices examine differences in peripheral autonomic responses to relevant versus irrelevant questions. For example, current polygraph devices record changes in skin conductance response (SCR), blood pressure, respiration and peripheral vasomotor activity. Whenever a greater autonomic response is recorded after a relevant questions versus an irrelevant question, this data is interpreted as indicative that the subject is being deceptive (see, e.g., Furedy (1986)).
  • SCR skin conductance response
  • blood pressure Whenever a greater autonomic response is recorded after a relevant questions versus an irrelevant question, this data is interpreted as indicative that the subject is being deceptive (see, e.g., Furedy (1986)).
  • Polygraph devices have several significant limitations. For example, subjects can learn to control some autonomic responses and, thereby, circumvent the ability of the test to detect deception. Conversely, anxiety associated with the test or questions can lead to autonomic responses associated with deception irrespective of the truthfulness of the subject's answers. Polygraph interpretation and testing procedures are also subjective. For example, there is little consensus amongst polygraph examiners regarding the types of questions to ask, and the interpretation of the results can be highly subjective. More fundamentally, polygraph devices do not directly measure any mental activity associated with deception but, rather, measure non-specific peripheral changes in the arousal of the test subject. Not surprisingly, the substantive predictive value of the polygraph has been found to be poor in many screening and investigative situations, and scientific evidence regarding the polygraph's validity is significantly lacking.
  • fMRI was performed in the context of “sympathetic arousal” and “risk-taking behavior” in which subjects picked playing cards and won or lost money based on their choices. Again, however, Critchley et al. did not attempt to detect deception.
  • Other researchers using fMRI and positron emission tomography (PET) have successfully delineated brain activity involved in response inhibition (e.g., “Go/No-Go” tasks) (Elliott et al. (2000), divided attention (Pardo et al. (1991); George et al. (1997); Bush et al. (1998)), anxiety (Rauch and Savage (1997); Lorberbaum et al. (1999)), emotion-related learning with reward and punishment (O'Doherty et al. (2001)), and cognitive breakthrough differentiating components of cognitive control such as performance monitoring (MacDonald et al. (2000)).
  • the present invention addresses the need for reliable detection of deception by specifically identifying the brain regions involved in deception in an individual, and measuring brain activity associated with potentially deceptive states or responses.
  • the present invention avoids the drawbacks of the prior art, and provides a reliable, objective means of detecting deception.
  • the present invention measures brain activity which is inherent in and necessary to the process of deception, it provides a means of detecting deception which cannot be circumvented by trained, skillful or remorseless liars.
  • the present invention depends, in part, upon the identification in groups of individuals of those brain regions which are typically activated during deception, the recognition that there is variability amongst individuals in these regions, and the development of methods for detecting deception at the individual level despite that variability.
  • the invention provides methods for detecting deception using appropriate controls which provide for reliability and reproducibility of results, and a level of confidence suitable for legal, commercial and security applications.
  • the invention provides methods for determining whether the brain activity of a human subject in response to a stimulus of interest is characteristic of a state of interest.
  • a stimulus of interest is provided to the subject and the brain activity of the subject in response to the stimulus is measured during a period of interest.
  • the brain activity in at least one brain region when measured during the period of interest is compared with a predetermined control level of activity, and a determination is made whether the brain activity in the brain region(s) when measured during the period of interest is characteristic of the state of interest based upon the comparison.
  • a comparison can be made to determine whether the activity is not characteristic of the state of interest (i.e., lacks characteristics of that state).
  • the stimulus is selected from the group consisting of a sound, a picture, an aurally-presented question and a visually-presented question.
  • the state of interest is either a truthful state or a deceptive state.
  • the step of comparing brain activity includes generating a first brain map of activity prior to or after the period of interest, generating a second brain map of activity during the period of interest, and generating a third brain map representing the difference between the first brain map and the second brain map.
  • the third brain map can include data representing values of statistical significance or probabilities.
  • the invention provides methods for determining whether the brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response.
  • the subject is asked at least one question of interest and is allowed to provide a response of interest during a period of interest while the brain activity of the subject is measured. It is not known beforehand whether the response of interest is truthful or deceptive.
  • the brain activity in the brain region(s) measured during the period of interest is compared with a predetermined control level of activity, and a determination is made whether the brain activity in the brain region(s) when measured during the period of interest is characteristic of a truthful or a deceptive response based upon the comparison.
  • control level of activity can be a level which is characteristic of either a truthful response or a deceptive response by a group of individuals. In other embodiments, the control level of activity can be a level which is not characteristic of either a truthful response or a deceptive response by a group of individuals (i.e., lacks characteristics of a truthful or deceptive response). On yet other embodiments, the control level of activity can be a level which is characteristic of either a truthful response or a deceptive response to control questions by the subject. Finally, in yet other embodiments, the control level of activity can be a level which is not characteristic of either a truthful response or a deceptive response to control questions by the subject (i.e., lacks characteristics of a truthful or deceptive response).
  • the step of comparing the brain activity can include scaling the brain activity in the brain region(s) relative to brain activity which is characteristic of a control response by the subject.
  • the control response can be a motor, auditory, visual, pain or other response.
  • the step of comparing brain activity can include generating a first brain map of activity prior to or after the period of interest, generating a second brain map of activity during said period of interest, and generating a third brain map representing the difference between said first brain map and said second brain map.
  • the third brain map can include data representing values of statistical significance or probabilities.
  • the invention employs control questions in methods for determining whether brain activity during a response of a human subject to a question of interest is characteristic of a truthful or a deceptive response.
  • the subject is asked at least one truthful control question and is allowed to provide a truthful response during a truthful control period while the brain activity of the subject is measured.
  • the subject is asked at least one deceptive control question and is allowed to provide a deceptive response during a deceptive control period while the brain activity of the subject is measured.
  • the subject is asked at least one question of interest and is allowed to provide a response of interest during a period of interest while the brain activity of the subject is measured. It is not known beforehand whether the response of interest is truthful or deceptive.
  • At least one brain region is identified which exhibits a statistically significant difference in brain activity when measured during the truthful control period and when measured during the deceptive control period.
  • the brain activity in the brain region(s) when measured during the period of interest is compared with brain activity during at least one of the truthful control period and the deceptive control period, and a determination is made whether the brain activity in the brain region(s) when measured during the period of interest is (or is not) characteristic of a truthful or a deceptive response based upon the comparison.
  • the step of comparing the brain activity includes generating a first brain map of activity during the period of interest, generating at least a second brain map of activity during the truthful control period(s) and the deceptive control period(s), and generating at least a third brain map representing the difference between the first brain map and the second brain map.
  • the third brain map can include data representing values of statistical significance or probabilities.
  • the brain activity of the subject can be measured by fMRI, BOLD fMRI, PET, SPECT, EEG, MEG, DOT or combinations thereof, as these terms are defined herein.
  • the brain region(s) can be chosen from prefrontal cortex, limbic cortex, anterior cruciate, temporal cortex, parietal cortex, caudate, hypothalamus and cerebellum.
  • the brain regions can be chosen from orbitofrontal cortex, anterior cingulate cortex, prefrontal cortex, middle temporal cortex, insula, cuneus, post-central gyms, pre-central gyms, superior temporal gyms and cerebellum.
  • the brain region(s) can be chosen from the right anterior cingulate cortex, right inferior frontal cortex, right orbitofrontal cortex, left middle temporal cortex and right middle frontal cortex.
  • the brain region(s) can be chosen from the right orbitofrontal cortex and right anterior cingulate cortex. In embodiments in which the subject has reversed left-right brain symmetry relative to the majority of the population, the terms “right” and “left” are reversed for the brain region(s).
  • the brain region(s) can be chosen from a group of brain regions identified in a control group of individuals as exhibiting a statistically significant difference in brain activity when measured during truthful responses and when measured during deceptive responses.
  • the brain regions can include at least two brains regions chosen from orbitofrontal cortex, anterior cingulate cortex, prefrontal cortex, middle temporal cortex, insula, cuneus, post-central gyms, pre-central gyms, superior temporal gyms and cerebellum.
  • the control group of individuals is matched to the subject for at least one characteristic chosen from sex, age, medical/psychiatric condition, handedness, race, language skills, health, socioeconomic status, and MMPI profile.
  • the methods include the step of assigning a probability that the subject is being deceptive. In other embodiments, the methods include the step of assigning a range of probabilities that the subject is being deceptive.
  • the methods further include the steps of measuring a physiological indicator chosen from SCR, heart rate and blood pressure at least once during the period of interest, and determining whether the indicator measurement is characteristic of a truthful or a deceptive response.
  • the invention provides methods further including the steps of measuring the SCR of the subject during at least a portion of the period of interest, comparing the SCR during the period of interest with a predetermined control SCR, and determining whether the SCR is characteristic of a truthful or a deceptive response based upon the comparison.
  • the measuring of the SCR includes the steps of attaching at least one SCR electrode to an area of the subject's skin, and maintaining substantially constant contact between the electrode and the subject's skin.
  • the methods include transmitting signals from the SCR electrode to a system processor via a shielded cable or employing a low-pass filter to reduce interference.
  • the SCR measurements can be stored on an electronic data storage medium.
  • the step of measuring brain activity of the subject can occur multiple times during the period of interest, multiple times during the truthful control period, multiple times during the deceptive control period, at least once per second, at least once every two seconds, or at least once every three seconds.
  • the brain activity of the subject can be measured by an MRI device using a field strength of at least 1 Tesla, at least 2 Tesla, or at least 3 Tesla.
  • the methods can further include the step of storing the brain activity measurements on an electronic data storage medium.
  • the subject's response can include pressing a button or raising a finger.
  • the subject's response can correspond to an affirmative or negative response.
  • the subject's response can be measured within 5 seconds of the question or stimulus.
  • the question or stimulus can be aurally-presented or visually presented.
  • the invention provides systems for determining whether the brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response.
  • the systems include means for providing a stimulus of interest, a brain activity measuring device, a response measuring device, and a system processor connected to the means for providing a stimulus, the brain activity measuring device and the response measuring device for receiving and processing data from each, and for statistically analyzing the data.
  • the means for providing a stimulus comprises a screen which presents visual stimuli.
  • the response measuring device includes at least one switch or button which is finger-activated by the subject.
  • the invention provides a system for determining whether the brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response which includes a brain activity measuring device, a SCR measuring device, a system processor connected to the brain activity measuring device and the SCR measuring device for receiving and processing data from each, and a shielded data cable for transmitting data from the SCR measuring device to the system processor.
  • the brain activity measuring device can be chosen from an fMRI, BOLD fMRI, PET, SPECT, EEG, MEG and DOT device.
  • the invention provides a system for measuring the SCR of a human subject during magnetic resonance imaging which includes a magnetic resonance imaging device, a SCR measuring device, a system processor connected to the brain activity measuring device and the SCR measuring device for receiving and processing data from each, and a shielded data cable for transmitting data from the SCR measuring device to the system processor.
  • the brain activity measuring device can measure brain activity in at least one brain region chosen from the right anterior cingulate cortex, right inferior frontal cortex, right orbitofrontal cortex, left middle temporal cortex and right middle frontal cortex.
  • the SCR measuring device can further include a device for maintaining substantially constant contact between an SCR electrode and an area of the subject's skin.
  • the system processor can be adapted to receive brain activity data from the brain activity measuring device and to receive SCR data from the SCR measuring device, and can be programmed to determine whether the brain activity of the subject during the response to the question of interest is characteristic of a truthful or a deceptive response.
  • the system processor can be adapted to receive brain activity data from the brain activity measuring device and to receive SCR data from the SCR measuring device, and to store the data on an electronic data storage medium.
  • the system can further include a partition for a doorway of a shielded room containing the magnetic resonance imaging device.
  • the partition includes a panel of an electrically conductive material, having two sides and a periphery substantially corresponding in shape to the doorway, one or more electrically conductive contacts located at one or more portions of the periphery to provide an electrical contact between the panel and the doorway, a first electrical connector on a first side of the panel for connection to the shielded SCR cable, and a second electrical connector on a second side of the panel for connection to the system processor.
  • the first and second electrical connectors are coupled to each other such that data can be transmitted from the first side to the second side of said panel.
  • the step of measuring brain activity of the subject can occur at least once per second, at least once every two seconds or at least once every three seconds.
  • the brain activity of the subject can be measured by an MRI device using a field strength of at least 1 Tesla, at least 2 Tesla or at least 3 Tesla.
  • the invention provides a partition for the doorway of a shielded room containing a brain imaging device.
  • the partition includes a panel of an electrically conductive material having two sides and a periphery substantially corresponding in shape to the doorway, one or more electrically conductive contacts located at one or more portions of the periphery to provide an electrical contact between the panel and the doorway, a first electrical connector on a first side of said panel, and the second electrical connector on a second side of the panel.
  • the first and second electrical connectors are coupled to each other such that data can be transmitted from the first side to the second side of the panel.
  • FIG. 1 illustrates an exemplary system for determining whether brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response, according to one embodiment of the invention
  • FIG. 2 illustrates an exemplary system for determining whether brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response, according to another embodiment of the invention.
  • brain activity means physiological and biochemical activity within the human brain, or a region of the brain, associated with mental activity, including but not limited to increases in blood flow to active brain regions, increases in metabolic activity (e.g., glucose consumption), changes in electrical potential of neurons, and the release of neurotransmitters.
  • Brain activity may be measured non-invasively by, for example, measuring changes in electrical fields, magnetic fields or infra-red radiation emanating from the cranium.
  • brain region refers to a volume of tissue within the human brain, which can be of any shape and which can be characterized anatomically or spatially.
  • Brodmann Area and the abbreviation “BA” refer to the 47 regions of the cerebral cortex first described by Brodmann (1909) and are illustrated in FIGS. 9 and 10 of Talairach and Tournoux (1988).
  • anterior As used herein, the terms “anterior”, “posterior”, “superior” and “inferior” have their customary meanings in anatomy. See, for example, Stedman's Medical Dictionary.
  • frontal As used herein, the terms “frontal”, “frontal lobe” and “frontal cortex” refer to that brain region as described in Martin (2003), and including all or part of BAs 4, 6, 8-12, 24, 25, 32, 33 and 44-47.
  • orbitofrontal and “orbitofrontal cortex” refer to that brain region as described in Martin (2003), including the basal surface of the frontal lobes, superior to the orbits of the eyes, and including all or part of BAs 10, 11, 38, 46 and 47.
  • prefrontal and prefrontal cortex refer to that brain region as described in Martin (2003), and including all or part of BAs 8-12, 24, 25, 32, 33 and 44-47.
  • inferior frontal and “inferior frontal cortex” refer to that brain region as described in Martin (2003), and including all or part of BAs 6, 38 and 44-47.
  • the terms “middle frontal” and “middle frontal cortex” refer to that brain region as described in Martin (2003), and all or part of BAs 6, 8-11 and 44-47.
  • the terms “parietal”, “parietal lobe” and “parietal cortex” refer to that brain region as described in Martin (2003), and including all or part of BAs 1-3, 5, 7, 37 and 39-40.
  • temporal As used herein, the terms “temporal”, “temporal lobe” and “temporal cortex” refer to that brain region as described in Martin (2003), and including all or part of BAs 20-22, 34-38 and 40-42.
  • the terms “middle temporal” and “middle temporal cortex” refer to that brain region as described in Martin (2003), and including all or part of BAs 20-22, 37, 39 and 48.
  • the terms “superior temporal” and “superior temporal gyms” refer to that brain region as described in Martin (2003), and including all or part of BAs 22, 38, 41, 42 and 48.
  • Cerebellum refers to that brain region as described in Martin (2003).
  • anterior cruciate refers to that brain region as described in Martin (2003).
  • the term “caudate” refers to that brain region as described in Martin (2003), particularly at pages 44-45, 77 and 328.
  • cingulate As used herein, the terms “cingulate”, “cingulate cortex” and “cingulate gyms” all refer to that brain region as described in Martin (2003), including all or part of BAs 6, 11, 23, 24 and 31-33 and, in the region of the retrosplenial isthmus, BAs 23, 26, 29 and 30.
  • the term “cuneus” refers to that brain region as described in Martin (2003), and including all or part of BAs 7, 17-19 and 23.
  • hypothalamus refers to that brain region as described in Martin (2003).
  • insula refers to that brain region as described in Martin (2003), and including all or part of BAs 38, 47 and 48.
  • limbic and limbic cortex refer to that brain region as described in Martin (2003), particularly at page 378.
  • pre-central gyms refers to that brain region as described in Martin (2003), and including all or part of BAs 4 and 6.
  • post-central gyms refers to that brain region as described in Martin (2003), and including all or part of BAs 1, 2 and 3.
  • voxel refers to a multidimensional data point corresponding to a specific volume in space, and particularly refers to such a data point obtained from a brain imaging procedure and corresponding to a specific volume within the brain.
  • brain map means a set or array of data in which each data point corresponds to a point or volume in a human brain.
  • Each data point can consist of a single datum associated with a brain coordinate, or can consist of a multidimensional data array associated with a brain coordinate.
  • the brain map can be displayed as a two- or three-dimensional representation, or can be stored as a data set without being graphically displayed.
  • the term “deception” means the act, with conscious intent, of causing another to accept as true or valid what is false or invalid.
  • the term “deceptive” means intended to cause deception.
  • the term “deceptive response” means any communication, action or omission in response to a question or other stimulus which is intended to be deceptive.
  • deceptive state means a transient state of brain activity characteristic of a deceptive response or awareness of deception.
  • the term “deceptive control question” means a control question which elicits a deceptive response which is known a priori to be deceptive.
  • the term “deceptive control period” means a period of time during which a deceptive response to a deceptive control question is provided, beginning during or after the presentation of the deceptive control question and ending after a period sufficient to measure the response to the question.
  • true response means any communication, action or omission in response to a question or other stimulus which is not intended to be deceptive.
  • a truthful response may, in fact, be true or valid, or it may be false or invalid if there is no intent to be deceptive.
  • true state means a transient state of brain activity characteristic of a truthful response or no awareness of deception.
  • true control question means a control question which elicits a truthful response which is known a priori to be truthful.
  • true control period means a period of time during which a truthful response to a truthful control question is provided, beginning during or after the presentation of the truthful control question and ending after a period sufficient to measure the response to the question.
  • the term “question of interest” means a question to which elicits a response which is not known a priori to be deceptive or truthful, and for which it is of interest to determine whether the response is deceptive or truthful.
  • the term “stimulus of interest” means a stimulus which elicits a response which is not known a priori to be deceptive or truthful, and for which it is of interest to determine whether the response is deceptive or truthful, or which elicits a state of interest, and for which it is of interest to determine whether the state is characteristic of a deceptive state or a truthful state.
  • response of interest means a response to a question of interest or a stimulus of interest.
  • state of interest means a transient state of brain activity elicited by a question of interest or a stimulus of interest.
  • the term “period of interest” means a period of time during which either (1) a response of interest to a question of interest or a stimulus of interest is provided, beginning during or after the presentation of the question of interest or stimulus of interest and ending after a period sufficient to measure the response to the question or stimulus, or (2) a state of interest is elicited by the question of interest or stimulus of interest, beginning during or after the presentation of the question of interest or stimulus of interest and ending after a period sufficient to measure the response to the question or stimulus.
  • control question means a question to which the true or valid answer is known a priori.
  • the true or valid answer need not be known with absolute certainty but, rather, can be known to a sufficient degree of probability (e.g., beyond reasonable doubt) to be useful for the intended purpose.
  • control response means a transient state of brain activity causally associated with a control activity or stimulus, such as a motor response (e.g., brain activity associated with raising a finger or pressing a button) or a response to a stimulus (e.g., brain activity associated with response to an auditory, visual, tactile or pain response).
  • a motor response e.g., brain activity associated with raising a finger or pressing a button
  • a response to a stimulus e.g., brain activity associated with response to an auditory, visual, tactile or pain response.
  • comparing the brain activity means evaluating the brain activity in a particular region or voxel during a particular period of time in relation to the brain activity in the same or different regions or voxels during the same or different period of time in order to identify similarities or differences which are characteristic of some state.
  • a comparison can include a direct evaluation of raw data points corresponding to brain activity (e.g., magnetic or electrical fields, blood flow) or indirect evaluations based upon summary statistics.
  • such a comparison can include an evaluation of raw data or summary statistics from an individual in relation to averaged data or summary statistics from the same individual or from a group of individuals, or in relation to some other control level of activity.
  • control level of activity means any level of activity to which the brain activity of an individual in a particular region or voxel during a particular period is compared.
  • the control level can be derived from the same individual or from a group of individuals, or can be based upon an arbitrary or statistical threshold designed to identify differences in brain activity which are of interest.
  • the term “characteristic of”, when used in connection with a specified response or state means statistically associated with the specified response/state to a degree which allows the specified response/state to be distinguished from other types of responses/states with a useful degree of certainty (e.g., p ⁇ 0.5, p ⁇ 0.1, p ⁇ 0.05, etc.) or probability (e.g., >50%, >90%, >95%, etc.).
  • activate means to cause an increase in activity.
  • the term “increase” means to cause a statistically significant increase.
  • the term “statistically significant” means having a probability of less than 10% under the relevant null hypothesis (i.e., p ⁇ 0.1).
  • variable As used herein, the recitation of a numerical range for a variable is intended to convey that the invention may be practiced with the variable equal to any of the values within that range. Thus, for a variable which is inherently discrete, the variable can be equal to any integer value within the numerical range, including the end-points of the range. Similarly, for a variable which is inherently continuous, the variable can be equal to any real value within the numerical range, including the end-points of the range.
  • a variable which is described as having values between 0 and 2 can take the values 0, 1 or 2 if the variable is inherently discrete, and can take the values 0.0, 0.1, 0.01, 0.001, or any other real values ⁇ 0 and ⁇ 2 if the variable is inherently continuous.
  • the present invention is dependent, in part, upon the discovery that, despite significant variation in the anatomy and functional usage of different brain regions amongst human individuals, it is still possible to identify patterns of brain activity in certain brain regions within an individual that are characteristic of deception or a deceptive state.
  • the patterns of activity associated with deception can differ between individuals, or even within the same individual between different deceptive responses or different deceptive states, it is nonetheless possible to assess the likelihood that an individual is being deceptive based upon measurements of brain activity.
  • the invention provides methods for determining whether the brain activity of a human subject in response to a stimulus of interest is characteristic of a particular state of interest, such as a deceptive state or a truthful state.
  • the stimulus of interest can be essentially any stimulus which can be presented while measuring brain activity.
  • the stimulus of interest can be a question which can be presented aurally (e.g., spoken or from a recording) or visually (e.g., printed or displayed on a video screen).
  • the stimulus of interest can be a sound (e.g., a particular individual's voice) or an image (e.g., a photograph of a crime scene, a drawing or photograph of a particular individual's face) which may elicit a response.
  • a stimulus of interest also can be part of a series of stimuli which are presented after a question, such as the question “Do you recognize any of the following?” followed by a series of photographs of individuals, objects or places.
  • the subject responds to the stimulus of interest by speech or physical movement. Rather, the stimulus of interest can elicit a response in brain activity even in the absence of any overt or manifest response. In some embodiments, however, the subject will respond overtly by speech (e.g., answering “yes” or “no”) or by physical movement (e.g., raising a finger, pressing a button, blinking).
  • speech e.g., answering “yes” or “no”
  • physical movement e.g., raising a finger, pressing a button, blinking
  • the brain activity is measured during a period of interest, which may include the period during which the stimulus of interest is presented, or may begin after presentation of the stimulus.
  • the period of interest will extend for 1-20 seconds after the presentation of the stimulus, but can extend for arbitrarily short periods or arbitrarily long periods with the understanding that measurements for shorter periods may not capture all (or any) of the response in brain activity and that measurements for longer periods may or may not capture pre-response or post-response brain activity which can confound the interpretation of the results.
  • the period of interest can be subdivided into a number of shorter periods, each corresponding to a single measurement of brain activity. Thus, there can be multiple measurements of brain activity during a period of interest, or only one.
  • the stimulus of interest is a question to which the subject provides a response of interest.
  • the invention provides methods for determining whether the brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response.
  • the subject is asked at least one question of interest and is allowed to provide a response of interest during a period of interest.
  • Brain activity is measured during the period of interest, and the brain activity in at least one brain region is compared with a control level of activity to determine whether the brain activity in response to the question of interest is characteristic of a truthful or a deceptive response based upon said comparison.
  • the step of comparing the brain activity during the period of interest includes a comparison of brain maps (as described below).
  • a first brain map can be generated corresponding to the level of activity during the period of interest.
  • a second brain map can be generated corresponding to the level of activity before or after the period of interest or corresponding to some other control level of activity.
  • a third brain map can be generated corresponding to the difference between the first brain map and the second brain map.
  • This third brain map can include differences in raw activity data, or can include data representing values of statistical significance or probabilities (e.g., z-scores or p-values as described below).
  • a large variety of such maps can be generated by manipulating and mapping the raw data, and by adding, subtracting or otherwise manipulating other brain maps.
  • the invention provides methods which employ truthful and deceptive control questions.
  • the subject is asked at least one truthful control question to which a truthful response is provided, and the brain activity of the subject is measured during the truthful control period in which the subject responds.
  • the subject is asked at least one deceptive control question to which a deceptive response is provided, and the brain activity of the subject is measured during the deceptive control period in which the subject responds.
  • the order of the truthful control question(s) and deceptive control question(s) can be arbitrary and, in some embodiments, truthful control questions and deceptive control questions are purposefully alternated or randomly mixed.
  • the subject is also asked at least one question of interest to which a response of interest is provided, and the brain activity of the subject is measured during the period of interest in which the subject responds. Based upon these brain activity measurements, at least one brain region is identified which exhibits a statistically significant difference in activity in the subject during the truthful control period(s) when compared to the deceptive control period(s). (If no statistically significant difference can be identified, the sample size of measurements can be increased.) Next, the brain activity in the identified brain region(s) when measured during the period of interest is compared with the brain activity during the truthful control period(s) or deceptive control period(s) to determine whether the brain activity in the identified brain region(s) during the period of interest is characteristic of a truthful or a deceptive response.
  • the step of comparing the brain activity during the period of interest includes a comparison of brain maps.
  • a first brain map can be generated corresponding to the level of activity during the period of interest.
  • a second brain map can be generated corresponding to the level of activity during a truthful control period, a deceptive control period or some other control level of activity.
  • a third brain map can be generated corresponding to the difference between the first brain map and the second brain map (e.g., question of interest minus truthful control, question of interest minus deceptive control).
  • This third brain map can include differences in raw activity data, or can include data representing values of statistical significance or probabilities (e.g., z-scores or p-values as described below).
  • a large variety of such maps can be generated by manipulating and mapping the raw data, and by adding, subtracting or otherwise manipulating other brain maps.
  • the measurements of brain activity can be focused upon or limited to one or more brain regions identified in a control group of individuals as exhibiting a statistically significant difference in brain activity when measured during truthful responses and when measured during deceptive responses.
  • the activity of the entire brain can be measured, but the statistical analysis of differences in activity can be limited to such regions.
  • any of a number of devices known in the art can be used to measure brain activity in the methods of the invention.
  • Such devices include, without limitation, magnetic resonance imaging (MRI), positron emission tomography (PET), single photon emission computed tomography (SPECT), quantitative electroencephalogram (qEEG), magneto-encephalography (MEG), and diffuse optical tomography (DOT) devices.
  • MRI magnetic resonance imaging
  • PET positron emission tomography
  • SPECT single photon emission computed tomography
  • qEEG quantitative electroencephalogram
  • MEG magneto-encephalography
  • DOT diffuse optical tomography
  • Each of these devices is, to varying degrees, capable of generating data which can be assembled into a volumetric (i.e., three dimensional) image or map of the brain using appropriate computer software. Moreover, by taking multiple measurements over a period of time, it is possible to detect changes in brain activity associated with particular mental activities or functions and, thereby, to map the brain activity associated with such mental activities or functions to specific regions of the brain.
  • the resultant “functional maps” of the brain correlate brain regions with mental activities or functions by measuring changes in activity associated with the performance of the mental activities or functions.
  • functional brain mapping is employed to map the brain regions correlated with deception or deceptive states in an individual.
  • MRI which involves the detection of selective absorption of very high frequency radio waves by certain atomic nuclei that are subjected to a strong magnetic field, has been developed extensively as a method for imaging not only the brain but all parts of the human anatomy.
  • MRI provides very high resolution volumetric images and does not require the ingestion of radioactive substances.
  • Current MRI scanners are capable of imaging or mapping the entire brain in less than one second to many seconds depending on the parameters chosen, which allows for repeated scans over a relatively short period. Very rapid scans, however, generally provide a lower degree of resolution and, therefore, brain scans of 1-5 seconds are more common.
  • BOLD fMRI blood oxygen-level dependent fMRI exploits the different magnetic signals generated by oxyhemoglobin and deoxyhemoglobin to identify areas of the brain with high oxygen demand, indicating increased activity. By generating a number of images in quick succession, changes in activity in response to a given mental task can be detected, thereby demonstrating the correspondence between the task and the brain region(s) involved in the task.
  • BOLD fMRI is now routinely used to measure regional cerebral blood flow (rCBF) in response to changes in neuronal activity.
  • rCBF regional cerebral blood flow
  • MRI devices can be employed in the methods of the invention, and a number of parameters relating to an MRI scan can be varied.
  • MRI devices generating magnetic fields varying from 0.5 to 7.0 Tesla (T) are commercially available, although magnetic fields of 1.5-4.0 T are more commonly used for fMRI.
  • MRI devices with stronger magnetic fields are generally more sensitive and can, therefore, provide higher resolution images.
  • MRI images of the brain are typically acquired in a series of 10-40 co-planar slices, in which each slice is 1-8 mm in thickness, but these values can vary depending on the area of interest and the specific question being addressed.
  • An entire image of the brain is typically obtained in 1-5 seconds, but certain situations can require shorter or longer duration to acquire a complete picture of the brain (see, e.g., Tzourio-Mazoyer et al. (2002)).
  • the resolution of an MRI can be improved by employing a sensitivity encoding phased-array head coil (e.g., SENSETM Head Coil, Philips Electronics, N.V., Amsterdam, Netherlands).
  • a sensitivity encoding phased-array head coil e.g., SENSETM Head Coil, Philips Electronics, N.V., Amsterdam, Netherlands.
  • PET which involves the detection of positrons emitted by radioactive substances (e.g., 18 F-fluorodeoxyglucose or FDG)
  • SPECT which involves the detection of gamma rays emitted by radioactive substances (e.g., 123 I-isopropyliodo-amphetamine or IMP)
  • FDG positron-fluorodeoxyglucose
  • SPECT which involves the detection of gamma rays emitted by radioactive substances (e.g., 123 I-isopropyliodo-amphetamine or IMP)
  • IMP e.g., 123 I-isopropyliodo-amphetamine
  • qEEG which measures the electrical fields associated with brain activity
  • MEG which measures the magnetic fields associated with brain activity
  • DOT also known as near infra-red (NIR) spectroscopy
  • NIR near infra-red
  • DOT produces images based upon the absorption and scattering of near-infrared light, and is useful for volumetric brain imaging based upon hemodynamic response. This method, however, is also limited in its ability to achieve high spatial resolution.
  • Exemplary references regarding the use of DOT include Taga et al. (2003), and Noguchi et al. (2003).
  • questions can be chosen such that the number of possible responses is limited. For example, questions with “yes” or “no” answers, or multiple choice questions, can be used. Such questions avoid the mental activity associated with formulating more complicated verbal or written responses.
  • both truthful and deceptive “yes” responses require brain activity associated with speaking or otherwise indicating the “yes” response. By identifying that activity, it can be excluded from consideration when determining whether brain activity in response to a question of interest is characteristic of a truthful response or a deceptive response.
  • Questions may be asked by any means which are effective to communicate with the subject. For example, and without limitation, an investigator can ask questions orally, an audio recording of questions can be played, questions can be presented on printed materials, or questions can be presented on a video screen.
  • a general question e.g., “Do you recognize the person in any of the following pictures?”
  • general instruction e.g., “Press the button if you recognize the object in any of the following pictures”
  • the nature of the brain activity measuring device may favor one format or another for asking questions.
  • the subject's head is enclosed within the device and the device generates significant levels of noise. Therefore, for embodiments employing MRI devices, it may be preferred to ask questions visually using, for example, video goggles or a video screen, or to present questions aurally using, for example, ear plugs or head phones.
  • responses are communicated without speech, such as by moving a body part (e.g., finger, hand, foot), pressing a button, or moving a switch, joystick or computer mouse.
  • an integrated computer-based system can be used to ask questions and record responses.
  • a computer processor can control the display of questions at timed intervals on a video screen or video goggles, and responses can be recorded by pressing buttons on a unit connected to the processor.
  • the processor also can receive data from the MRI to integrate the brain activity with the questions and responses.
  • At least one such system is available commercially (IFIS-SATM, MRI Devices Corp., Gainesville, Fla.).
  • control level of activity can be based upon measurements from the same individual or from a group of individuals, or can be based upon an arbitrary or statistical threshold designed to identify differences in brain activity which are of interest.
  • control level of activity can be based upon measurements of responses to control questions which are designed to elicit truthful and deceptive responses or states.
  • the control level of activity is based upon measurements of brain activity in response to one or more control stimuli.
  • a subject can be shown a series of images including photographs of individuals who are not known to the subject (i.e., strangers), as well as one or more photographs of individuals who are known to the subject (e.g., recent acquaintances, long-time acquaintances, famous individuals, family members, alleged accomplices).
  • the responses to these images can be analyzed to determine those aspects of brain activity that are associated with recognition of individuals, and to distinguish from those aspects related to the recognition of a human face.
  • images of objects e.g., crime scene objects, weapons, stolen items, documents
  • sounds e.g., recorded voices, music
  • the stimuli can be presented after a question such that they are considered in the context of the question.
  • a first control level of activity can be determined by measuring the response of the subject to the unfamiliar images (e.g., strangers) and a second control level of activity can be determined by measuring the response of the subject to the familiar images (e.g., family members).
  • the response of the subject to a stimulus of interest e.g., an alleged accomplice
  • Such comparisons can be used to assess the likelihood that the subject is being truthful or deceptive when asked about the stimulus of interest.
  • control level of activity will be determined based upon measurements in a group of individuals.
  • the individuals within the group can be presented with identical stimuli or questions or with comparable stimuli or questions (e.g., photographs of family members would vary from individual to individual but would be comparable).
  • the individuals within the group can be matched to each other and to the subject based on various criteria. For example, individuals can be matched for age (e.g., ⁇ 5 years, ⁇ 10 years), sex, race, ethnicity, handedness (e.g., using the Annett Handedness Scale (Annett (1970)), Edinburgh Handedness Inventory (Oldfield (1971)) or Waterloo Handedness Questionnaire (Steenhuis and Bryden (1989))), language skills (e.g., native language), health, socioeconomic status (e.g., MacArthur Subjective Status Scale (Adler et al.
  • MMPI Minnesota Multiphasic Personality Inventory
  • the results for each individual can be scaled to account for differences in baseline activities and variances in activity.
  • the brain activity associated with a control response e.g., brain activity associated with raising a finger or pressing a button, or with response to an auditory, visual, tactile or pain response
  • can be used as a scaling factor within each individual, with all other brain activity scaled relative to the control response (e.g., the motor response brain activity 100).
  • Motor responses are particularly useful scaling factors because they are less affected by subjective mental states and anatomical variation between individuals, but auditory, tactile and pain responses can also be used.
  • control level of activity is based upon measurements of brain activity in response to one or more control questions.
  • the control questions can be truthful control questions, deceptive control questions, or a mixture thereof.
  • the subject can be instructed to answer truthfully, or can spontaneously answer truthfully.
  • the subject can either be instructed to answer deceptively or can spontaneously practice deception.
  • the investigator knows (either with absolute certainty or an appropriate degree of certainty) whether the subject has provided a truthful answer or a deceptive answer. That is, in some instances, the answer will be known with certainty because it relates to an established fact (e.g., “Is today Monday?”), whereas in some cases the answer can be known with a sufficient degree of certainty (e.g., “Have you ever made a mistake?” “Have you ever told a lie?”).
  • the answer is not known at the time that the question is asked, but is later determined.
  • a subject cam deny familiarity with a person or object during a brain imaging procedure, but it can be demonstrated later by other evidence that the subject was, in fact, being deceptive.
  • a question with an initially unknown answer e.g., a question of interest
  • a control question e.g., a deceptive control question
  • the control questions can be chosen to be emotionally neutral or emotive.
  • Emotionally neutral questions are intended to be “matter-of-fact” and not to elicit brain activity associated with strong memories or emotions.
  • emotive questions are intended to be “uncomfortable” and to elicit an emotional response.
  • Differences in brain activity between truthful responses to neutral and emotive questions, as well as differences between deceptive responses to neutral and emotive responses represent differences which are based on the emotional content of the question or response, and not on the truthfulness or deceptiveness of the response. Therefore, brain regions which are characteristic of the emotive aspect of a question or response can be identified and eliminated from consideration when determining whether a subject's response to a question of interest is characteristic of a truthful or a deceptive response.
  • neutral control questions can include:
  • Emotive control questions can include, for example:
  • control questions are asked first in the positive and then in the negative.
  • the subject can be asked “Is your name John?” and “Is your name not John?”
  • mutually exclusive questions can be asked.
  • the subject can be asked “Is your name John?” and “Is your name Robert?”
  • the answer to one question will be “yes” and the answer to the other question will be “no.” This procedure is useful to obtain measurements of brain activity while the subject provides both truthful and deceptive “yes” and “no” responses.
  • a situation can be created by the investigator to create a basis for truthful and deceptive control questions. For example, as described in the examples below, a subject can be asked to perform a task (e.g., taking an object from a room, hiding an object in a room, choosing a playing card from a deck of cards, viewing pictures of strangers) and can then be asked questions about the task (e.g., “Did you take this object?” “Did you hide the object here?” “Did you choose this card?” “Have you seen this person before?”). In some embodiments, the subject is instructed to provide truthful responses to at least one set of questions and to provide deceptive responses to at least one other set of questions.
  • a task e.g., taking an object from a room, hiding an object in a room, choosing a playing card from a deck of cards, viewing pictures of strangers
  • questions about the task e.g., “Did you take this object?” “Did you hide the object here?” “Di
  • the present invention provides methods for identifying the brain region(s) which are activated during deception in a particular subject by comparing the brain activity in response to a stimulus or question of interest to control levels of activity, which can be based upon measurements obtained from the same individual or from a group of individuals, or by comparing the brain activity in response to a stimulus or question of interest to the activity measured in the subject in response to truthful and deceptive control questions.
  • Brain regions are generally defined either anatomically or by reference to a three-dimensional coordinate system. In either case, individual variation between brains, both structurally and functionally, limits the precision of such descriptions. Therefore, as used herein, references to particular brain regions refer to regions of typical or average brains, with the understanding that the precise locations in different individual will be variable. For example, Thompson et al. (1996)) estimate that individual differences remain in the 9-18 mm range even after normalization.
  • brain regions may be defined at various levels of generality or specificity.
  • the brain consists of the hindbrain, midbrain and forebrain.
  • the forebrain consists of the cerebral cortex, amygdala, corpus striatum, thalamus and hypothalamus.
  • the cerebral cortex can be divided into lobes (i.e., frontal, parietal, temporal, and occipital).
  • portions of defined anatomical structures can be further delimited by reference to their relative positions, such as anterior, posterior, superior, inferior, etc., or by reference to other structures.
  • brain regions refer to right and left sides based on the more common “right-handed” brain, with the understanding that the “right” and “left” descriptors should be reversed in individuals in which the functionality is reversed.
  • the brain regions which are activated during deception can include the prefrontal cortex, limbic cortex, anterior cruciate, temporal cortex, parietal cortex, caudate, hypothalamus and cerebellum.
  • the brain regions can include the orbitofrontal cortex, anterior cingulate cortex, prefrontal cortex, middle temporal cortex, insula, cuneus, post-central gyms, pre-central gyms, superior temporal gyms and cerebellum.
  • regions which most consistently are activated include the right anterior cingulate cortex, right inferior frontal cortex, right orbitofrontal cortex, left middle temporal cortex and right middle frontal cortex.
  • Specific locations within the brain, or volumes within the brain, can also be described by reference to three-dimensional coordinate systems.
  • One such system was described by Talairach and Tournox (1988), and is based upon a single brain considered by the authors to be typical.
  • Another such system developed at the Montreal Neurological Institute (MNI), was described by Collins et al. (1994), and is based upon an average of 152 brains.
  • MNI Montreal Neurological Institute
  • the MNI has also produced a high resolution single-subject brain template (Collins et al. (1998)).
  • the brain images or maps of individual subjects can be compared to such template brains by visual comparison, or computer software programs can be used which map the individual brains onto a template brain.
  • the Statistical Parametric Mapping (SPM) software automatically performs spatial registration and normalization of individual brains onto the MNI template.
  • Software is also available which determines the correspondence amongst MNI coordinates, Talairach coordinates and Brodmann Areas (e.g., MRIcro, available at www.cla.sc.edu/psyc/faculty/rorden/mricro.html; see also Rorden and Brett (2000), Behavioural Neurology, 12:191-200).
  • SPECT, PET or MRI data can be analyzed using the Dot or EMMA (Extensible MATLAB Medical image Analysis) packages which are both freely available from the MNI, or the SPM software package which is freely available from the Functional Imaging Laboratory of the Wellcome Department of Imaging Neuroscience at the University College of London, UK (www.fil.ion.ucl.ac.uk/spm/).
  • EMMA and SPM software are based upon the MATLAB® programming language (MathWorks, Inc., Natick, Mass.), with additional routines in the C programming language.
  • An SPM module is incorporated into the commercially available MEDx software (Medical Numerics, Inc., Sterling, Va.).
  • the raw data on brain activity is usually grouped into voxels corresponding to fixed volumes of the subject brain.
  • the voxel size can be varied depending upon the resolution capability of the brain activity measuring device or the desired degree of precision in identifying brain regions. It should be noted, however, that smaller voxels have worse signal to noise ratios and greater susceptibility artifacts due to partial volume effects.
  • voxels are cubes measuring, for example, 2-7 mm per side (e.g., 4 ⁇ 4 ⁇ 4 mm), but non-cubic voxels can also be employed (e.g., 3.0 ⁇ 3.2 ⁇ 3.2 mm).
  • the data can be displayed graphically by color-coding the voxels according to some statistical value (e.g., z-score), and showing cross-sections in which levels of activity or changes in levels of activity are mapped in two-dimensions.
  • some statistical value e.g., z-score
  • SPECT, PET or fMRI data is analyzed using one of the SPM software programs (e.g., SPM'96, SPM'99, SPM2).
  • the SPM software uses a parametric statistical model at each voxel, using a general linear model to describe the variability of the data in terms of experimental and confounding effects, and residual variability. Hypotheses expressed in terms of the model parameters are assessed at each voxel with univariate statistics.
  • Temporal convolution of the general linear model for fMRI enables the application of results from serially correlated regression, permitting the construction of statistic images from fMRI time series.
  • the investigator can choose an appropriate probability value for assessing statistical significance.
  • thresholds can be chosen based not upon probability values but, rather, to select a pre-determined number of activated voxels. For example, the 10, 100 or 1000 largest z-scores can be identified, and only those can be included in a map or subsequent analysis.
  • a threshold value can be chosen based upon a comparison to a control response.
  • the subject can be asked to perform a simple motor task such as raising a finger or pushing a button, or this task can be part of the act of responding to a question.
  • the subject can be exposed to an auditory, visual, tactile, pain or other stimulus.
  • the brain activity associated with the performance of the task or response to the stimulus, or some percentage or multiple of that brain activity, can be used as a threshold for identifying significant brain activity in other regions associated with other activities.
  • motor responses typically have greater signal-to-noise ratios and, therefore, a fraction of a motor response signal might be employed as a threshold.
  • the motor responses of different individuals could be normalized to account for differences between individuals.
  • an SCR measuring device is used concurrently with a brain activity measuring device to provide additional data that may be indicative of deception.
  • Devices for measuring SCR also known as electrodermal activity (EDA) or galvanic skin response (GSR) are well known in the art and are regularly used in polygraphs.
  • EDA electrodermal activity
  • GSR galvanic skin response
  • the devices can be connected to a computer system processor which is also connected to the brain activity measuring device such that both devices provide data to the system processor, thereby allowing both sets of data to be analyzed together.
  • SCR measuring devices consist of at least one pair of electrodes which is attached to the skin of the subject.
  • the electrodes can be attached to essentially any surface which provides for good electrical contact. In order to obtain good signals, areas with little or no hair, and areas with higher densities of sweat glands can be preferred (e.g., the palms of the hands).
  • a device for maintaining substantially constant contact between the SCR electrode and the subject's skin is employed.
  • a clamp can be used to apply substantially constant pressure to the electrodes, or the electrodes can be placed inside a tightly fitted glove or gantlet which is worn by the subject.
  • the device for maintaining substantially constant contact also immobilizes the area of the contact (e.g., the hand) to prevent any disturbance of the electrodes.
  • the device for maintaining contact and immobilizing the area fits over the subject's wrist, and is constructed from a section of pipe (e.g., 10′′ length of 4′′ diameter PVC pipe) cut in half lengthwise, to which is mounted a flat member (e.g., 1 ⁇ 4′′ thick Lexan sheet) with adjustable bolts to achieve substantially constant pressure to the electrodes.
  • the sheet and pipe can be padded to increased comfort.
  • the brain activity measuring device is an MRI device
  • the strong magnetic fields generated by that device can interfere with the electrical signal to be conducted from the SCR measuring device to the system processor. Therefore, in those embodiments, non-ferrous connectors (e.g., snap-on ECG connectors) and a shielded cable (e.g., shielded twisted pair cable) is used to reduce such interference.
  • a low-pass filter e.g., 1 Hz cut-off
  • the SCR data in order to conduct statistical analysis of the combined fMRI and SCR data, it is necessary to adjust the data such that there is one SCR datum for each voxel for each unit of time sampled.
  • the SCR data does not map to any particular brain region, the SCR data can be simply repeated for each voxel under consideration.
  • the sampling rates of the MRI and SCR devices differ, either the data set with fewer time points can be replicated to provide the missing time points, or the data set with more time points can be averaged over time to reduce the extra time points.
  • each set of 300 sequential SCR time points can be averaged and associated with a single MRI time point.
  • the adjusted SCR data can then be statistically analyzed as a co-variate with the brain activity level (e.g., correlated using a Pearson's r-correlation, or producing a z-map as described below in Example 1).
  • the invention provides systems for detecting deception by measuring brain activity.
  • the system includes means for providing a stimulus of interest to a subject, a brain activity measuring device (e.g., an MRI, PET, SPECT, qEEG, MEG or DOT device), a response measuring device and a system processor connected to each of the means for providing a stimulus, the brain activity measuring device and the response measuring device for receiving and processing data from them.
  • the system processor can include software which conducts statistical analysis of the brain activity data by generating brain maps which correspond to differences between responses to truthful control questions and deceptive control questions, and between responses to questions of interest and truthful and/or deceptive control questions.
  • a system according to one embodiment of the invention can be understood with reference to FIG. 1 .
  • brain activity of human subject 10 is imaged by magnetic resonance imaging device 20 (e.g., a fMRI device).
  • the question of interest is presented to human subject 10 by means for presenting stimulus of interest 50 (e.g., a screen).
  • Response measuring device 45 e.g., a computer mouse
  • System processor 30 located, e.g., inside a computer as illustrated
  • a system according to another embodiment of the invention can be understood with reference to FIG. 2 .
  • brain activity of human subject 10 is imaged by magnetic resonance imaging device 20 (e.g., a fMRI device).
  • the question of interest is presented to human subject 10 by means for presenting stimulus of interest 50 (e.g., a screen).
  • Response measuring device 45 e.g., a computer mouse
  • Skin conductance response device 40 measures skin conductance response of human subject 10 and transmits it via shielded cable 60 to system processor 30.
  • System processor 30 located, e.g., inside a computer as illustrated
  • the means for providing a stimulus can be any device which can transmit aural or visual stimuli to the subject.
  • the device can be an audio speaker, a video screen or video goggles.
  • the device can also include a mirror which allows the subject to view source of stimuli (e.g., a video screen, projection screen, printed matter, or an individual) which is displaced from the subject's line of sight.
  • the response measuring device can be any device which can receive and transmit the subject's responses to control questions and questions of interest to the system processor.
  • the device can include one or more buttons or switches which are activated by a finger of the subject, or can include a joystick or computer mouse.
  • the response measuring device can record the subject's responses by video.
  • the subject can respond by making raising one or more fingers or making some other pre-arranged physical movement (e.g., blinking).
  • the response measuring device can record these responses, and the data subsequently can be analyzed in conjunction with the brain activity data.
  • the means for providing a stimulus and the response measuring device are integrated to facilitate coordination and analysis of the stimuli/questions and responses.
  • One such integrated device which is commercially available for use with MRI devices is the IFISTM system (MRI Devices Corporation, Gainesville, Fla.).
  • the invention provides a system which includes a brain activity measuring device (e.g., an MRI, PET, SPECT, qEEG, MEG or DOT device), an SCR measuring device and a system processor connected to both the brain activity measuring device and the skin conductance response measuring device for receiving and processing data from them.
  • the system processor can include software which conducts statistical analysis of the brain activity data by generating brain maps which correspond to differences between responses to truthful control questions and deceptive control questions, and between responses to questions of interest and truthful and/or deceptive control questions.
  • the system can further include a means for providing a stimulus and a response measuring device, as described above.
  • the system can further include a shielded data cable for transmitting data from the SCR measuring device to the system processor.
  • the system can further comprise a low-pass (e.g., 1 Hz) filter for signal from the SCR measuring device.
  • the SCR measuring device includes at least one pair of electrodes to be attached to an area of the subject's skin. In some embodiments, as described above, the SCR measuring device further includes a device for maintaining substantially constant contact between the SCR electrode and the subject's skin.
  • the brain activity measuring device is an MRI device, such as a 1.5 T or 3.0 T device.
  • the strong magnetic fields generated by the MRI device make it necessary to magnetically isolate other electronic components.
  • Current MRI devices are installed in specially-designed chambers which achieve such isolation. However, such chambers are not designed to accommodate an SCR measuring device and its cable connection to a system processor outside the chamber. Therefore, in some embodiments, the invention provides a partition, hatch, or door including an electrical connection called a penetration panel.
  • the door is an electrically conductive panel, e.g., an aluminum screen or 1 ⁇ 4′′ thick aluminum plate, and in some embodiments includes electrically conductive contact strips attached to the panel and distributed around the door periphery to provide a shielding seal and a mechanical seal between the panel and the doorway.
  • the strips can be contact fingers compressed 70% of their width when the door is closed.
  • the door can be made translucent or transparent to allow a person outside the room to observe activity within the room.
  • the penetration panel can include a connector for attachment to a shielded data cable on the side exterior to the chamber, where the shielding serves to protect the data from noise induced by the magnetic fields of the MRI device.
  • the penetration panel also includes a connector for attachment of an SCR cable that leads the SCR monitoring device and the electrodes in contact with the subject's skin.
  • the connectors can be mounted in a connector enclosure.
  • the connector enclosure provides for filtering of the signals or other data processing. Such filtering can be performed using passive elements (e.g., capacitors and inductors) or active elements (e.g., transistors and amplifiers).
  • the SCR measuring device transmits SCR data with magnitudes ranging from SCR min ⁇ 0.01 ⁇ S to SCR max ⁇ 1 ⁇ S.
  • the system suppresses interference during operation to a level ⁇ which is at least an order of magnitude below SCR min . This can be accomplished by using a low-pass filter with a 3 dB cutoff frequency of approximately 1 Hz.
  • the SCR measuring device can comprise a Wheatstone bridge (e.g., with a 10-turn potentiometer variable resistor), a differential amplifier (e.g., amplifier gain ⁇ 610), and a low-pass filter, with all fixed resistors having approximately 1% tolerance and the minimum bridge output voltage being approximately 1 ⁇ V.
  • a Wheatstone bridge e.g., with a 10-turn potentiometer variable resistor
  • a differential amplifier e.g., amplifier gain ⁇ 610
  • a low-pass filter e.g., with all fixed resistors having approximately 1% tolerance and the minimum bridge output voltage being approximately 1 ⁇ V.
  • the system processor can be adapted to receive brain activity data from the brain activity measuring device and to receive SCR data from the SCR measuring device, and is programmed to determine whether the brain activity of the subject during the response(s) to the question(s) of interest is characteristic of a truthful or a deceptive response.
  • the system processor is adapted to store the data or statistical analyses on an electronic data storage medium (e.g., a hard disk, floppy disk, compact disk, magnetic tape).
  • Brain activity was measured using BOLD fMRI.
  • the images were acquired using a Picker EdgeTM 1.5 T MRI scanner (Picker International, Inc., Cleveland, Ohio) equipped with an actively shielded magnet and high performance whole-body gradients (27 mT/m, 72 T/m-sec).
  • TE Time-to-Echo
  • the BOLD fMRI consisted of 15 coplanar transverse slices (8.0 mm thick/0 mm gap) covering the entire brain and positioned 90° to the Anterior Commissure-Posterior Commissure (AC-PC) line using a sagittal scout image.
  • AC-PC Anterior Commissure-Posterior Commissure
  • EPI echo-planar
  • brain regions known to be activated during response inhibition (related to the orbitofrontal cortex (OFCx)) (Elliott et al. (2000), divided attention (involving the anterior cingulate (AC)) (Pardo et al. (1991); George et al. (1997); Bush et al. (1998)), and anxiety (involving the amygdala) (Rauch and Savage (1997)) were tested to assess activity during deception.
  • Brain activity was investigated initially as for groups and then for individuals. In order to investigate the correlates of brain activation and psychophysiologic parameters during deception, the relationship between SCR and BOLD-fMRI signal changes were examined.
  • the subjects were escorted to each of two rooms, one of which was called the “Truth Room” and the other of which was called the “Deception Room.” There were five different objects in each room, with objects differing between rooms, for a total of ten unique objects in the two rooms.
  • the order of visits to the two rooms was randomized, with half of the subjects going to the Truth Room first and the other half going to the Deception Room first.
  • subjects were instructed to find a fifty-dollar bill which was concealed under one of five objects, to remember the location of the money, and to leave it in place.
  • the subjects were then placed in the MRI scanner and provided with video goggles which were connected to a computer system and which displayed pictures of the objects in the Truth and Deception Rooms.
  • a control question test paradigm was utilized in which the subjects would give both truthful and deceptive answers about the location of the money while the BOLD fMRI scans were being acquired.
  • the subjects were shown prompt screens and then pictures of the objects in the rooms in which the money had been concealed. If a subject had first visited the Truth Room, he was first shown only the Truth Room objects, followed by the Deception Room objects. Conversely, if the subject had first visited the Deception Room, he was first shown only the Deception Room objects, followed by the Truth Room objects.
  • the five objects in each room were each shown once in a block, with a total of four blocks per room. The order of the objects was randomized within each block.
  • a prompt screen was displayed that instructed the subject to raise either one finger for “yes” or two fingers for “no” to indicate whether the money was concealed under an object as soon as a picture of the object was displayed in the goggles.
  • the object and the prompt were each displayed for 10.2 seconds, and responses were monitored by an observer.
  • Subjects were told that an investigator unaware of the true location of the money would attempt to determine when they were being deceptive by observing their behavior in the scanner through the control room window. Subjects were also told that they would receive $50 if the subjects accurately reported the position of the money in the Truth Room, and an additional $50 if they successfully deceived the investigator regarding the location of the money in the Deception Room. The monetary rewards were included to increase the motivation and the anxiety during deception task.
  • MEDx 3.3TM software Medical Numerics, Inc., Sterling, Va.
  • Functional MRI data were analyzed with MEDx 3.3TM software (Medical Numerics, Inc., Sterling, Va.) for the visualization, processing, and analysis of medical images, and which includes the SPM96 statistical package and Talairach and Tournoux brain template.
  • the MEDx motion detection function was performed using the center of intensity weighting method. Any motion greater than 2.0 mm from reference volume would have been corrected using the MEDx 3.3 motion correction function, but no subjects required motion correction, with the largest movement being in the range of 0.4 to ⁇ 1.7 mm.
  • individual volumes were spatially normalized into Talairach space utilizing the SPM Module 96 in MEDx 3.3.
  • spatial smoothing was performed using an 8 ⁇ 8 ⁇ 8 mm Gaussian kernel.
  • Intensity normalization was performed which first created a “within the brain” mask that only included voxels if they had an intensity greater than 35% the maximum of each image volume for all time points and then scaled the remaining non-zero voxels in each volume in the time series to a mean value of 1000.
  • High pass temporal filtering was then performed to filter-out patterns greater than twice the cycle length of 204 seconds. Due to the SPM module performing another intensity mask during the upcoming SPM statistics step, a software program was written to add 100 to all voxels outside the brain. When the SPM statistics were run, this ensured that no voxels previously defined as within the brain would be eliminated from the analysis but that voxels previously defined as outside the brain would be eliminated.
  • the epochs were grouped as Lie (the time period when individuals gave a deceptive answer—both indicating that the object did not conceal money when it did ⁇ 4 epochs ⁇ and indicating the object concealed money when it did not ⁇ 4 epochs ⁇ ), Lprompt (time period prompt image displayed just prior to each Lie ⁇ 8 epochs ⁇ ), True1 (time period subjects answered truthfully the location of the money ⁇ 4 epochs ⁇ and 4 truthful answers that the money was not under an object—temporally surrounding deceptive answers ⁇ 4 epochs ⁇ ), Prompt1 (time period prompt displayed immediately preceding True1 epochs), True (time period of all remaining truthful answers ⁇ 24 epochs ⁇ ), and Prompt (time period of prompt immediately preceding True epochs ⁇ 24 ⁇ ).
  • Lie the time period when individuals gave a deceptive answer—both indicating that the object did not conceal money when it did ⁇ 4 epochs ⁇ and
  • Raw brain activity data for each individual was normalized by transforming the data points to z-scores (i.e., by subtracting from each data point the mean value of all data points and then dividing by the standard deviation, to produce a set of z-scores with a mean vale of 0.0 and a standard deviation of 1.0).
  • the resultant z-scores for each voxel. or changes in z-scores for each voxel, were mapped to produce z-maps.
  • the image calculator in MEDx 3.3 was used to compute unthresholded Lie minus True1 z-maps containing both positive and negative z-scores. That is, the image calculator was used to obtain the results of (Lie minus True1) minus (True1 minus Lie) z-maps for each subject. Once these results were obtained for each individual, images were summed and divided by the square root of the sample size (i.e., eight) to create the group fixed effects analysis unthresholded z-map.
  • a low statistical threshold was chosen since the paradigm could have only a limited number of epochs of Lie.
  • the resulting values were used to determine local maxima and visually present the significant clusters. Specifically, the Talairach Daemon interface in MEDx 3.3 was used to identify locations of the local maxima (Lancaster et al.
  • this study revealed significant activation during deceptive responses compared with truthful responses (z>1.645 with an extent threshold of p ⁇ 0.05) in the right frontal (superior, middle, and inferior, including the orbitofrontal) areas, right anterior cingulate gyms, and right precentral gyms.
  • epochs that could be classified as deception. There were only eight epochs where the subjects attempted to deceive. Increasing the number of epochs can significantly improve the signal to noise ratio within an individual. Therefore, in some embodiments, a greater number of epochs of deception can be measured in order to increase the power for the individual analysis.
  • the analysis can include a motion correction on all of the subjects regardless of the degree of movement and a more stringent threshold for significance.
  • stronger magnetic fields and more sensitive RF measurement devices can be employed (e.g., 3.0 T field and sensitivity encoding technology).
  • the MEDx 3.3 analysis package requires an equal number of volumes and SCR data points.
  • the SCR data corresponding to each volume were averaged using STATA® statistical software (UCLA Academic Technology Services, Los Angeles, Calif.). Every sequential 300 SCR data points (sampling rate was 100 per second) were averaged to a single point.
  • a total of 272 means corresponding to functional brain volumes were compared.
  • the volumes utilized were the ones that had been motion detected, spatially normalized, smoothed, intensity normalized, and temporally filtered as described above.
  • the changes in SCR were correlated with BOLD fMRI changes using Pearson's r-correlation. This analysis was performed for each individual resulting in individual z-maps. One of the correlation z-maps was found to have a significant artifact and, therefore, was excluded from the subsequent individual and group analyses.
  • the remaining seven individual z-maps were added using the MEDx 3.3 calculator and divided by the square root of the sample size (i.e., seven).
  • spatial extent threshold of p ⁇ 0.05.
  • the group analysis result correlating changes in SCR and BOLD fMRI signal revealed significant correlations between SCR and brain activity in the same two regions (OFCx and AC) that significantly activated in the Lie minus True1 group analysis.
  • Brain activity was measured using BOLD fMRI.
  • the images were acquired using a Philips Intera 3 T MRI scanner.
  • the BOLD fMRI scans consisted of 26 coplanar transverse slices (4.0 mm thick/1 mm gap) covering the entire brain and positioned 90° to the AC-PC line using a sagittal scout image.
  • Subjects were escorted into a room in which six objects were located. Fifty-dollar bills had been placed under two of the objects before the subject entered. The subjects were instructed to find both locations of the two fifty-dollar bills and to leave them in place. The subjects were then made safe to enter the MRI scanner by removing metal objects and by providing hearing protection.
  • Subjects were instructed that they would see pictures of the six objects from the room just visited while in the MRI scanner. The picture of each object would be presented to them multiple times. For each picture, the subject would respond whether money was concealed below the object. The subject would respond “yes” by pushing the right thumb button and “no” by pressing the right index finger button of the IFIS system. The subjects were instructed to choose one of the two objects concealing a fifty-dollar bill and to respond truthfully (i.e., “yes” with the thumb) when presented with an image of that object. The subjects were informed that they would receive $50 for truthfully responding. This question served as a truthful control question.
  • the subjects were instructed to respond deceptively (i.e., “no” with the index finger) when presented with an image of that object.
  • the subjects were instructed to choose one of the objects which had not concealed a fifty-dollar bill and to respond deceptively (i.e., “yes” with the thumb) when presented with an image of that object.
  • These two questions served as deceptive control questions.
  • the subjects were told that a research assistant who did not know the location of the money would attempt to determine whether the subject was being deceptive.
  • the subjects were informed that they would receive an additional $50 if the research assistant could not tell when the subject was being deceptive.
  • the research assistant and the IFIS system recorded the subject's responses.
  • the tests consisted of 2 runs of 10 blocks. During each block, an image of each of the six objects was presented for six seconds in randomized order. Therefore, each block was 36 seconds and each run was six minutes. There was a one-minute break between runs. Each block required two deceptive responses and four truthful responses. Therefore, these tests required a total of 40 deceptive responses and 80 truthful responses. Therefore, this design included 40 deceptive epochs rather than the 8 deceptive epochs in the design of Example 1.
  • the image data were analyzed with Statistical Parametric Mapping 2 (SPM 2) software (www.fil.ion.bpmf.ac.uk/spm/). Initially, images were reoriented to the standard orientation for analysis. The volumes were then realigned and spatially normalized using the Montreal Neurologic Institute (MNI) EPI template in SPM 2. The resulting images were smoothed using a 6 mm kernel. An event model was designed for each subject using deceptive and truthful responses convolved with the hemodynamic response function. The data was modeled and estimations created. Individual analysis was performed with two contrasts: Lie (deceptive responses) minus True (truthful responses); and True minus Lie.
  • SPM 2 Statistical Parametric Mapping 2
  • Significance was defined as p ⁇ 0.001 with a cluster value of p-corrected ⁇ 0.05.
  • a second level (random effects) group analysis was performed using a one-sample t-test (p ⁇ 0.001, cluster-level p-corrected ⁇ 0.05) of contrast images for both Lie minus True and True minus Lie.
  • the statistical threshold used for final display and testing was higher for this study (random effects model, p ⁇ 0.001, cluster p-corrected ⁇ 0.05) than for the study of Example 1 (fixed effects model, p ⁇ 0.05, cluster p ⁇ 0.05).
  • the MRIcro software (available at www.cla.sc.edu/psyc/faculty/rorden/mricro.html; see also Rorden and Brett (2000)) was used to determine the anatomic location and Brodmann areas for significant clusters of activation.
  • the SPM functional map was superimposed on the T1 template skull stripped brain image in MRIcro.
  • this study had a more conservative threshold for statistical significance (random-effects model with p ⁇ 0.001 versus fixed-effects model with p ⁇ 0.05) and used an event-related versus a block design. Nonetheless, as shown below (Tables 3 and 4), an increased level of statistical significance was observed for activation in five brain regions. This may be due to the increased number of deceptive epochs measured (8 versus 40) and the increased field strength of the MRI (1.5 T versus 3.0 T). The individual results also showed more consistency than the previous study, with seven of the ten subjects having significant activation in the right prefrontal cortex.
  • the events analyzed were defined as Lie (subjects gave deceptive responses regarding whether the object was hiding money) and True (subjects gave truthful responses regarding whether the object was hiding money). Contrast maps of, Lie minus True and True minus Lie were computed. The individual contrast maps were used to obtain group and individual activation profiles.
  • the group analysis for Lie minus True revealed significant activation (p ⁇ 0.001, cluster p-corrected ⁇ 0.05) in five areas (right anterior cingulate, right inferior frontal, right orbitofrontal, right middle frontal, and left middle temporal) that are consistent with the study of Example 1.
  • the group analysis of True minus Lie revealed no areas of significant activation.
  • a subject of interest e.g., a criminal court, an individual with access to confidential information
  • subjects are assessed to determine that they are appropriate.
  • Subjects of interest are not scanned if they have any metal implants or shrapnel which would make an MRI procedure unsafe; irremovable medical devices such as pacemakers or fixed hearing aids that would make the MRI procedure unsafe; or claustrophobia severe enough to induce overwhelming anxiety in closed spaces.
  • the subject is subjected to extensive testing for the use of psychotropic drugs.
  • medical history, psychiatric history, and handedness are carefully assessed. If the subject has taken psychotropic drugs within 5 half-lives, the test is delayed if possible until 5 half-lives have elapsed.
  • Female subjects are given pregnancy tests.
  • the test is delayed if possible until after the pregnancy.
  • the ability of the subject of interest to read and write English is determined. If the subject cannot read and write English, a different language is chosen in which the subject has proficiency. If the subject has characteristics (e.g., sex, age, medical status) consistent with previously studied subjects, the results for the previous subjects can validate the applicability of the methods. If the subject differs substantially from previously studied subjects, a group of individuals with matched characteristics can be recruited to validate the methods for the group.
  • the day of scanning the subject is taken through two fMRI examinations in which the method is first verified to be able to detect deception in the individual (the “verification paradigm”), and then the subject is tested for the questions of interest (the “testing paradigm”).
  • the verification paradigm truthful and deceptive control questions and additional neutral control questions are randomly presented. The randomness of the questions prevents anticipation of responses.
  • the verification paradigm establishes that the method is able to detect deception by the individual subject on that day.
  • the subject performs the testing paradigm in which the structure is the same as the verification paradigm, but in which questions of interest are asked.
  • the same neutral control questions are used for both paradigms.
  • results will be compared to the group analyses generated from previous studies to determine if the subject uses the canonical deceptive brain regions previously identified. Reported results will consist of the deceptive brain regions that can be identified for the subject and the probability or statistical likelihood that the subject was truthful or deceptive in responding to the questions of interest.
  • Brain activity measurements are obtained by BOLD fMRI using a 3.0 T MRI scanner (e.g., Philips Intera 3 T) with a sensitivity encoding phased-array head coil (e.g., SENSETM Head Coil, Philips Electronics, N.V., Amsterdam, Netherlands).
  • the BOLD fMRI scans consist of 36 coplanar transverse slices (3.0 mm thick/0 mm gap) covering the entire brain and positioned 90° to the AC-PC line using a sagittal scout image.
  • a set of 515 whole brain volumes are acquired for each paradigm.
  • a structural T1 weighted scan is acquired to insure no major structural abnormalities.
  • the subject is brought to a room in which there are two objects (e.g., a ring and a watch) which can potentially be “stolen.”
  • the subjects are given instructions to take one of the objects and are provided an incentive to successfully deceive the investigator.
  • an investigator enters the room to confirm which object was taken.
  • the subjects are then placed in the MRI scanner with a video screen for presenting questions and a unit with finger-activated buttons for recording responses (e.g., IFIS-SATM System, MRI Devices Corporation, Gainesville, Fla.). A series of questions are asked and the subjects respond “yes” or “no” by pressing a button.
  • the questions are of three types: neutral control questions (e.g., “Are you male?”), truthful and deceptive control questions related to the first item (e.g., “Did you steal a ring?”), and truthful and deceptive control questions related to the second item (e.g., “Did you take the money?”).
  • This protocol provides events of deception and events of truthfulness in the same run. There verification paradigm run is approximately 16 minutes for the subject.
  • Testing for the information of interest is performed using the same type of questions and scanning parameters as the verification paradigm. The difference is that questions regarding the matter being tested are substituted for the questions about the ring and the watch. Questions of interest (e.g., “Did you commit the crime of which you are accused?” or “Did you sell the company's confidential information to a competitor?”) are randomly interspersed with the neutral control questions.
  • Questions of interest e.g., “Did you commit the crime of which you are accused?” or “Did you sell the company's confidential information to a competitor?”
  • the image data are analyzed with SPM 2 software, essentially as described above.
  • An event model is designed for each subject using deceptive and truthful control responses convolved with the hemodynamic response function.
  • individual analysis is performed with four contrasts: Lie (deceptive control responses) minus Control (neutral control responses); Control minus Lie; True (truthful control responses) minus Control; and Control minus True.
  • Significance is defined as p ⁇ 0.001 with a cluster value of p-corrected ⁇ 0.05.
  • the MRIcro software is used to determine the anatomic location and Brodmann Areas for significant clusters of activation and the SPM2 functional map is superimposed on the T1 template skull stripped brain image in MRIcro.
  • Unknown response to questions of interest
  • Control and Control Unknown contrasts are performed for each subject.
  • Significance is again defined as p ⁇ 0.001 with a cluster value of p-corrected ⁇ 0.05, and the MRIcro and SPM2 software are used as described above to identify areas of activation.
  • Regions which show significant activation for the testing paradigm in Unknown minus Control are compared with the regions identified as indicative of deception in the Lie minus Control of the verification paradigm. These regions are also compared with the True minus Control in the verification paradigm. Similarly, the Control minus Unknown of the testing paradigm is compared with the Control minus Lie and the Control minus True of the verification paradigm. Thus, the Unknown condition will be matched with either the truthful or the deceptive response pattern confirmed in the verification task.

Abstract

Methods for determining whether the brain activity of a human subject in response to a stimulus of interest or question of interest is characteristic of a state of interest, such as a deceptive state or a truthful state, are disclosed. Some methods include the use of control questions, including truthful control questions and deceptive control questions, to provide bases for comparison for responses to stimuli of interest or questions of interest. In some methods, brain maps are generated and compared. Also disclosed are systems for detecting deception by measuring brain activity.

Description

    RELATED APPLICATIONS
  • This application is a continuation of U.S. patent application Ser. No. 10/868,045, filed Jun. 14, 2004, which is a continuation-in-part of International Application No. PCT/US02/40142, filed Dec. 13, 2002, which claims benefit of priority to U.S. Provisional Application No. 60/341,137, filed Dec. 13, 2001, U.S. Provisional Application No. 60/341,297, filed Dec. 13, 2001, and U.S. Provisional Application No. 60/396,054, filed Jul. 15, 2002, all of which are incorporated by reference herein.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The invention relates to the detection of deception by measuring brain activity which is associated with or characteristic of acts of deception.
  • 2. Description of the Related Art
  • Deception, the conscious and intentional misleading of another to accept as true or valid what is actually false or invalid, is an unfortunate but common human practice with substantial societal costs. For example, according to U.S. government statistics for the years 1999-2002, civil litigation consumed approximately $100 billion annually in attorneys fees as both individuals and corporations fought in the courts to resolve disputes that could, in many instances, be decided with reliable deception detection. Government expenditures and lost productivity add even more to the societal cost of civil litigation. Similarly, fraud is estimated to cost the insurance industry $80 billion annually, but reliable deception detection could both reduce insurance premiums and speed claim processing for legitimate claimants. In commerce, industrial espionage and the theft of trade secrets result in untold losses in proprietary confidential information which could be better protected by reliable employee screening. Finally, in the defense and intelligence communities, there is an enormous need to safeguard secret information and, therefore, a need for reliable detection of deception during security clearances and investigations.
  • The search for an accurate lie detector has a long and colorful history, ranging from the ancient Chinese practice of putting rice in the mouth of suspected liars to the quasi-scientific techniques of polygraph and voice stress analysis (see, e.g., Furedy (1986)). The development of equipment to measure psycho-physiologic functions enabled investigators in the late 19th century to study the peripheral physiologic changes that were associated with deception. This led to the development of more sophisticated peripheral measuring techniques and data analysis, including the polygraph (Yankee (1995)).
  • Polygraph devices examine differences in peripheral autonomic responses to relevant versus irrelevant questions. For example, current polygraph devices record changes in skin conductance response (SCR), blood pressure, respiration and peripheral vasomotor activity. Whenever a greater autonomic response is recorded after a relevant questions versus an irrelevant question, this data is interpreted as indicative that the subject is being deceptive (see, e.g., Furedy (1986)).
  • Polygraph devices have several significant limitations. For example, subjects can learn to control some autonomic responses and, thereby, circumvent the ability of the test to detect deception. Conversely, anxiety associated with the test or questions can lead to autonomic responses associated with deception irrespective of the truthfulness of the subject's answers. Polygraph interpretation and testing procedures are also subjective. For example, there is little consensus amongst polygraph examiners regarding the types of questions to ask, and the interpretation of the results can be highly subjective. More fundamentally, polygraph devices do not directly measure any mental activity associated with deception but, rather, measure non-specific peripheral changes in the arousal of the test subject. Not surprisingly, the substantive predictive value of the polygraph has been found to be poor in many screening and investigative situations, and scientific evidence regarding the polygraph's validity is significantly lacking.
  • Various other techniques have been investigated to predict deception, which also use peripheral measures of autonomic activity. These techniques include measures of papillary size response to visual stimuli that are related to a mock crime scene (Lubow and Fein (1996)), voice analysis, observations of facial and hand movement (Ekman et al. (1991)), observations of verbal cues (Sporer (1997)), hypnosis (Sheehan and Statham (1988)), and high-definition thermal imaging of periorbital changes (Pavlidis et al. (2002)). One of the few methods that actually measures brain activity involves examining the amplitude of the P300 component of event-related brain potentials (Farwell and Donchin (1991); see also U.S. Pat. No. 4,941,477, U.S. Pat. No. 5,363,858, U.S. Pat. No. 5,406,956, and U.S. Pat. No. 5,467,777).
  • More recently, brain imaging techniques have been used to investigate brain activity associated with various mental tasks non-invasively (see, e.g., Ogawa et al. (1990)). For example, Shastri et al. (2000) disclosed the simultaneous use of fMRI and SCR measurements, and noted the potential to reveal relationships between psychological states and patterns of brain activity. However, Shastri et al. did not attempt to measure deception. Rather, they investigated brain activity in response to an auditory stimulus consisting an aggravating clicking sound (10 Hz frequency). Critchley et al. (2000) also measured SCR during fMRI. In their experiments, fMRI was performed in the context of “sympathetic arousal” and “risk-taking behavior” in which subjects picked playing cards and won or lost money based on their choices. Again, however, Critchley et al. did not attempt to detect deception. Other researchers using fMRI and positron emission tomography (PET) have successfully delineated brain activity involved in response inhibition (e.g., “Go/No-Go” tasks) (Elliott et al. (2000), divided attention (Pardo et al. (1991); George et al. (1997); Bush et al. (1998)), anxiety (Rauch and Savage (1997); Lorberbaum et al. (1999)), emotion-related learning with reward and punishment (O'Doherty et al. (2001)), and cognitive breakthrough differentiating components of cognitive control such as performance monitoring (MacDonald et al. (2000)).
  • The present invention addresses the need for reliable detection of deception by specifically identifying the brain regions involved in deception in an individual, and measuring brain activity associated with potentially deceptive states or responses. By measuring brain activity as opposed to peripheral measures of autonomic or sympathetic responses, the present invention avoids the drawbacks of the prior art, and provides a reliable, objective means of detecting deception. Moreover, because the present invention measures brain activity which is inherent in and necessary to the process of deception, it provides a means of detecting deception which cannot be circumvented by trained, skillful or remorseless liars.
  • SUMMARY OF THE INVENTION
  • The present invention depends, in part, upon the identification in groups of individuals of those brain regions which are typically activated during deception, the recognition that there is variability amongst individuals in these regions, and the development of methods for detecting deception at the individual level despite that variability. In particular, the invention provides methods for detecting deception using appropriate controls which provide for reliability and reproducibility of results, and a level of confidence suitable for legal, commercial and security applications.
  • Thus, in one aspect, the invention provides methods for determining whether the brain activity of a human subject in response to a stimulus of interest is characteristic of a state of interest. In these methods, a stimulus of interest is provided to the subject and the brain activity of the subject in response to the stimulus is measured during a period of interest. The brain activity in at least one brain region when measured during the period of interest is compared with a predetermined control level of activity, and a determination is made whether the brain activity in the brain region(s) when measured during the period of interest is characteristic of the state of interest based upon the comparison. Alternatively, a comparison can be made to determine whether the activity is not characteristic of the state of interest (i.e., lacks characteristics of that state).
  • In some embodiments, the stimulus is selected from the group consisting of a sound, a picture, an aurally-presented question and a visually-presented question.
  • In some embodiments, the state of interest is either a truthful state or a deceptive state.
  • In some embodiments, the step of comparing brain activity includes generating a first brain map of activity prior to or after the period of interest, generating a second brain map of activity during the period of interest, and generating a third brain map representing the difference between the first brain map and the second brain map. In these embodiments, the third brain map can include data representing values of statistical significance or probabilities.
  • In another aspect, the invention provides methods for determining whether the brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response. In these methods, the subject is asked at least one question of interest and is allowed to provide a response of interest during a period of interest while the brain activity of the subject is measured. It is not known beforehand whether the response of interest is truthful or deceptive. The brain activity in the brain region(s) measured during the period of interest is compared with a predetermined control level of activity, and a determination is made whether the brain activity in the brain region(s) when measured during the period of interest is characteristic of a truthful or a deceptive response based upon the comparison.
  • In some of the foregoing embodiments, the control level of activity can be a level which is characteristic of either a truthful response or a deceptive response by a group of individuals. In other embodiments, the control level of activity can be a level which is not characteristic of either a truthful response or a deceptive response by a group of individuals (i.e., lacks characteristics of a truthful or deceptive response). On yet other embodiments, the control level of activity can be a level which is characteristic of either a truthful response or a deceptive response to control questions by the subject. Finally, in yet other embodiments, the control level of activity can be a level which is not characteristic of either a truthful response or a deceptive response to control questions by the subject (i.e., lacks characteristics of a truthful or deceptive response).
  • In some of the foregoing embodiments, the step of comparing the brain activity can include scaling the brain activity in the brain region(s) relative to brain activity which is characteristic of a control response by the subject. In these embodiments, the control response can be a motor, auditory, visual, pain or other response.
  • In some embodiments involving questions of interest, the step of comparing brain activity can include generating a first brain map of activity prior to or after the period of interest, generating a second brain map of activity during said period of interest, and generating a third brain map representing the difference between said first brain map and said second brain map. In these embodiments, the third brain map can include data representing values of statistical significance or probabilities.
  • In another aspect, the invention employs control questions in methods for determining whether brain activity during a response of a human subject to a question of interest is characteristic of a truthful or a deceptive response. In these methods, the subject is asked at least one truthful control question and is allowed to provide a truthful response during a truthful control period while the brain activity of the subject is measured. In addition, the subject is asked at least one deceptive control question and is allowed to provide a deceptive response during a deceptive control period while the brain activity of the subject is measured. In addition, the subject is asked at least one question of interest and is allowed to provide a response of interest during a period of interest while the brain activity of the subject is measured. It is not known beforehand whether the response of interest is truthful or deceptive. Based upon these measurements, at least one brain region is identified which exhibits a statistically significant difference in brain activity when measured during the truthful control period and when measured during the deceptive control period. The brain activity in the brain region(s) when measured during the period of interest is compared with brain activity during at least one of the truthful control period and the deceptive control period, and a determination is made whether the brain activity in the brain region(s) when measured during the period of interest is (or is not) characteristic of a truthful or a deceptive response based upon the comparison.
  • In some embodiments, the step of comparing the brain activity includes generating a first brain map of activity during the period of interest, generating at least a second brain map of activity during the truthful control period(s) and the deceptive control period(s), and generating at least a third brain map representing the difference between the first brain map and the second brain map. In some of these embodiments, the third brain map can include data representing values of statistical significance or probabilities.
  • In any of the foregoing embodiments, the brain activity of the subject can be measured by fMRI, BOLD fMRI, PET, SPECT, EEG, MEG, DOT or combinations thereof, as these terms are defined herein.
  • In any of the foregoing embodiments, the brain region(s) can be chosen from prefrontal cortex, limbic cortex, anterior cruciate, temporal cortex, parietal cortex, caudate, hypothalamus and cerebellum. In some embodiments, the brain regions can be chosen from orbitofrontal cortex, anterior cingulate cortex, prefrontal cortex, middle temporal cortex, insula, cuneus, post-central gyms, pre-central gyms, superior temporal gyms and cerebellum. In certain embodiments, the brain region(s) can be chosen from the right anterior cingulate cortex, right inferior frontal cortex, right orbitofrontal cortex, left middle temporal cortex and right middle frontal cortex. In specific embodiments, the brain region(s) can be chosen from the right orbitofrontal cortex and right anterior cingulate cortex. In embodiments in which the subject has reversed left-right brain symmetry relative to the majority of the population, the terms “right” and “left” are reversed for the brain region(s).
  • In some embodiments, the brain region(s) can be chosen from a group of brain regions identified in a control group of individuals as exhibiting a statistically significant difference in brain activity when measured during truthful responses and when measured during deceptive responses. In these embodiments, the brain regions can include at least two brains regions chosen from orbitofrontal cortex, anterior cingulate cortex, prefrontal cortex, middle temporal cortex, insula, cuneus, post-central gyms, pre-central gyms, superior temporal gyms and cerebellum. In embodiments in which the subject has reversed left-right brain symmetry relative to the majority of the population, the terms “right” and “left” are reversed for the brain region(s). In some of these embodiments, the control group of individuals is matched to the subject for at least one characteristic chosen from sex, age, medical/psychiatric condition, handedness, race, language skills, health, socioeconomic status, and MMPI profile.
  • In some embodiments, the methods include the step of assigning a probability that the subject is being deceptive. In other embodiments, the methods include the step of assigning a range of probabilities that the subject is being deceptive.
  • In yet other embodiments, the methods further include the steps of measuring a physiological indicator chosen from SCR, heart rate and blood pressure at least once during the period of interest, and determining whether the indicator measurement is characteristic of a truthful or a deceptive response.
  • Thus, in some embodiments, the invention provides methods further including the steps of measuring the SCR of the subject during at least a portion of the period of interest, comparing the SCR during the period of interest with a predetermined control SCR, and determining whether the SCR is characteristic of a truthful or a deceptive response based upon the comparison. In some of these embodiments, the measuring of the SCR includes the steps of attaching at least one SCR electrode to an area of the subject's skin, and maintaining substantially constant contact between the electrode and the subject's skin. In some embodiments, the methods include transmitting signals from the SCR electrode to a system processor via a shielded cable or employing a low-pass filter to reduce interference. In some of these embodiments, the SCR measurements can be stored on an electronic data storage medium.
  • In any of the foregoing embodiments, the step of measuring brain activity of the subject can occur multiple times during the period of interest, multiple times during the truthful control period, multiple times during the deceptive control period, at least once per second, at least once every two seconds, or at least once every three seconds.
  • In addition, in any of the foregoing embodiments, the brain activity of the subject can be measured by an MRI device using a field strength of at least 1 Tesla, at least 2 Tesla, or at least 3 Tesla.
  • In addition, in any of the foregoing embodiments, the methods can further include the step of storing the brain activity measurements on an electronic data storage medium.
  • In addition, in any of the foregoing embodiments, the subject's response can include pressing a button or raising a finger. In addition, the subject's response can correspond to an affirmative or negative response.
  • In addition, in any of the foregoing embodiments, the subject's response can be measured within 5 seconds of the question or stimulus.
  • Finally, in any of the foregoing embodiments, the question or stimulus can be aurally-presented or visually presented.
  • In another aspect, the invention provides systems for determining whether the brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response. The systems include means for providing a stimulus of interest, a brain activity measuring device, a response measuring device, and a system processor connected to the means for providing a stimulus, the brain activity measuring device and the response measuring device for receiving and processing data from each, and for statistically analyzing the data.
  • In some embodiments, the means for providing a stimulus comprises a screen which presents visual stimuli.
  • In some embodiments, the response measuring device includes at least one switch or button which is finger-activated by the subject.
  • In another aspect, the invention provides a system for determining whether the brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response which includes a brain activity measuring device, a SCR measuring device, a system processor connected to the brain activity measuring device and the SCR measuring device for receiving and processing data from each, and a shielded data cable for transmitting data from the SCR measuring device to the system processor.
  • In any of the foregoing embodiments, the brain activity measuring device can be chosen from an fMRI, BOLD fMRI, PET, SPECT, EEG, MEG and DOT device.
  • In another aspect, the invention provides a system for measuring the SCR of a human subject during magnetic resonance imaging which includes a magnetic resonance imaging device, a SCR measuring device, a system processor connected to the brain activity measuring device and the SCR measuring device for receiving and processing data from each, and a shielded data cable for transmitting data from the SCR measuring device to the system processor.
  • In any of the foregoing embodiments, the brain activity measuring device can measure brain activity in at least one brain region chosen from the right anterior cingulate cortex, right inferior frontal cortex, right orbitofrontal cortex, left middle temporal cortex and right middle frontal cortex.
  • In any of the foregoing embodiments including SCR measurements, the SCR measuring device can further include a device for maintaining substantially constant contact between an SCR electrode and an area of the subject's skin.
  • In any of the foregoing embodiments including SCR measurements, the system processor can be adapted to receive brain activity data from the brain activity measuring device and to receive SCR data from the SCR measuring device, and can be programmed to determine whether the brain activity of the subject during the response to the question of interest is characteristic of a truthful or a deceptive response.
  • In any of the foregoing embodiments including SCR measurements, the system processor can be adapted to receive brain activity data from the brain activity measuring device and to receive SCR data from the SCR measuring device, and to store the data on an electronic data storage medium.
  • In any of the foregoing embodiments including an SCR device and an MRI device, the system can further include a partition for a doorway of a shielded room containing the magnetic resonance imaging device. In these embodiments, the partition includes a panel of an electrically conductive material, having two sides and a periphery substantially corresponding in shape to the doorway, one or more electrically conductive contacts located at one or more portions of the periphery to provide an electrical contact between the panel and the doorway, a first electrical connector on a first side of the panel for connection to the shielded SCR cable, and a second electrical connector on a second side of the panel for connection to the system processor. In these embodiments, the first and second electrical connectors are coupled to each other such that data can be transmitted from the first side to the second side of said panel.
  • In any of the foregoing embodiments of the systems, the step of measuring brain activity of the subject can occur at least once per second, at least once every two seconds or at least once every three seconds.
  • In any of the foregoing embodiments of the systems, the brain activity of the subject can be measured by an MRI device using a field strength of at least 1 Tesla, at least 2 Tesla or at least 3 Tesla.
  • In another aspect, the invention provides a partition for the doorway of a shielded room containing a brain imaging device. The partition includes a panel of an electrically conductive material having two sides and a periphery substantially corresponding in shape to the doorway, one or more electrically conductive contacts located at one or more portions of the periphery to provide an electrical contact between the panel and the doorway, a first electrical connector on a first side of said panel, and the second electrical connector on a second side of the panel. In these embodiments, the first and second electrical connectors are coupled to each other such that data can be transmitted from the first side to the second side of the panel.
  • These and other aspects and embodiments of the invention will be apparent to one of ordinary skill in the art from the following detailed description of the invention and examples of certain embodiments.
  • FIG. 1 illustrates an exemplary system for determining whether brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response, according to one embodiment of the invention; and
  • FIG. 2 illustrates an exemplary system for determining whether brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response, according to another embodiment of the invention.
  • DETAILED DESCRIPTION
  • The patent, scientific and medical publications referred to herein establish knowledge that was available to those of ordinary skill in the art at the time the invention was made. The entire disclosures of the issued U.S. patents, published and pending patent applications, and other references cited herein are hereby incorporated by reference.
  • DEFINITIONS
  • All technical and scientific terms used herein, unless otherwise defined below, are intended to have the same meaning as commonly understood by one of ordinary skill in the art. References to techniques employed herein are intended to refer to the techniques as commonly understood in the art, including variations on those techniques or substitutions of equivalent or later-developed techniques which would be apparent to one of skill in the art. In addition, in order to more clearly and concisely describe the subject matter which is the invention, the following definitions are provided for certain terms which are used in the specification and appended claims.
  • As used herein, the term “brain activity” means physiological and biochemical activity within the human brain, or a region of the brain, associated with mental activity, including but not limited to increases in blood flow to active brain regions, increases in metabolic activity (e.g., glucose consumption), changes in electrical potential of neurons, and the release of neurotransmitters. Brain activity may be measured non-invasively by, for example, measuring changes in electrical fields, magnetic fields or infra-red radiation emanating from the cranium.
  • As used herein, the term “brain region” refers to a volume of tissue within the human brain, which can be of any shape and which can be characterized anatomically or spatially.
  • As used herein, the term “Brodmann Area” and the abbreviation “BA” refer to the 47 regions of the cerebral cortex first described by Brodmann (1909) and are illustrated in FIGS. 9 and 10 of Talairach and Tournoux (1988).
  • As used herein, the terms “anterior”, “posterior”, “superior” and “inferior” have their customary meanings in anatomy. See, for example, Stedman's Medical Dictionary.
  • As used herein, the terms “frontal”, “frontal lobe” and “frontal cortex” refer to that brain region as described in Martin (2003), and including all or part of BAs 4, 6, 8-12, 24, 25, 32, 33 and 44-47.
  • As used herein, the terms “orbitofrontal” and “orbitofrontal cortex” refer to that brain region as described in Martin (2003), including the basal surface of the frontal lobes, superior to the orbits of the eyes, and including all or part of BAs 10, 11, 38, 46 and 47.
  • As used herein, the terms “prefrontal” and “prefrontal cortex” refer to that brain region as described in Martin (2003), and including all or part of BAs 8-12, 24, 25, 32, 33 and 44-47.
  • As used herein, the terms “inferior frontal” and “inferior frontal cortex” refer to that brain region as described in Martin (2003), and including all or part of BAs 6, 38 and 44-47.
  • As used herein, the terms “middle frontal” and “middle frontal cortex” refer to that brain region as described in Martin (2003), and all or part of BAs 6, 8-11 and 44-47.
  • As used herein, the terms “parietal”, “parietal lobe” and “parietal cortex” refer to that brain region as described in Martin (2003), and including all or part of BAs 1-3, 5, 7, 37 and 39-40.
  • As used herein, the terms “temporal”, “temporal lobe” and “temporal cortex” refer to that brain region as described in Martin (2003), and including all or part of BAs 20-22, 34-38 and 40-42.
  • As used herein, the terms “middle temporal” and “middle temporal cortex” refer to that brain region as described in Martin (2003), and including all or part of BAs 20-22, 37, 39 and 48.
  • As used herein, the terms “superior temporal” and “superior temporal gyms” refer to that brain region as described in Martin (2003), and including all or part of BAs 22, 38, 41, 42 and 48.
  • As used herein, the term “cerebellum” refers to that brain region as described in Martin (2003).
  • As used herein, the term “anterior cruciate” refers to that brain region as described in Martin (2003).
  • As used herein, the term “caudate” refers to that brain region as described in Martin (2003), particularly at pages 44-45, 77 and 328.
  • As used herein, the terms “cingulate”, “cingulate cortex” and “cingulate gyms” all refer to that brain region as described in Martin (2003), including all or part of BAs 6, 11, 23, 24 and 31-33 and, in the region of the retrosplenial isthmus, BAs 23, 26, 29 and 30.
  • As used herein, the term “cuneus” refers to that brain region as described in Martin (2003), and including all or part of BAs 7, 17-19 and 23.
  • As used herein, the term “hypothalamus” refers to that brain region as described in Martin (2003).
  • As used herein, the term “insula” refers to that brain region as described in Martin (2003), and including all or part of BAs 38, 47 and 48.
  • As used herein, the terms “limbic” and “limbic cortex” refer to that brain region as described in Martin (2003), particularly at page 378.
  • As used herein, the term “pre-central gyms” refers to that brain region as described in Martin (2003), and including all or part of BAs 4 and 6.
  • As used herein, the term “post-central gyms” refers to that brain region as described in Martin (2003), and including all or part of BAs 1, 2 and 3.
  • As used herein, the term “voxel” refers to a multidimensional data point corresponding to a specific volume in space, and particularly refers to such a data point obtained from a brain imaging procedure and corresponding to a specific volume within the brain.
  • As used herein, the term “brain map” means a set or array of data in which each data point corresponds to a point or volume in a human brain. Each data point can consist of a single datum associated with a brain coordinate, or can consist of a multidimensional data array associated with a brain coordinate. The brain map can be displayed as a two- or three-dimensional representation, or can be stored as a data set without being graphically displayed.
  • As used herein, the term “deception” means the act, with conscious intent, of causing another to accept as true or valid what is false or invalid. Similarly, as used herein, the term “deceptive” means intended to cause deception.
  • As used herein, the term “deceptive response” means any communication, action or omission in response to a question or other stimulus which is intended to be deceptive.
  • As used herein, the term “deceptive state” means a transient state of brain activity characteristic of a deceptive response or awareness of deception.
  • As used herein, the term “deceptive control question” means a control question which elicits a deceptive response which is known a priori to be deceptive.
  • As used herein, the term “deceptive control period” means a period of time during which a deceptive response to a deceptive control question is provided, beginning during or after the presentation of the deceptive control question and ending after a period sufficient to measure the response to the question.
  • As used herein, the term “truthful response” means any communication, action or omission in response to a question or other stimulus which is not intended to be deceptive. A truthful response may, in fact, be true or valid, or it may be false or invalid if there is no intent to be deceptive.
  • As used herein, the term “truthful state” means a transient state of brain activity characteristic of a truthful response or no awareness of deception.
  • As used herein, the term “truthful control question” means a control question which elicits a truthful response which is known a priori to be truthful.
  • As used herein, the term “truthful control period” means a period of time during which a truthful response to a truthful control question is provided, beginning during or after the presentation of the truthful control question and ending after a period sufficient to measure the response to the question.
  • As used herein, the term “question of interest” means a question to which elicits a response which is not known a priori to be deceptive or truthful, and for which it is of interest to determine whether the response is deceptive or truthful.
  • As used herein, the term “stimulus of interest” means a stimulus which elicits a response which is not known a priori to be deceptive or truthful, and for which it is of interest to determine whether the response is deceptive or truthful, or which elicits a state of interest, and for which it is of interest to determine whether the state is characteristic of a deceptive state or a truthful state.
  • As used herein, the term “response of interest” means a response to a question of interest or a stimulus of interest.
  • As used herein, the term “state of interest” means a transient state of brain activity elicited by a question of interest or a stimulus of interest.
  • As used herein, the term “period of interest” means a period of time during which either (1) a response of interest to a question of interest or a stimulus of interest is provided, beginning during or after the presentation of the question of interest or stimulus of interest and ending after a period sufficient to measure the response to the question or stimulus, or (2) a state of interest is elicited by the question of interest or stimulus of interest, beginning during or after the presentation of the question of interest or stimulus of interest and ending after a period sufficient to measure the response to the question or stimulus.
  • As used herein, the term “control question” means a question to which the true or valid answer is known a priori. The true or valid answer need not be known with absolute certainty but, rather, can be known to a sufficient degree of probability (e.g., beyond reasonable doubt) to be useful for the intended purpose.
  • As used herein, the term “control response” means a transient state of brain activity causally associated with a control activity or stimulus, such as a motor response (e.g., brain activity associated with raising a finger or pressing a button) or a response to a stimulus (e.g., brain activity associated with response to an auditory, visual, tactile or pain response).
  • As used herein, the term “comparing the brain activity” means evaluating the brain activity in a particular region or voxel during a particular period of time in relation to the brain activity in the same or different regions or voxels during the same or different period of time in order to identify similarities or differences which are characteristic of some state. Such a comparison can include a direct evaluation of raw data points corresponding to brain activity (e.g., magnetic or electrical fields, blood flow) or indirect evaluations based upon summary statistics. In addition, such a comparison can include an evaluation of raw data or summary statistics from an individual in relation to averaged data or summary statistics from the same individual or from a group of individuals, or in relation to some other control level of activity.
  • As used herein, the term “control level of activity” means any level of activity to which the brain activity of an individual in a particular region or voxel during a particular period is compared. The control level can be derived from the same individual or from a group of individuals, or can be based upon an arbitrary or statistical threshold designed to identify differences in brain activity which are of interest.
  • As used herein, the term “characteristic of”, when used in connection with a specified response or state (e.g., deceptive, truthful), means statistically associated with the specified response/state to a degree which allows the specified response/state to be distinguished from other types of responses/states with a useful degree of certainty (e.g., p<0.5, p<0.1, p<0.05, etc.) or probability (e.g., >50%, >90%, >95%, etc.).
  • As used herein, the term “activate” means to cause an increase in activity.
  • As used herein the term “increase” means to cause a statistically significant increase.
  • As used herein, the term “statistically significant” means having a probability of less than 10% under the relevant null hypothesis (i.e., p<0.1).
  • As used herein, the recitation of a numerical range for a variable is intended to convey that the invention may be practiced with the variable equal to any of the values within that range. Thus, for a variable which is inherently discrete, the variable can be equal to any integer value within the numerical range, including the end-points of the range. Similarly, for a variable which is inherently continuous, the variable can be equal to any real value within the numerical range, including the end-points of the range. As an example, and without limitation, a variable which is described as having values between 0 and 2 can take the values 0, 1 or 2 if the variable is inherently discrete, and can take the values 0.0, 0.1, 0.01, 0.001, or any other real values ≧0 and ≦2 if the variable is inherently continuous.
  • As used herein, unless specifically indicated otherwise, the word “or” is used in the inclusive sense of “and/or” and not the exclusive sense of “either/or.”
  • Methods for Detecting Deception by Measuring Brain Activity.
  • The present invention is dependent, in part, upon the discovery that, despite significant variation in the anatomy and functional usage of different brain regions amongst human individuals, it is still possible to identify patterns of brain activity in certain brain regions within an individual that are characteristic of deception or a deceptive state. Thus, although the patterns of activity associated with deception can differ between individuals, or even within the same individual between different deceptive responses or different deceptive states, it is nonetheless possible to assess the likelihood that an individual is being deceptive based upon measurements of brain activity.
  • Thus, in some embodiments, the invention provides methods for determining whether the brain activity of a human subject in response to a stimulus of interest is characteristic of a particular state of interest, such as a deceptive state or a truthful state. The stimulus of interest can be essentially any stimulus which can be presented while measuring brain activity. For example, the stimulus of interest can be a question which can be presented aurally (e.g., spoken or from a recording) or visually (e.g., printed or displayed on a video screen). Alternatively, the stimulus of interest can be a sound (e.g., a particular individual's voice) or an image (e.g., a photograph of a crime scene, a drawing or photograph of a particular individual's face) which may elicit a response. A stimulus of interest also can be part of a series of stimuli which are presented after a question, such as the question “Do you recognize any of the following?” followed by a series of photographs of individuals, objects or places.
  • It is not necessary that the subject respond to the stimulus of interest by speech or physical movement. Rather, the stimulus of interest can elicit a response in brain activity even in the absence of any overt or manifest response. In some embodiments, however, the subject will respond overtly by speech (e.g., answering “yes” or “no”) or by physical movement (e.g., raising a finger, pressing a button, blinking).
  • The brain activity is measured during a period of interest, which may include the period during which the stimulus of interest is presented, or may begin after presentation of the stimulus. Typically, the period of interest will extend for 1-20 seconds after the presentation of the stimulus, but can extend for arbitrarily short periods or arbitrarily long periods with the understanding that measurements for shorter periods may not capture all (or any) of the response in brain activity and that measurements for longer periods may or may not capture pre-response or post-response brain activity which can confound the interpretation of the results. The period of interest can be subdivided into a number of shorter periods, each corresponding to a single measurement of brain activity. Thus, there can be multiple measurements of brain activity during a period of interest, or only one.
  • In some embodiments, the stimulus of interest is a question to which the subject provides a response of interest. Thus, in some embodiments, the invention provides methods for determining whether the brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response. In such methods, the subject is asked at least one question of interest and is allowed to provide a response of interest during a period of interest. Brain activity is measured during the period of interest, and the brain activity in at least one brain region is compared with a control level of activity to determine whether the brain activity in response to the question of interest is characteristic of a truthful or a deceptive response based upon said comparison.
  • In some embodiments, the step of comparing the brain activity during the period of interest includes a comparison of brain maps (as described below). In particular, a first brain map can be generated corresponding to the level of activity during the period of interest. A second brain map can be generated corresponding to the level of activity before or after the period of interest or corresponding to some other control level of activity. A third brain map can be generated corresponding to the difference between the first brain map and the second brain map. This third brain map can include differences in raw activity data, or can include data representing values of statistical significance or probabilities (e.g., z-scores or p-values as described below). A large variety of such maps can be generated by manipulating and mapping the raw data, and by adding, subtracting or otherwise manipulating other brain maps.
  • In other embodiments, the invention provides methods which employ truthful and deceptive control questions. In these methods, the subject is asked at least one truthful control question to which a truthful response is provided, and the brain activity of the subject is measured during the truthful control period in which the subject responds. In addition, the subject is asked at least one deceptive control question to which a deceptive response is provided, and the brain activity of the subject is measured during the deceptive control period in which the subject responds. The order of the truthful control question(s) and deceptive control question(s) can be arbitrary and, in some embodiments, truthful control questions and deceptive control questions are purposefully alternated or randomly mixed. The subject is also asked at least one question of interest to which a response of interest is provided, and the brain activity of the subject is measured during the period of interest in which the subject responds. Based upon these brain activity measurements, at least one brain region is identified which exhibits a statistically significant difference in activity in the subject during the truthful control period(s) when compared to the deceptive control period(s). (If no statistically significant difference can be identified, the sample size of measurements can be increased.) Next, the brain activity in the identified brain region(s) when measured during the period of interest is compared with the brain activity during the truthful control period(s) or deceptive control period(s) to determine whether the brain activity in the identified brain region(s) during the period of interest is characteristic of a truthful or a deceptive response.
  • As described above, in some embodiments, the step of comparing the brain activity during the period of interest includes a comparison of brain maps. In particular, a first brain map can be generated corresponding to the level of activity during the period of interest. A second brain map can be generated corresponding to the level of activity during a truthful control period, a deceptive control period or some other control level of activity. A third brain map can be generated corresponding to the difference between the first brain map and the second brain map (e.g., question of interest minus truthful control, question of interest minus deceptive control). This third brain map can include differences in raw activity data, or can include data representing values of statistical significance or probabilities (e.g., z-scores or p-values as described below). A large variety of such maps can be generated by manipulating and mapping the raw data, and by adding, subtracting or otherwise manipulating other brain maps.
  • In some of the foregoing methods, the measurements of brain activity can be focused upon or limited to one or more brain regions identified in a control group of individuals as exhibiting a statistically significant difference in brain activity when measured during truthful responses and when measured during deceptive responses. Alternatively, the activity of the entire brain can be measured, but the statistical analysis of differences in activity can be limited to such regions. By limiting the brain regions measured or analyzed in this way, it is possible that better measurements can be obtained by focusing on fewer regions, and that more robust statistical analyses can be conducted be excluding regions unrelated to the brain activity involved in deception (e.g., motor regions involved in physical aspects of responses).
  • Measurements of Brain Activity.
  • Any of a number of devices known in the art can be used to measure brain activity in the methods of the invention. Such devices include, without limitation, magnetic resonance imaging (MRI), positron emission tomography (PET), single photon emission computed tomography (SPECT), quantitative electroencephalogram (qEEG), magneto-encephalography (MEG), and diffuse optical tomography (DOT) devices. In addition, it is expected that new devices will be developed in the future to measure brain activity, and that some of these will be useful in the methods and systems of the invention.
  • Each of these devices is, to varying degrees, capable of generating data which can be assembled into a volumetric (i.e., three dimensional) image or map of the brain using appropriate computer software. Moreover, by taking multiple measurements over a period of time, it is possible to detect changes in brain activity associated with particular mental activities or functions and, thereby, to map the brain activity associated with such mental activities or functions to specific regions of the brain. The resultant “functional maps” of the brain correlate brain regions with mental activities or functions by measuring changes in activity associated with the performance of the mental activities or functions. In the context of the present invention, functional brain mapping is employed to map the brain regions correlated with deception or deceptive states in an individual.
  • MRI, which involves the detection of selective absorption of very high frequency radio waves by certain atomic nuclei that are subjected to a strong magnetic field, has been developed extensively as a method for imaging not only the brain but all parts of the human anatomy. MRI provides very high resolution volumetric images and does not require the ingestion of radioactive substances. Current MRI scanners are capable of imaging or mapping the entire brain in less than one second to many seconds depending on the parameters chosen, which allows for repeated scans over a relatively short period. Very rapid scans, however, generally provide a lower degree of resolution and, therefore, brain scans of 1-5 seconds are more common.
  • As opposed to conventional MRI, which provides a static image of tissues, functional MRI (fMRI) images the functioning of the brain over time. For example, blood oxygen-level dependent (BOLD) fMRI exploits the different magnetic signals generated by oxyhemoglobin and deoxyhemoglobin to identify areas of the brain with high oxygen demand, indicating increased activity. By generating a number of images in quick succession, changes in activity in response to a given mental task can be detected, thereby demonstrating the correspondence between the task and the brain region(s) involved in the task. BOLD fMRI is now routinely used to measure regional cerebral blood flow (rCBF) in response to changes in neuronal activity. Exemplary references on the use of BOLD fMRI include Feng et al. (2004) and Ogawa et al. (1990).
  • Various types of MRI devices can be employed in the methods of the invention, and a number of parameters relating to an MRI scan can be varied. For example, MRI devices generating magnetic fields varying from 0.5 to 7.0 Tesla (T) are commercially available, although magnetic fields of 1.5-4.0 T are more commonly used for fMRI. MRI devices with stronger magnetic fields are generally more sensitive and can, therefore, provide higher resolution images. MRI images of the brain are typically acquired in a series of 10-40 co-planar slices, in which each slice is 1-8 mm in thickness, but these values can vary depending on the area of interest and the specific question being addressed. An entire image of the brain is typically obtained in 1-5 seconds, but certain situations can require shorter or longer duration to acquire a complete picture of the brain (see, e.g., Tzourio-Mazoyer et al. (2002)).
  • Because of the strong magnetic fields generated by MRI devices, subjects with metal implants (other than dental fillings), shrapnel, or irremovable medical devices (e.g., pacemakers, fixed hearing aids) should not be examined in an MRI device.
  • Optionally, the resolution of an MRI can be improved by employing a sensitivity encoding phased-array head coil (e.g., SENSE™ Head Coil, Philips Electronics, N.V., Amsterdam, Netherlands).
  • Both PET, which involves the detection of positrons emitted by radioactive substances (e.g., 18F-fluorodeoxyglucose or FDG), and SPECT, which involves the detection of gamma rays emitted by radioactive substances (e.g., 123I-isopropyliodo-amphetamine or IMP), provide accurate images of the brain and also can be used in the methods of the invention. Each of these methods, however, typically involves the use of radioactive substances with short half-lives (e.g., approximately 102 minutes for FDG, approximately 13 hours for IMP) and, therefore, are not available for use at sites distant from the cyclotrons which are necessary to produce such isotopes. Both methods are well known in the art, and exemplary references regarding the use of PET and SPECT include Taylor et al. (1997), Wicker et al. (1998), and Turner et al. (2003).
  • Both qEEG, which measures the electrical fields associated with brain activity, and MEG, which measures the magnetic fields associated with brain activity, are based upon measurements which have historically provided only crude or spatially unrefined images of the brain. Improvements in these technologies, however, have increased the ability to functionally map brain activity to regions. For example, the development of superconducting quantum interference devices (SQUIDS) has improved the spatial resolution of MEG. Exemplary references regarding the use of qEEG and MEG include Alary et al. (2002), Babiloni et al. (2004), Moule et al. (2003).
  • DOT, also known as near infra-red (NIR) spectroscopy, produces images based upon the absorption and scattering of near-infrared light, and is useful for volumetric brain imaging based upon hemodynamic response. This method, however, is also limited in its ability to achieve high spatial resolution. Exemplary references regarding the use of DOT include Taga et al. (2003), and Noguchi et al. (2003).
  • In the discussion and examples which follow, reference is made primarily to the best-developed brain imaging technology, BOLD fMRI. One of skill in the art will recognize, however, that any of the above-described technologies, or any other technology capable of functional brain mapping, can be used equivalently in the methods of the invention.
  • Question and Response Formats.
  • In order to limit the brain regions involved in a response, to isolate activity which is not involved in deception, as well as to reduce variability between individuals, questions can be chosen such that the number of possible responses is limited. For example, questions with “yes” or “no” answers, or multiple choice questions, can be used. Such questions avoid the mental activity associated with formulating more complicated verbal or written responses.
  • In addition, it may be possible to isolate the brain activity which, independent of the content of the question or the answer, and independent of the truthfulness of deceptiveness of the response, is inherently associated with the act of responding “yes” or “no” or choosing amongst multiple choices. For example, both truthful and deceptive “yes” responses require brain activity associated with speaking or otherwise indicating the “yes” response. By identifying that activity, it can be excluded from consideration when determining whether brain activity in response to a question of interest is characteristic of a truthful response or a deceptive response.
  • Questions may be asked by any means which are effective to communicate with the subject. For example, and without limitation, an investigator can ask questions orally, an audio recording of questions can be played, questions can be presented on printed materials, or questions can be presented on a video screen. In addition, as noted above, a general question (e.g., “Do you recognize the person in any of the following pictures?”) or general instruction (e.g., “Press the button if you recognize the object in any of the following pictures”) can be asked followed by a series of stimuli to which the question or instruction is applied.
  • In some embodiments, the nature of the brain activity measuring device may favor one format or another for asking questions. For example, in an MRI device, the subject's head is enclosed within the device and the device generates significant levels of noise. Therefore, for embodiments employing MRI devices, it may be preferred to ask questions visually using, for example, video goggles or a video screen, or to present questions aurally using, for example, ear plugs or head phones.
  • Depending upon the nature of the brain measuring device employed, it may be desirable to avoid spoken responses because the movements of the head inherent in speaking may interfere with the measurement of brain activity. For example, speaking can create motion artifacts which confound the interpretation of fMRI results. Therefore, in some embodiments, responses are communicated without speech, such as by moving a body part (e.g., finger, hand, foot), pressing a button, or moving a switch, joystick or computer mouse.
  • In some embodiments, an integrated computer-based system can be used to ask questions and record responses. For example, a computer processor can control the display of questions at timed intervals on a video screen or video goggles, and responses can be recorded by pressing buttons on a unit connected to the processor. The processor also can receive data from the MRI to integrate the brain activity with the questions and responses. At least one such system is available commercially (IFIS-SA™, MRI Devices Corp., Gainesville, Fla.).
  • Control Activities and Control Questions.
  • In order to determine whether the brain activity of a subject in response to a stimulus of interest or question of interest is characteristic of a deceptive state or a deceptive response, a statistical comparison is made to a control level of activity. As noted above, the control level of activity can be based upon measurements from the same individual or from a group of individuals, or can be based upon an arbitrary or statistical threshold designed to identify differences in brain activity which are of interest. In addition, the control level of activity can be based upon measurements of responses to control questions which are designed to elicit truthful and deceptive responses or states.
  • Thus, in some embodiments, the control level of activity is based upon measurements of brain activity in response to one or more control stimuli. For example, a subject can be shown a series of images including photographs of individuals who are not known to the subject (i.e., strangers), as well as one or more photographs of individuals who are known to the subject (e.g., recent acquaintances, long-time acquaintances, famous individuals, family members, alleged accomplices). The responses to these images can be analyzed to determine those aspects of brain activity that are associated with recognition of individuals, and to distinguish from those aspects related to the recognition of a human face. Similarly, images of objects (e.g., crime scene objects, weapons, stolen items, documents) or sounds (e.g., recorded voices, music) could be used as stimuli. Furthermore, as noted above, the stimuli can be presented after a question such that they are considered in the context of the question.
  • In such embodiments, a first control level of activity can be determined by measuring the response of the subject to the unfamiliar images (e.g., strangers) and a second control level of activity can be determined by measuring the response of the subject to the familiar images (e.g., family members). The response of the subject to a stimulus of interest (e.g., an alleged accomplice) can be compared to the first and second control levels of activity to determine whether the subject's response of interest is more characteristic of recognition or not. Such comparisons can be used to assess the likelihood that the subject is being truthful or deceptive when asked about the stimulus of interest.
  • In some embodiments, the control level of activity will be determined based upon measurements in a group of individuals. In such embodiments, the individuals within the group can be presented with identical stimuli or questions or with comparable stimuli or questions (e.g., photographs of family members would vary from individual to individual but would be comparable).
  • To reduce variability between individuals within the control group and the subject, the individuals within the group can be matched to each other and to the subject based on various criteria. For example, individuals can be matched for age (e.g., ±5 years, ±10 years), sex, race, ethnicity, handedness (e.g., using the Annett Handedness Scale (Annett (1970)), Edinburgh Handedness Inventory (Oldfield (1971)) or Waterloo Handedness Questionnaire (Steenhuis and Bryden (1989))), language skills (e.g., native language), health, socioeconomic status (e.g., MacArthur Subjective Status Scale (Adler et al. (2000))), and personality profile (e.g., Minnesota Multiphasic Personality Inventory (MMPI) (Graham (1999))). The degree of matching is entirely within the discretion of the practitioner. Based upon a variety of reports in the field of brain imaging, however, it is generally believed that matching for sex, age, medical/psychiatric condition and handedness is most significant.
  • In addition, or alternatively, to reduce variability within individuals with the control group and the subject, the results for each individual can be scaled to account for differences in baseline activities and variances in activity. For example, the average activity level over one or more brain regions (or the entire brain) can be scaled to an arbitrary value (e.g., such that the mean=100), and the variance in activity can be similarly scaled (e.g., such that the standard deviation=10). Alternatively, the brain activity associated with a control response (e.g., brain activity associated with raising a finger or pressing a button, or with response to an auditory, visual, tactile or pain response) can be used as a scaling factor within each individual, with all other brain activity scaled relative to the control response (e.g., the motor response brain activity=100). Motor responses are particularly useful scaling factors because they are less affected by subjective mental states and anatomical variation between individuals, but auditory, tactile and pain responses can also be used.
  • In some embodiments, the control level of activity is based upon measurements of brain activity in response to one or more control questions. The control questions can be truthful control questions, deceptive control questions, or a mixture thereof.
  • For the truthful control questions, the subject can be instructed to answer truthfully, or can spontaneously answer truthfully. Similarly, for deceptive control questions, the subject can either be instructed to answer deceptively or can spontaneously practice deception. In either case, the investigator knows (either with absolute certainty or an appropriate degree of certainty) whether the subject has provided a truthful answer or a deceptive answer. That is, in some instances, the answer will be known with certainty because it relates to an established fact (e.g., “Is today Monday?”), whereas in some cases the answer can be known with a sufficient degree of certainty (e.g., “Have you ever made a mistake?” “Have you ever told a lie?”). In certain cases, it is possible that the answer is not known at the time that the question is asked, but is later determined. For example, a subject cam deny familiarity with a person or object during a brain imaging procedure, but it can be demonstrated later by other evidence that the subject was, in fact, being deceptive. Thus, a question with an initially unknown answer (e.g., a question of interest) can subsequently be regarded as a control question (e.g., a deceptive control question) when the answer becomes known.
  • The control questions can be chosen to be emotionally neutral or emotive. Emotionally neutral questions are intended to be “matter-of-fact” and not to elicit brain activity associated with strong memories or emotions. Conversely, emotive questions are intended to be “uncomfortable” and to elicit an emotional response. Differences in brain activity between truthful responses to neutral and emotive questions, as well as differences between deceptive responses to neutral and emotive responses, represent differences which are based on the emotional content of the question or response, and not on the truthfulness or deceptiveness of the response. Therefore, brain regions which are characteristic of the emotive aspect of a question or response can be identified and eliminated from consideration when determining whether a subject's response to a question of interest is characteristic of a truthful or a deceptive response.
  • For example, neutral control questions can include:
      • Is your name John?
      • Are you over 18 years old?
      • Are you a United States citizen?
      • Do you own a dog?
      • Are you awake?
      • Is it raining?
      • Is today Monday?
      • Is 2+2 equal to 4?
  • Emotive control questions can include, for example:
      • Have you ever used foul language?
      • Have you ever used illegal drugs?
      • Have you ever cheated on a test?
      • Have you ever faked an illness?
      • Have you ever lied to hurt someone?
      • Have you ever lied to protect yourself?
      • Have you ever cheated on your taxes?
      • Have you ever stolen something?
  • In some embodiments, control questions are asked first in the positive and then in the negative. For example, the subject can be asked “Is your name John?” and “Is your name not John?” Alternatively, mutually exclusive questions can be asked. For example, the subject can be asked “Is your name John?” and “Is your name Robert?” Assuming that the subject provides a truthful or a deceptive response to both questions, the answer to one question will be “yes” and the answer to the other question will be “no.” This procedure is useful to obtain measurements of brain activity while the subject provides both truthful and deceptive “yes” and “no” responses.
  • In some embodiments, a situation can be created by the investigator to create a basis for truthful and deceptive control questions. For example, as described in the examples below, a subject can be asked to perform a task (e.g., taking an object from a room, hiding an object in a room, choosing a playing card from a deck of cards, viewing pictures of strangers) and can then be asked questions about the task (e.g., “Did you take this object?” “Did you hide the object here?” “Did you choose this card?” “Have you seen this person before?”). In some embodiments, the subject is instructed to provide truthful responses to at least one set of questions and to provide deceptive responses to at least one other set of questions. Because the task is controlled by the investigator, the truthfulness or deceptiveness of all responses is known with certainty. In addition, because the task is simple, unambiguous, of recent occurrence, and presumably has no connection or relation to the individual's personal history or experiences, there is expected to be less variability in the responses between individuals.
  • In any of the foregoing embodiments in which the subject is asked questions of interest, truthful control questions, or deceptive control questions, it is understood that the questions may be “asked” aurally or visually.
  • Brain Regions Implicated in Deception.
  • A number of different brain regions have been identified which are implicated in deception in different individuals. Although no one region has been identified which is activated in all individuals during deception, the present invention provides methods for identifying the brain region(s) which are activated during deception in a particular subject by comparing the brain activity in response to a stimulus or question of interest to control levels of activity, which can be based upon measurements obtained from the same individual or from a group of individuals, or by comparing the brain activity in response to a stimulus or question of interest to the activity measured in the subject in response to truthful and deceptive control questions.
  • Brain regions are generally defined either anatomically or by reference to a three-dimensional coordinate system. In either case, individual variation between brains, both structurally and functionally, limits the precision of such descriptions. Therefore, as used herein, references to particular brain regions refer to regions of typical or average brains, with the understanding that the precise locations in different individual will be variable. For example, Thompson et al. (1996)) estimate that individual differences remain in the 9-18 mm range even after normalization.
  • Anatomically, brain regions may be defined at various levels of generality or specificity. For example, at the grossest anatomical level, the brain consists of the hindbrain, midbrain and forebrain. At a finer anatomical level, the forebrain consists of the cerebral cortex, amygdala, corpus striatum, thalamus and hypothalamus. At a yet finer level, the cerebral cortex can be divided into lobes (i.e., frontal, parietal, temporal, and occipital). In addition, portions of defined anatomical structures can be further delimited by reference to their relative positions, such as anterior, posterior, superior, inferior, etc., or by reference to other structures.
  • In addition to such anatomical descriptions, forty-seven regions of the cortex were described by Brodmann (1909). These Brodmann Areas (BAs) are illustrated in FIGS. 9 and 10 of Talairach and Tournoux (1988). It should be noted, however, that the boundaries of many of the BAs do not coincide with the boundaries of the anatomical subdivisions. Therefore, a single BA may be correspond to portions of several anatomical subdivisions and, conversely, an anatomical subdivision may include all or a portion of several BAs.
  • It is well-known that the right and left sides of the brain are differentiated functionally. Although approximately 11-13% of the general population is left-handed, only about 5% of left-handed individuals show a left-right reversal in brain functionality. Therefore, as used herein, the descriptions of brain regions refer to right and left sides based on the more common “right-handed” brain, with the understanding that the “right” and “left” descriptors should be reversed in individuals in which the functionality is reversed.
  • Based upon the studies described herein, and subject to the variability described above, the brain regions which are activated during deception can include the prefrontal cortex, limbic cortex, anterior cruciate, temporal cortex, parietal cortex, caudate, hypothalamus and cerebellum. At a finer anatomical level, the brain regions can include the orbitofrontal cortex, anterior cingulate cortex, prefrontal cortex, middle temporal cortex, insula, cuneus, post-central gyms, pre-central gyms, superior temporal gyms and cerebellum. In particular, regions which most consistently are activated include the right anterior cingulate cortex, right inferior frontal cortex, right orbitofrontal cortex, left middle temporal cortex and right middle frontal cortex.
  • Specific locations within the brain, or volumes within the brain, can also be described by reference to three-dimensional coordinate systems. One such system was described by Talairach and Tournox (1988), and is based upon a single brain considered by the authors to be typical. Another such system, developed at the Montreal Neurological Institute (MNI), was described by Collins et al. (1994), and is based upon an average of 152 brains. The MNI has also produced a high resolution single-subject brain template (Collins et al. (1998)). The brain images or maps of individual subjects can be compared to such template brains by visual comparison, or computer software programs can be used which map the individual brains onto a template brain. For example, the Statistical Parametric Mapping (SPM) software, described below, automatically performs spatial registration and normalization of individual brains onto the MNI template. Software is also available which determines the correspondence amongst MNI coordinates, Talairach coordinates and Brodmann Areas (e.g., MRIcro, available at www.cla.sc.edu/psyc/faculty/rorden/mricro.html; see also Rorden and Brett (2000), Behavioural Neurology, 12:191-200).
  • Statistical Analysis.
  • Methods for the statistical analysis of changes in brain activity are well known in the art and, for some brain activity measuring devices, computer software packages are commercially available which specifically adapted to analyze the data. For example, SPECT, PET or MRI data can be analyzed using the Dot or EMMA (Extensible MATLAB Medical image Analysis) packages which are both freely available from the MNI, or the SPM software package which is freely available from the Functional Imaging Laboratory of the Wellcome Department of Imaging Neuroscience at the University College of London, UK (www.fil.ion.ucl.ac.uk/spm/). The EMMA and SPM software are based upon the MATLAB® programming language (MathWorks, Inc., Natick, Mass.), with additional routines in the C programming language. An SPM module is incorporated into the commercially available MEDx software (Medical Numerics, Inc., Sterling, Va.).
  • For purposes of statistical analysis and graphical display, the raw data on brain activity is usually grouped into voxels corresponding to fixed volumes of the subject brain. The voxel size can be varied depending upon the resolution capability of the brain activity measuring device or the desired degree of precision in identifying brain regions. It should be noted, however, that smaller voxels have worse signal to noise ratios and greater susceptibility artifacts due to partial volume effects. Typically, voxels are cubes measuring, for example, 2-7 mm per side (e.g., 4×4×4 mm), but non-cubic voxels can also be employed (e.g., 3.0×3.2×3.2 mm). The data can be displayed graphically by color-coding the voxels according to some statistical value (e.g., z-score), and showing cross-sections in which levels of activity or changes in levels of activity are mapped in two-dimensions. By generating a series of such co-planar cross-sections, the entire brain volume can be mapped.
  • In some embodiments, SPECT, PET or fMRI data is analyzed using one of the SPM software programs (e.g., SPM'96, SPM'99, SPM2). The SPM software uses a parametric statistical model at each voxel, using a general linear model to describe the variability of the data in terms of experimental and confounding effects, and residual variability. Hypotheses expressed in terms of the model parameters are assessed at each voxel with univariate statistics. Temporal convolution of the general linear model for fMRI enables the application of results from serially correlated regression, permitting the construction of statistic images from fMRI time series. The multiple comparisons problem of simultaneously assessing all the voxel statistics is addressed using the theory of continuous random fields, assuming the statistic image to be a good lattice representation of an underlying continuous stationary random field. Results for the Euler characteristic lead to corrected p-values for each voxel hypothesis. In addition, the theory permits the computation of corrected p-values for clusters of k voxels exceeding a given threshold, and for entire sets of supra-threshold clusters, leading to more powerful statistical tests at the expense of some localizing power. See Friston et al. (1995), and Ashburner and Friston (1999).
  • When conducting statistical analyses on brain images, the investigator can choose an appropriate probability value for assessing statistical significance. The particular value chosen can vary depending upon the purpose of the statistical analysis and the level of certainty required. For example, when assessing groups of individuals to identify brain regions potentially involved in deception, a lower threshold of statistical significance may be employed. On the other hand, when analyzing an individual subject for forensic purposes, a higher statistical threshold can be employed. In the studies described below, for example, the level for statistical significance was chosen to be p≦0.05. Thus, for one-tailed tests based on comparisons of z-scores, a threshold of z=1.645 can be employed, and for two-tailed tests, a threshold of z=1.960 can be employed.
  • Alternatively, thresholds can be chosen based not upon probability values but, rather, to select a pre-determined number of activated voxels. For example, the 10, 100 or 1000 largest z-scores can be identified, and only those can be included in a map or subsequent analysis.
  • In other embodiments, a threshold value can be chosen based upon a comparison to a control response. For example, the subject can be asked to perform a simple motor task such as raising a finger or pushing a button, or this task can be part of the act of responding to a question. Alternatively, the subject can be exposed to an auditory, visual, tactile, pain or other stimulus. The brain activity associated with the performance of the task or response to the stimulus, or some percentage or multiple of that brain activity, can be used as a threshold for identifying significant brain activity in other regions associated with other activities. For example, motor responses typically have greater signal-to-noise ratios and, therefore, a fraction of a motor response signal might be employed as a threshold. Alternatively, the motor responses of different individuals could be normalized to account for differences between individuals.
  • Measurements of Skin Conductance Response.
  • In some embodiments of the methods of the invention, an SCR measuring device is used concurrently with a brain activity measuring device to provide additional data that may be indicative of deception. Devices for measuring SCR, also known as electrodermal activity (EDA) or galvanic skin response (GSR), are well known in the art and are regularly used in polygraphs. In accordance with the invention, however, the devices can be connected to a computer system processor which is also connected to the brain activity measuring device such that both devices provide data to the system processor, thereby allowing both sets of data to be analyzed together.
  • SCR measuring devices consist of at least one pair of electrodes which is attached to the skin of the subject. The electrodes can be attached to essentially any surface which provides for good electrical contact. In order to obtain good signals, areas with little or no hair, and areas with higher densities of sweat glands can be preferred (e.g., the palms of the hands). In some embodiments, a device for maintaining substantially constant contact between the SCR electrode and the subject's skin is employed. For example, a clamp can be used to apply substantially constant pressure to the electrodes, or the electrodes can be placed inside a tightly fitted glove or gantlet which is worn by the subject. On some embodiments, the device for maintaining substantially constant contact also immobilizes the area of the contact (e.g., the hand) to prevent any disturbance of the electrodes. For example, in one embodiment, the device for maintaining contact and immobilizing the area fits over the subject's wrist, and is constructed from a section of pipe (e.g., 10″ length of 4″ diameter PVC pipe) cut in half lengthwise, to which is mounted a flat member (e.g., ¼″ thick Lexan sheet) with adjustable bolts to achieve substantially constant pressure to the electrodes. The sheet and pipe can be padded to increased comfort.
  • In those embodiments in which the brain activity measuring device is an MRI device, the strong magnetic fields generated by that device can interfere with the electrical signal to be conducted from the SCR measuring device to the system processor. Therefore, in those embodiments, non-ferrous connectors (e.g., snap-on ECG connectors) and a shielded cable (e.g., shielded twisted pair cable) is used to reduce such interference. In addition, a low-pass filter (e.g., 1 Hz cut-off) can be used to eliminate some of the interference generated by the MRI device.
  • In some embodiments, in order to conduct statistical analysis of the combined fMRI and SCR data, it is necessary to adjust the data such that there is one SCR datum for each voxel for each unit of time sampled. Thus, because the SCR data does not map to any particular brain region, the SCR data can be simply repeated for each voxel under consideration. In addition, if the sampling rates of the MRI and SCR devices differ, either the data set with fewer time points can be replicated to provide the missing time points, or the data set with more time points can be averaged over time to reduce the extra time points. Thus, for example, for an SCR device with a sampling rate of 100 per second and an MRI device with a 3 second sampling rate (i.e., TR=3000 ms), there are 300 SCR time points for each MRI time point and, therefore, each set of 300 sequential SCR time points can be averaged and associated with a single MRI time point. The adjusted SCR data can then be statistically analyzed as a co-variate with the brain activity level (e.g., correlated using a Pearson's r-correlation, or producing a z-map as described below in Example 1).
  • Systems for Detecting Deception by Measuring Brain Activity.
  • In another aspect, the invention provides systems for detecting deception by measuring brain activity. In some embodiments, the system includes means for providing a stimulus of interest to a subject, a brain activity measuring device (e.g., an MRI, PET, SPECT, qEEG, MEG or DOT device), a response measuring device and a system processor connected to each of the means for providing a stimulus, the brain activity measuring device and the response measuring device for receiving and processing data from them. The system processor can include software which conducts statistical analysis of the brain activity data by generating brain maps which correspond to differences between responses to truthful control questions and deceptive control questions, and between responses to questions of interest and truthful and/or deceptive control questions.
  • A system according to one embodiment of the invention can be understood with reference to FIG. 1. Referring to FIG. 1, brain activity of human subject 10 is imaged by magnetic resonance imaging device 20 (e.g., a fMRI device). The question of interest is presented to human subject 10 by means for presenting stimulus of interest 50 (e.g., a screen). Response measuring device 45 (e.g., a computer mouse) receives the response to the question of interest from human subject 10. System processor 30 (located, e.g., inside a computer as illustrated) is adapted to receive data from magnetic resonance imaging device 20 and response measuring device 45.
  • A system according to another embodiment of the invention can be understood with reference to FIG. 2. In the system according to FIG. 2, brain activity of human subject 10 is imaged by magnetic resonance imaging device 20 (e.g., a fMRI device). The question of interest is presented to human subject 10 by means for presenting stimulus of interest 50 (e.g., a screen). Response measuring device 45 (e.g., a computer mouse) receives the response to the question of interest from human subject 10. Skin conductance response device 40 measures skin conductance response of human subject 10 and transmits it via shielded cable 60 to system processor 30. System processor 30 (located, e.g., inside a computer as illustrated) is adapted to receive data from magnetic resonance imaging device 20, response measuring device 45, and skin conductance response device 40.
  • The means for providing a stimulus can be any device which can transmit aural or visual stimuli to the subject. Thus, for example, the device can be an audio speaker, a video screen or video goggles. The device can also include a mirror which allows the subject to view source of stimuli (e.g., a video screen, projection screen, printed matter, or an individual) which is displaced from the subject's line of sight.
  • The response measuring device can be any device which can receive and transmit the subject's responses to control questions and questions of interest to the system processor. For example, the device can include one or more buttons or switches which are activated by a finger of the subject, or can include a joystick or computer mouse. In other embodiments, the response measuring device can record the subject's responses by video. For example, the subject can respond by making raising one or more fingers or making some other pre-arranged physical movement (e.g., blinking). The response measuring device can record these responses, and the data subsequently can be analyzed in conjunction with the brain activity data.
  • In some embodiments, the means for providing a stimulus and the response measuring device are integrated to facilitate coordination and analysis of the stimuli/questions and responses. One such integrated device which is commercially available for use with MRI devices is the IFIS™ system (MRI Devices Corporation, Gainesville, Fla.).
  • In some embodiments, the invention provides a system which includes a brain activity measuring device (e.g., an MRI, PET, SPECT, qEEG, MEG or DOT device), an SCR measuring device and a system processor connected to both the brain activity measuring device and the skin conductance response measuring device for receiving and processing data from them. The system processor can include software which conducts statistical analysis of the brain activity data by generating brain maps which correspond to differences between responses to truthful control questions and deceptive control questions, and between responses to questions of interest and truthful and/or deceptive control questions. In some embodiments, the system can further include a means for providing a stimulus and a response measuring device, as described above. In embodiments employing an MRI device, the system can further include a shielded data cable for transmitting data from the SCR measuring device to the system processor. In some such embodiments, the system can further comprise a low-pass (e.g., 1 Hz) filter for signal from the SCR measuring device.
  • The SCR measuring device includes at least one pair of electrodes to be attached to an area of the subject's skin. In some embodiments, as described above, the SCR measuring device further includes a device for maintaining substantially constant contact between the SCR electrode and the subject's skin.
  • In some embodiments, the brain activity measuring device is an MRI device, such as a 1.5 T or 3.0 T device. In these embodiments, the strong magnetic fields generated by the MRI device make it necessary to magnetically isolate other electronic components. Current MRI devices are installed in specially-designed chambers which achieve such isolation. However, such chambers are not designed to accommodate an SCR measuring device and its cable connection to a system processor outside the chamber. Therefore, in some embodiments, the invention provides a partition, hatch, or door including an electrical connection called a penetration panel. The door is an electrically conductive panel, e.g., an aluminum screen or ¼″ thick aluminum plate, and in some embodiments includes electrically conductive contact strips attached to the panel and distributed around the door periphery to provide a shielding seal and a mechanical seal between the panel and the doorway. For example, the strips can be contact fingers compressed 70% of their width when the door is closed. The door can be made translucent or transparent to allow a person outside the room to observe activity within the room.
  • The penetration panel can include a connector for attachment to a shielded data cable on the side exterior to the chamber, where the shielding serves to protect the data from noise induced by the magnetic fields of the MRI device. The penetration panel also includes a connector for attachment of an SCR cable that leads the SCR monitoring device and the electrodes in contact with the subject's skin. Thus the penetration panel serves to pass data from the inside of the chamber to the outside. The connectors can be mounted in a connector enclosure. In some embodiments, the connector enclosure provides for filtering of the signals or other data processing. Such filtering can be performed using passive elements (e.g., capacitors and inductors) or active elements (e.g., transistors and amplifiers).
  • In some embodiments, the SCR measuring device transmits SCR data with magnitudes ranging from SCRmin˜0.01 μS to SCRmax˜1 μS. In order to ensure adequate resolution in measuring the SCR, the system suppresses interference during operation to a level σ which is at least an order of magnitude below SCRmin. This can be accomplished by using a low-pass filter with a 3 dB cutoff frequency of approximately 1 Hz. For example, in some embodiments, the SCR measuring device can comprise a Wheatstone bridge (e.g., with a 10-turn potentiometer variable resistor), a differential amplifier (e.g., amplifier gain≧610), and a low-pass filter, with all fixed resistors having approximately 1% tolerance and the minimum bridge output voltage being approximately 1 μV.
  • In each of the foregoing embodiments, the system processor can be adapted to receive brain activity data from the brain activity measuring device and to receive SCR data from the SCR measuring device, and is programmed to determine whether the brain activity of the subject during the response(s) to the question(s) of interest is characteristic of a truthful or a deceptive response. In some embodiments, the system processor is adapted to store the data or statistical analyses on an electronic data storage medium (e.g., a hard disk, floppy disk, compact disk, magnetic tape).
  • The following examples illustrate certain modes and principles relating to the practice of the invention, but are not intended to limit the scope of the invention claimed.
  • Example 1 Subjects.
  • Eight healthy men were examined. The subjects were 21-28 years old (mean age 25), and scored 9-12 (mean score 11) on the Annett Handedness scale for right handedness (Annett (1970)). It was also required that the subjects be able to read and write English; and have the capacity to provide informed consent. Potential subjects were excluded if they had (1) a history of any current or past Axis I Psychiatric Disorder other than simple phobias but including substance abuse/dependence as determined by the Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I) (First et al. (1995)); (2) a history of neurologic disease; (3) a currently unstable medical condition; (4) used psychotropic medication within 5 half-lives of the procedure time; (5) caffeinism; (6) nicotine use; (7) any metal implants or shrapnel which would make an MRI procedure unsafe; (8) irremovable medical devices such as pacemakers or fixed hearing aids; (9) previous inability to tolerate an MRI procedure; or (10) claustrophobia severe enough to induce substantial anxiety in closed spaces.
  • Brain Activity Measurements.
  • Brain activity was measured using BOLD fMRI. The images were acquired using a Picker Edge™ 1.5 T MRI scanner (Picker International, Inc., Cleveland, Ohio) equipped with an actively shielded magnet and high performance whole-body gradients (27 mT/m, 72 T/m-sec). A 15-slice Time-to-Echo (TE) 20 ms structural scan was obtained to evaluate for any structural pathology. The BOLD fMRI consisted of 15 coplanar transverse slices (8.0 mm thick/0 mm gap) covering the entire brain and positioned 90° to the Anterior Commissure-Posterior Commissure (AC-PC) line using a sagittal scout image. Each fMRI volume consisted of BOLD weighted transverse scans and used an asymmetric-spin gradient echo, echo-planar (EPI) fMRI sequence (flip angle=90° to the AC-PC line; TE 45.0 ms; Time-to-Repetition (TR) 3000 ms; fifteen 8 mm thick/0 mm gap transverse slices; Field-of-View (FOV) 300×300 mm; in-plane resolution 2.109×2.109 mm; through-plane resolution 8 mm; frequency selective fat suppression). Given these parameters for the fMRI, a set of fifteen 8 mm thick/0 gap transverse slices covering the entire brain was obtained every 3 seconds.
  • Using BOLD fMRI, brain regions known to be activated during response inhibition (related to the orbitofrontal cortex (OFCx)) (Elliott et al. (2000), divided attention (involving the anterior cingulate (AC)) (Pardo et al. (1991); George et al. (1997); Bush et al. (1998)), and anxiety (involving the amygdala) (Rauch and Savage (1997)) were tested to assess activity during deception. Brain activity was investigated initially as for groups and then for individuals. In order to investigate the correlates of brain activation and psychophysiologic parameters during deception, the relationship between SCR and BOLD-fMRI signal changes were examined.
  • Deception Test Paradigm.
  • The subjects were escorted to each of two rooms, one of which was called the “Truth Room” and the other of which was called the “Deception Room.” There were five different objects in each room, with objects differing between rooms, for a total of ten unique objects in the two rooms. The order of visits to the two rooms was randomized, with half of the subjects going to the Truth Room first and the other half going to the Deception Room first. Within each room, subjects were instructed to find a fifty-dollar bill which was concealed under one of five objects, to remember the location of the money, and to leave it in place. The subjects were then placed in the MRI scanner and provided with video goggles which were connected to a computer system and which displayed pictures of the objects in the Truth and Deception Rooms. SCR electrodes were attached to each subject's left hand, and the data (sampling rate 100 per second) was recorded using LabView™ 5.0.1 (National Instruments, Inc., Austin, Tex.) on a G4 Macintosh™ (Apple Computer, Inc., Sunnyvale, Calif.), as described in Shastri et al. (2001).
  • A control question test paradigm was utilized in which the subjects would give both truthful and deceptive answers about the location of the money while the BOLD fMRI scans were being acquired. Through the video goggles, the subjects were shown prompt screens and then pictures of the objects in the rooms in which the money had been concealed. If a subject had first visited the Truth Room, he was first shown only the Truth Room objects, followed by the Deception Room objects. Conversely, if the subject had first visited the Deception Room, he was first shown only the Deception Room objects, followed by the Truth Room objects. The five objects in each room were each shown once in a block, with a total of four blocks per room. The order of the objects was randomized within each block. Before the picture of the first object and between the pictures of each object in the rooms, a prompt screen was displayed that instructed the subject to raise either one finger for “yes” or two fingers for “no” to indicate whether the money was concealed under an object as soon as a picture of the object was displayed in the goggles. The object and the prompt were each displayed for 10.2 seconds, and responses were monitored by an observer.
  • For the Truth Room, subjects were instructed to accurately report the location of the money by raising the right index finger (one finger) when they were shown an object under which the money had been concealed, and by raising the right index and middle finger (two fingers) when shown an object under which the money was not concealed. These questions served as truthful control questions with which the responses to deceptive control questions were compared.
  • For the Deception Room, subjects were instructed to choose an object that did not have money concealed under it and to respond affirmatively by raising the right index finger (one finger). This required a deceptive affirmative response about the money location. They were also asked to respond negatively by raising the right index and middle finger (two fingers) to all other objects shown, including the object under which the money was concealed. This required a deceptive negative response about the money location. The money was concealed under the same object for all subjects and, therefore, the subjects were consistently lying when the object with money concealed under it was shown.
  • Subjects were told that an investigator unaware of the true location of the money would attempt to determine when they were being deceptive by observing their behavior in the scanner through the control room window. Subjects were also told that they would receive $50 if the subjects accurately reported the position of the money in the Truth Room, and an additional $50 if they successfully deceived the investigator regarding the location of the money in the Deception Room. The monetary rewards were included to increase the motivation and the anxiety during deception task.
  • All subjects correctly responded as instructed for both the Truth Room and Deception Room questions. For the Deception Room questions, each subject consistently provided the same deceptive response for each block of questions, although the object chosen for the affirmative deception varied across the individuals.
  • Functional Magnetic Resonance Imaging Method.
  • Functional MRI data were analyzed with MEDx 3.3™ software (Medical Numerics, Inc., Sterling, Va.) for the visualization, processing, and analysis of medical images, and which includes the SPM96 statistical package and Talairach and Tournoux brain template. Initially, the MEDx motion detection function was performed using the center of intensity weighting method. Any motion greater than 2.0 mm from reference volume would have been corrected using the MEDx 3.3 motion correction function, but no subjects required motion correction, with the largest movement being in the range of 0.4 to −1.7 mm. Next, individual volumes were spatially normalized into Talairach space utilizing the SPM Module 96 in MEDx 3.3. Algorithm parameters included Basic functions and smoothing, x=4, y=5, z=1, iteration=2, smoothing=8.0, deformation=0.2, the SPM template corresponding to the original Talairach and Tournoux atlas (Talairach and Tournoux (1988)) and output voxel size 4×4×4 mm. Using the SPM module again, spatial smoothing was performed using an 8×8×8 mm Gaussian kernel. Intensity normalization was performed which first created a “within the brain” mask that only included voxels if they had an intensity greater than 35% the maximum of each image volume for all time points and then scaled the remaining non-zero voxels in each volume in the time series to a mean value of 1000. High pass temporal filtering was then performed to filter-out patterns greater than twice the cycle length of 204 seconds. Due to the SPM module performing another intensity mask during the upcoming SPM statistics step, a software program was written to add 100 to all voxels outside the brain. When the SPM statistics were run, this ensured that no voxels previously defined as within the brain would be eliminated from the analysis but that voxels previously defined as outside the brain would be eliminated.
  • Identification of Measurement Periods.
  • Using the SPM module on MEDx 3.3, statistical analysis with a delayed boxcar design without temporal filtering was performed. The epochs were grouped as Lie (the time period when individuals gave a deceptive answer—both indicating that the object did not conceal money when it did {4 epochs} and indicating the object concealed money when it did not {4 epochs}), Lprompt (time period prompt image displayed just prior to each Lie {8 epochs}), True1 (time period subjects answered truthfully the location of the money {4 epochs} and 4 truthful answers that the money was not under an object—temporally surrounding deceptive answers {4 epochs}), Prompt1 (time period prompt displayed immediately preceding True1 epochs), True (time period of all remaining truthful answers {24 epochs}), and Prompt (time period of prompt immediately preceding True epochs {24}). Using these epochs, Lie minus True1 and True1 minus Lie was computed with no threshold (p=0.05 and uncorrected k (cluster size)=1). The individual unthresholded images were used to obtain group and individual activation profiles.
  • Group Analyses.
  • Raw brain activity data for each individual was normalized by transforming the data points to z-scores (i.e., by subtracting from each data point the mean value of all data points and then dividing by the standard deviation, to produce a set of z-scores with a mean vale of 0.0 and a standard deviation of 1.0). The resultant z-scores for each voxel. or changes in z-scores for each voxel, were mapped to produce z-maps.
  • To calculate results for the group of individual subjects, the image calculator in MEDx 3.3 was used to compute unthresholded Lie minus True1 z-maps containing both positive and negative z-scores. That is, the image calculator was used to obtain the results of (Lie minus True1) minus (True1 minus Lie) z-maps for each subject. Once these results were obtained for each individual, images were summed and divided by the square root of the sample size (i.e., eight) to create the group fixed effects analysis unthresholded z-map. The resulting image was then analyzed with MEDx 3.3 cluster detection with a minimum of z=1.645 (i.e., the one-sided value for p≦0.05 in the z-distribution) and spatial extent threshold of p≦0.05 (i.e., the probability that the signal is due to chance as opposed to event-related). A low statistical threshold was chosen since the paradigm could have only a limited number of epochs of Lie. The resulting values were used to determine local maxima and visually present the significant clusters. Specifically, the Talairach Daemon interface in MEDx 3.3 was used to identify locations of the local maxima (Lancaster et al. (1997)) and the Talairach atlas (Talairach and Tournoux (1988)) was used to confirm the location of the significant clusters. The definition of the orbitofrontal cortex was based on the Johns Hopkins University BRAID imaging database for the Damasio Talairach space. The MRIcro software was used to identify anatomical areas.
  • The results are shown in Table 1, in which z-scores are calculated as described above, x, y and z coordinates are based upon the MNI template, and BAs are as reported by the MEDx 3.3 software.
  • TABLE 1
    Group Analysis of Significant Changes in Regional Blood
    Flow for Lie minus True1
    z-Score X Y Z BA Anatomic Area1
    3.49 −64 −40 −4 21 L2 Middle Temporal Gyrus
    3.05 56 12 8 44 R3 Precentral Gyrus
    3.00 44 44 −8 R Middle Frontal Gyrus (OF)4
    2.89 −36 −48 −32 L Cerebellum Posterior Lobe
    2.77 −48 −24 4 L Superior Temporal Gyrus
    2.73 −56 −56 −8 37 L Inferior Temporal Gyrus
    2.48 20 56 12 R Superior Frontal Gyrus
    2.32 −28 −32 −28 L Cerebellum Anterior Lobe
    2.03 56 8 20 44 R Inferior Frontal Gyrus (OF)
    2.00 12 52 0 R Anterior Cingulate Cortex
    1Predominant anatomic area of significant BOLD signal as determined using MRIcro.
    2L = Left.
    3R = Right.
    4OF = Orbitofrontal.
  • Thus, this study revealed significant activation during deceptive responses compared with truthful responses (z>1.645 with an extent threshold of p<0.05) in the right frontal (superior, middle, and inferior, including the orbitofrontal) areas, right anterior cingulate gyms, and right precentral gyms.
  • Individual Analyses.
  • For individual analyses, the unthresholded images of True1 minus Lie were subtracted from Lie minus True1 as described above for the group analyses. The resulting image was analyzed using MEDx 3.3 cluster detection with a minimum of z=1.645 and extent threshold of 0.05. The resulting values were used to determine local maxima and generate a visual representation of those significant clusters as described above.
  • The heterogeneity among the subjects in brain activation during the deception task was examined. Each individual was studied to determine if he had significant activation in any of the regions identified in the group analysis during the deception minus true comparison. Using a minimum statistical threshold of z=1.645 and extent threshold of 0.05, one subject had no significant activation, while seven others showed diverse activation patterns. Within subject BOLD fMRI analysis of Lie minus True1 generated large variations in the areas of significant differences in blood flow across the group, and no one brain region was found activated for all subjects. The mean number of discrete regions identified by the group analysis that were activated was 2 per individual subject, with a range of 0 to 6.
  • One explanation for this lack of consistency across individuals is the limited number of epochs that could be classified as deception. There were only eight epochs where the subjects attempted to deceive. Increasing the number of epochs can significantly improve the signal to noise ratio within an individual. Therefore, in some embodiments, a greater number of epochs of deception can be measured in order to increase the power for the individual analysis. In addition, the analysis can include a motion correction on all of the subjects regardless of the degree of movement and a more stringent threshold for significance. In addition, stronger magnetic fields and more sensitive RF measurement devices can be employed (e.g., 3.0 T field and sensitivity encoding technology).
  • Skin Conductance Response Analyses.
  • In order to correlate SCR with the BOLD fMRI signal, the MEDx 3.3 analysis package requires an equal number of volumes and SCR data points. The SCR data corresponding to each volume (TR=3 seconds) were averaged using STATA® statistical software (UCLA Academic Technology Services, Los Angeles, Calif.). Every sequential 300 SCR data points (sampling rate was 100 per second) were averaged to a single point. A total of 272 means corresponding to functional brain volumes were compared. The volumes utilized were the ones that had been motion detected, spatially normalized, smoothed, intensity normalized, and temporally filtered as described above. Using MEDx 3.3, independent of the deception paradigm, the changes in SCR were correlated with BOLD fMRI changes using Pearson's r-correlation. This analysis was performed for each individual resulting in individual z-maps. One of the correlation z-maps was found to have a significant artifact and, therefore, was excluded from the subsequent individual and group analyses.
  • For the group analysis, the remaining seven individual z-maps were added using the MEDx 3.3 calculator and divided by the square root of the sample size (i.e., seven). The resulting image was then analyzed with the MEDx 3.3 cluster detection with a minimum of z=1.960 (i.e., the two-sided value for p≦0.05 in the z-distribution) and spatial extent threshold of p≦0.05. In the direct BOLD comparison above (Lie minus True1), only eight epochs were used. For the correlational analysis, all time points were used, justifying the use of the larger z value threshold. The resulting values were used to determine local maxima and visually present the significant clusters as described above.
  • For the individual analyses, the individual correlation z-maps were each analyzed using the MEDx 3.3 cluster detection with a minimum of z=1.960 and spatial extent threshold of p≦0.05. The resulting values were used to determine local maxima and generate a visual representation of those significant clusters as described above.
  • The results of the group analyses are shown in Table 2, in which z-scores are calculated as described above, x, y and z coordinates are based upon the MM template, and BAs are as reported by the MEDx 3.3 software. The MRIcro software was used to identify anatomical areas. Significant activation was found in the orbitofrontal and right anterior cingulate gyms.
  • TABLE 2
    Group Analysis of Significant Changes in Regional Blood
    Flow Correlated to SCR
    z-Score X Y Z BA Anatomic Area1
    11.04 36 32 −16 R2 Inferior Frontal Gyrus (OF)4
    6.98 56 28 −8 47 R Inferior Frontal Gyrus GM5 (OF)
    5.11 56 32 16 46 R Middle Frontal Gyrus GM (OF)
    5.01 12 36 24 32 R Anterior Cingulate GM
    4.27 −48 −48 40 40 L3 Inferior Parietal Lobule WM6
    L Inferior Parietal Lobule GM
    3.89 12 8 12 R Sub-lobar Caudate GM Caudate
    Body
    3.59 48 32 36 9 R Middle Frontal Gyrus
    R Middle Frontal Gyrus GM
    3.51 64 −32 4 22 R Middle Temporal Gyrus GM
    3.30 8 −4 −4 R Sub-lobar GM Hypothalamus
    2.73 −4 −24 40 31 L Cingulate Gyrus GM
    2.63 56 −40 −16 20 R Inferior Temporal Gyrus WM
    R Inferior Temporal Gyrus GM
    1Predominant anatomic area of significant BOLD signal as determined using MRIcro.
    2R = Right.
    3L = Left.
    4OF = Orbitofrontal.
    5GM = Gray matter.
    6WM = White matter.
  • The group analysis result correlating changes in SCR and BOLD fMRI signal revealed significant correlations between SCR and brain activity in the same two regions (OFCx and AC) that significantly activated in the Lie minus True1 group analysis.
  • Of the seven subjects included in the individual analyses, six had significant (z>1.960 and extent threshold<0.05) right orbitofrontal activation, and five had significant (z>1.960 and extent threshold<0.05) right anterior cingulate activation. No other regions consistently activated across individuals.
  • Example 2 Subjects.
  • Thirteen subjects were scanned, but three were excluded for failure to provide deceptive responses as instructed. Ten healthy subjects (7 men and 3 women) were examined. The subjects were 20-35 years old (mean age 27.8), and scored 10-12 (mean score 11.2) on the Annett Handedness scale for right handedness (Annett (1970)). It was also required that the subjects be able to read and write English; and have the capacity to provide informed consent. Potential subjects were excluded if they had (1) a history of any current or past Axis I Psychiatric Disorder other than simple phobias but including substance abuse/dependence as determined by the Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I) (First et al. (1995)); (2) a history of neurologic disease; (3) a currently unstable medical condition; (4) used psychotropic medication within 5 half-lives of the procedure time; (5) caffeinism; (6) nicotine use; (7) any metal implants or shrapnel which would make an MRI procedure unsafe; (8) irremovable medical devices such as pacemakers or fixed hearing aids; (9) previous inability to tolerate an MRI procedure; or (10) claustrophobia severe enough to induce substantial anxiety in closed spaces. Prior to scanning, female subjects were given a pregnancy test and excluded if it was positive.
  • Brain Activity Measurements.
  • Brain activity was measured using BOLD fMRI. The images were acquired using a Philips Intera 3 T MRI scanner. The BOLD fMRI scans consisted of 26 coplanar transverse slices (4.0 mm thick/1 mm gap) covering the entire brain and positioned 90° to the AC-PC line using a sagittal scout image. Each fMRI volume consisted of BOLD weighted transverse scans and used a single shot gradient EPI sequence (flip angle=90°; TE 30.0 ms; TR 3000 ms; FOV 256×256; matrix 64×64 mm; in-plane resolution 4.0 mm×4.0 mm; through-plane resolution 4 mm). Given these parameters, a set of 120 whole brain volumes was acquired for each run (total of 240 volumes for the study). Following the BOLD fMRI, a structural T1 weighted scan was acquired to insure no major structural abnormalities. The images in these experiments were acquired at a higher field strength (3.0 T versus 1.5 T) than those in Example 1.
  • Images were displayed to the subjects and responses recorded using an IFIS™ system (MRI Devices Corporation, Gainesville, Fla.).
  • Deception Test Paradigm.
  • Subjects were escorted into a room in which six objects were located. Fifty-dollar bills had been placed under two of the objects before the subject entered. The subjects were instructed to find both locations of the two fifty-dollar bills and to leave them in place. The subjects were then made safe to enter the MRI scanner by removing metal objects and by providing hearing protection.
  • Subjects were instructed that they would see pictures of the six objects from the room just visited while in the MRI scanner. The picture of each object would be presented to them multiple times. For each picture, the subject would respond whether money was concealed below the object. The subject would respond “yes” by pushing the right thumb button and “no” by pressing the right index finger button of the IFIS system. The subjects were instructed to choose one of the two objects concealing a fifty-dollar bill and to respond truthfully (i.e., “yes” with the thumb) when presented with an image of that object. The subjects were informed that they would receive $50 for truthfully responding. This question served as a truthful control question. For the other object concealing the other fifty-dollar bill, the subjects were instructed to respond deceptively (i.e., “no” with the index finger) when presented with an image of that object. In addition, the subjects were instructed to choose one of the objects which had not concealed a fifty-dollar bill and to respond deceptively (i.e., “yes” with the thumb) when presented with an image of that object. These two questions served as deceptive control questions. The subjects were told that a research assistant who did not know the location of the money would attempt to determine whether the subject was being deceptive. The subjects were informed that they would receive an additional $50 if the research assistant could not tell when the subject was being deceptive. The research assistant and the IFIS system recorded the subject's responses.
  • For each subject, the tests consisted of 2 runs of 10 blocks. During each block, an image of each of the six objects was presented for six seconds in randomized order. Therefore, each block was 36 seconds and each run was six minutes. There was a one-minute break between runs. Each block required two deceptive responses and four truthful responses. Therefore, these tests required a total of 40 deceptive responses and 80 truthful responses. Therefore, this design included 40 deceptive epochs rather than the 8 deceptive epochs in the design of Example 1.
  • Because each subject chose both one of the two objects concealing money to lie about and one of the four objects not concealing money to lie about, the order and timing of lying and truthful events were different across the group.
  • Functional Magnetic Resonance Imaging Method.
  • The image data were analyzed with Statistical Parametric Mapping 2 (SPM 2) software (www.fil.ion.bpmf.ac.uk/spm/). Initially, images were reoriented to the standard orientation for analysis. The volumes were then realigned and spatially normalized using the Montreal Neurologic Institute (MNI) EPI template in SPM 2. The resulting images were smoothed using a 6 mm kernel. An event model was designed for each subject using deceptive and truthful responses convolved with the hemodynamic response function. The data was modeled and estimations created. Individual analysis was performed with two contrasts: Lie (deceptive responses) minus True (truthful responses); and True minus Lie. Significance was defined as p<0.001 with a cluster value of p-corrected<0.05. A second level (random effects) group analysis was performed using a one-sample t-test (p<0.001, cluster-level p-corrected<0.05) of contrast images for both Lie minus True and True minus Lie. The statistical threshold used for final display and testing was higher for this study (random effects model, p<0.001, cluster p-corrected<0.05) than for the study of Example 1 (fixed effects model, p<0.05, cluster p<0.05). The MRIcro software (available at www.cla.sc.edu/psyc/faculty/rorden/mricro.html; see also Rorden and Brett (2000)) was used to determine the anatomic location and Brodmann areas for significant clusters of activation. The SPM functional map was superimposed on the T1 template skull stripped brain image in MRIcro.
  • In comparison to the study of Example 1, this study had a more conservative threshold for statistical significance (random-effects model with p<0.001 versus fixed-effects model with p<0.05) and used an event-related versus a block design. Nonetheless, as shown below (Tables 3 and 4), an increased level of statistical significance was observed for activation in five brain regions. This may be due to the increased number of deceptive epochs measured (8 versus 40) and the increased field strength of the MRI (1.5 T versus 3.0 T). The individual results also showed more consistency than the previous study, with seven of the ten subjects having significant activation in the right prefrontal cortex.
  • Identification of Measurement Periods.
  • The events analyzed were defined as Lie (subjects gave deceptive responses regarding whether the object was hiding money) and True (subjects gave truthful responses regarding whether the object was hiding money). Contrast maps of, Lie minus True and True minus Lie were computed. The individual contrast maps were used to obtain group and individual activation profiles.
  • Group Analyses.
  • The group analysis for Lie minus True revealed significant activation (p<0.001, cluster p-corrected<0.05) in five areas (right anterior cingulate, right inferior frontal, right orbitofrontal, right middle frontal, and left middle temporal) that are consistent with the study of Example 1. The group analysis of True minus Lie revealed no areas of significant activation.
  • The results are shown in Table 3, in which k is the number of voxels in a cluster, t is Student's t statistic, x, y and z coordinates are based upon the MNI template, and BAs are as reported by the MEDx 3.3 software.
  • TABLE 3
    Group Analysis of Lie minus True1
    Cluster Level Voxel Level MNI
    p p Coordinates
    k (corrected) t (uncorrected) X Y Z BA Anatomic Area1
    65 0.006 9.89 <0.001 4 −28 34 23 R2 Middle Cingulate
    81 0.001 8.53 <0.001 −40 26 −8 47 L3 Inferior Orbitofrontal
    56 0.013 8.03 <0.001 4 20 20 24 R Anterior Cingulate
    −4 24 20 24 L Anterior Cingulate
    396 0.000 7.32 <0.001 52 20 4 45 R Inferior Frontal
    6.17 <0.001 52 32 0 45 R Inferior Orbitofrontal
    5.84 <0.001 44 22 0 47 R Insula
    67 0.005 7.07 <0.001 −60 −60 8 37 L Middle Temporal
    52 0.020 6.79 <0.001 42 44 30 46 R Middle Frontal
    131 0.000 6.12 <0.001 10 −78 20 18 R Cuneus
    79 0.001 6.08 <0.001 −48 −8 54 6 L Post-Central
    1Predominant anatomic area of significant BOLD signal as determined using MRIcro.
    2R = Right.
    3L = Left.
  • Individual Analyses.
  • For the within individual results of Lie minus True, there was a variable degree and pattern of increased BOLD signal. Focusing on the areas that were significantly activated in the group analyses during deceptive responses in both this Example 2 and Example 1, 5 subjects had significant activation (p<0.001, cluster p-corrected<0.05) in the right orbitofrontal cortex, as shown in Table 5. Two subjects did not have any significant activation at this threshold. Taking a broader neuroanatomic perspective (i.e., prefrontal cortex versus only a portion of the prefrontal cortex, such as the orbitofrontal cortex), 7 of 10 subjects had significant right prefrontal activation during the Lie minus True contrast.
  • TABLE 4
    Individual Analysis of Lie minus True
    Subject
    Anatomic Location1 001 002 006 007 008 009 010 011 012 013
    R2 anterior cingulate x
    R inferior frontal x x
    R orbitofrontal x x x x x
    L3 middle temporal x x x
    R middle frontal x x x
    R prefrontal x x x x x x x
    Other activation x
    No Activation x x
    1Predominant anatomic area of significant BOLD signal as determined using MRIcro.
    2R = Right.
    3L = Left.
  • Example 3 Subjects.
  • A subject of interest (e.g., a criminal defendant, an individual with access to confidential information) is identified for examination. Initially, subjects are assessed to determine that they are appropriate. Subjects of interest are not scanned if they have any metal implants or shrapnel which would make an MRI procedure unsafe; irremovable medical devices such as pacemakers or fixed hearing aids that would make the MRI procedure unsafe; or claustrophobia severe enough to induce overwhelming anxiety in closed spaces. The subject is subjected to extensive testing for the use of psychotropic drugs. In addition, medical history, psychiatric history, and handedness are carefully assessed. If the subject has taken psychotropic drugs within 5 half-lives, the test is delayed if possible until 5 half-lives have elapsed. Female subjects are given pregnancy tests. If the subject is pregnant, the test is delayed if possible until after the pregnancy. The ability of the subject of interest to read and write English is determined. If the subject cannot read and write English, a different language is chosen in which the subject has proficiency. If the subject has characteristics (e.g., sex, age, medical status) consistent with previously studied subjects, the results for the previous subjects can validate the applicability of the methods. If the subject differs substantially from previously studied subjects, a group of individuals with matched characteristics can be recruited to validate the methods for the group.
  • The day of scanning, the subject is taken through two fMRI examinations in which the method is first verified to be able to detect deception in the individual (the “verification paradigm”), and then the subject is tested for the questions of interest (the “testing paradigm”). For the verification paradigm, truthful and deceptive control questions and additional neutral control questions are randomly presented. The randomness of the questions prevents anticipation of responses. The verification paradigm establishes that the method is able to detect deception by the individual subject on that day. Following the verification paradigm, the subject performs the testing paradigm in which the structure is the same as the verification paradigm, but in which questions of interest are asked. The same neutral control questions are used for both paradigms. Immediately following scanning, a final drug screen is performed to verify that no unknown substances were taken prior to or during scanning Data analysis will include individual analysis on control questions and questions of interest using a whole-brain analysis and a region of interest approach. Results will be compared to the group analyses generated from previous studies to determine if the subject uses the canonical deceptive brain regions previously identified. Reported results will consist of the deceptive brain regions that can be identified for the subject and the probability or statistical likelihood that the subject was truthful or deceptive in responding to the questions of interest.
  • Brain Activity Measurements.
  • Brain activity measurements are obtained by BOLD fMRI using a 3.0 T MRI scanner (e.g., Philips Intera 3 T) with a sensitivity encoding phased-array head coil (e.g., SENSE™ Head Coil, Philips Electronics, N.V., Amsterdam, Netherlands). The BOLD fMRI scans consist of 36 coplanar transverse slices (3.0 mm thick/0 mm gap) covering the entire brain and positioned 90° to the AC-PC line using a sagittal scout image. Each fMRI volume consists of BOLD weighted transverse scans and uses a single shot gradient EPI sequence (SENSE factor 2, flip angle=90°; TE 30.0 ms; TR 1867 ms; FOV 208×208; matrix 64×64 mm; in-plane resolution 3.25 mm×3.25 mm; through-plane resolution 3 mm). A set of 515 whole brain volumes are acquired for each paradigm. Following the BOLD fMRI, a structural T1 weighted scan is acquired to insure no major structural abnormalities.
  • Deception Verification Paradigm.
  • The subject is brought to a room in which there are two objects (e.g., a ring and a watch) which can potentially be “stolen.” The subjects are given instructions to take one of the objects and are provided an incentive to successfully deceive the investigator. After the subjects take the chosen object and leave the room, an investigator enters the room to confirm which object was taken. The subjects are then placed in the MRI scanner with a video screen for presenting questions and a unit with finger-activated buttons for recording responses (e.g., IFIS-SA™ System, MRI Devices Corporation, Gainesville, Fla.). A series of questions are asked and the subjects respond “yes” or “no” by pressing a button. The questions are of three types: neutral control questions (e.g., “Are you male?”), truthful and deceptive control questions related to the first item (e.g., “Did you steal a ring?”), and truthful and deceptive control questions related to the second item (e.g., “Did you take the money?”). This protocol provides events of deception and events of truthfulness in the same run. There verification paradigm run is approximately 16 minutes for the subject.
  • Deception Testing Paradigm.
  • Testing for the information of interest is performed using the same type of questions and scanning parameters as the verification paradigm. The difference is that questions regarding the matter being tested are substituted for the questions about the ring and the watch. Questions of interest (e.g., “Did you commit the crime of which you are accused?” or “Did you sell the company's confidential information to a competitor?”) are randomly interspersed with the neutral control questions.
  • Functional Magnetic Resonance Imaging Method.
  • The image data are analyzed with SPM 2 software, essentially as described above. An event model is designed for each subject using deceptive and truthful control responses convolved with the hemodynamic response function. For the verification paradigm, individual analysis is performed with four contrasts: Lie (deceptive control responses) minus Control (neutral control responses); Control minus Lie; True (truthful control responses) minus Control; and Control minus True. Significance is defined as p<0.001 with a cluster value of p-corrected<0.05. The MRIcro software is used to determine the anatomic location and Brodmann Areas for significant clusters of activation and the SPM2 functional map is superimposed on the T1 template skull stripped brain image in MRIcro.
  • Next, Unknown (responses to questions of interest) minus Control and Control minus Unknown contrasts are performed for each subject. Significance is again defined as p<0.001 with a cluster value of p-corrected<0.05, and the MRIcro and SPM2 software are used as described above to identify areas of activation.
  • Regions which show significant activation for the testing paradigm in Unknown minus Control are compared with the regions identified as indicative of deception in the Lie minus Control of the verification paradigm. These regions are also compared with the True minus Control in the verification paradigm. Similarly, the Control minus Unknown of the testing paradigm is compared with the Control minus Lie and the Control minus True of the verification paradigm. Thus, the Unknown condition will be matched with either the truthful or the deceptive response pattern confirmed in the verification task.
  • Equivalents.
  • While this invention has been particularly shown and described with references to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Those skilled in the art will recognize, or be able to ascertain using no more than routine experimentation, many equivalents to the specific embodiments of the invention described specifically herein. Such equivalents are intended to be encompassed in the scope of the appended claims.
  • REFERENCES
    • Adler et al. (2000), Health Psychol., 19(6):586-592.
    • Alary et al. (2002), NeuroImage, 15(3):691-6.
    • American Polygraph Association (1996), Polygraph: Issues and Answers, American Polygraph Association, Severa Park, Md.
    • Annett (1970), Brit. J. Psychol., 61:303-321.
    • Ashburner and Friston (1999), Hum. Brain Mapp. 7:254-266.
    • Babiloni et al. (2004), NeuroImage, 21(4):1576-84.
    • Binder et al. (1997), J. Neurosci., 17:353-362.
    • Brodmann (1909), Vergleichende Lokalisationslehre der Groβhirnrinde, Barth, Leipzig.
    • Bush et al. (1998), Hum. Brain Mapp., 6:270-282.
    • Cohen et al. (1990), Psychological Rev., 97:332-361.
    • Collins et al. (1994), J. Comput. Assist. Tomogr. 18:192-205.
    • Collins et al. (1998), IEEE Trans. Med. Imag. 17:463-468.
    • Critchley et al. (2002), NeuroImage, 16:909-918.
    • Ekman et al. (1991), J. Nonverbal Behav. 15:125-135.
    • Elliott et al. (2000), Neuroreport, 11:1739-1744.
    • Farwell and Donchin (1991), Psychophysiol., 28:531-547.
    • Feng et al. (2004), NeuroImage 22:443-446.
    • Fernandez et al. (2001), NeuroImage, 14:585-94.
    • First et al. (1995), Structured Clinical Interview for DSM-IV (SCID), American Psychiatric Press, Washington, D.C.
    • Friston et al. (1995), Hum. Brain Mapp. 2:189-210.
    • Furedy (1986), in Psychophysiology Systems, Processes and Applications—A handbook, Coles, Donchin and Porges (Eds.), Guilford Press, New York, pp. 683-700.
    • Ganis et al. (2003), Cerebral Cortex, 13:830-836.
    • George et al. (1997), J. Neuropsychiatry Clin. Neurosci., 9:55-63.
    • Graham (1999), MMPI-2: Assessing Personality and Psychopathology. 3rd ed., Oxford University Press, New York.
    • Kozel et al. (2003), Hum. Brain Mapp., 19:S33 (Abstract #455).
    • Kozel et al. (2004a), J. Neuropsychiatry Clin. Neurosci., in press.
    • Kozel et al. (2004b), Behav. Neurosci., in press.
    • Lancaster et al. (1997), Hum. Brain Mapp., 5:238-242.
    • Langleben et al. (2002), NeuroImage, 15(3):727-732.
    • Lee et al. (2002), Hum. Brain Mapp., 15(3):157-164.
    • Lorberbaum et al. (1999), Depression and Anxiety, 10:99-104
    • Lubow and Fein (1996), J. Exp. Psychol.: Applied, 2:164-177.
    • MacDonald et al. (2000), Science, 288:1835-8
    • Martin (2003), Neuroanatomy Text and Atlas, 3rd ed., McGraw-Hill, New York.
    • McGonigle et al. (2000), NeuroImage, 11:708-734.
    • Moule et al. (2003) Proc. Natl. Acad. Sci. (USA) 100(16):9122-7.
    • Noguchi et al. (2003), NeuroImage, 19(1):156-162
    • O'Doherty et al. (2001), Nature Neurosci., 4(1):95-102.
    • Ogawa et al. (1990), Proc. Natl. Acad. Sci. (USA), 87(24):9868-9872.
    • Oldfield (1971), Neuropsychologia, 9:97-113.
    • Pardo et al. (1991), Nature 349:61-64.
    • Pavlidis et al. (2002), Nature 415:35.
    • Rain et al. (2000), Arch. Gen. Psychiatry, 57:119-127.
    • Rauch and Savage (1997), Psychiatric Clin. N. Amer., 20:741-768.
    • Rorden and Brett (2000), Behavioural Neurology, 12:191-200.
    • Samuel et al. (1998). Neurology 51:1567-1575.
    • Shastri et al. (2001), J. Magnet. Reson. Imaging, 14:187-193.
    • Sheehan and Statham (1988), Brit. J. Exper. Clin. Hypnosis, 5:87-94.
    • Spence et al. (2001a), NeuroImage 13:Abstract #S477.
    • Spence et al. (2001b), Neuroreport, 12(13):2849-53.
    • Sporer (1997), Applied Cog. Psychol., 11:373-397.
    • Steenhuis and Bryden (1989), Cortex, 25:289-304.
    • Sugiura et al. (2001), Soc. Neurosci. 31st Ann. Mtg., Abstract #80.5.
    • Taga et al. (2003), Proc. Natl. Acad. Sci. (USA), 100(19):10722-7.
    • Talairach and Tournox (1988), Co-Planar Stereotaxic Atlas of the Human Brain, Georg Thieme Verlag, Stuttgart.
    • Tardif et al. (2000), Intl. J. Psychophysiology, 36:1-9.
    • Taylor et al. (1997), NeuroImage, 6(2): 81-92.
    • Thompson et al. (1996), J. Neurosci., 16:4261-4274.
    • Turner et al. (2003), NeuroImage, 19(3):1145-62.
    • Tzourio-Mazoyer et al. (2002), NeuroImage, 15:273-89.
    • van Honk et al. (2001), Arch. Gen. Psychiatry, 58:973-974.
    • Wicker et al. (1998), NeuroImage, 8(2):221-7.
    • Wiley (1998), Psychiatric Clin. N. Amer., 21:870-893.
    • Yankee (1995), J. Forensic Sci., 40:63-68.

Claims (21)

1. A method for determining whether brain activity of a human subject in response to a stimulus of interest is characteristic of a truthful state or a deceptive state, comprising the steps of:
(a) providing a stimulus of interest;
(b) measuring brain activity of said subject in response to said stimulus during a period of interest;
(c) generating a first brain map of activity prior to or after said period of interest;
(d) generating a second brain map of activity during said period of interest; and
(e) generating a third brain map of activity representing the difference between said first brain map and said second brain map; and
(f) determining whether the brain activity in at least one brain region of said third brain map of activity exceeds a predetermined control level of activity,
wherein the brain activity in said at least one brain region of said third brain map of activity is characteristic of said truthful state or said deceptive state if it exceeds said predetermined control level of activity.
2. The method of claim 1 wherein said stimulus is selected from the group consisting of a sound, a picture, an aurally-presented question and a visually-presented question.
3. The method of claim 1 wherein said third brain map includes data representing values of statistical significance or probabilities.
4. The method of claim 1 wherein said control level of activity is a level which is characteristic of either said truthful response or said deceptive response to control questions by said subject.
5. The method of claim 1 further comprising the steps of:
measuring a physiological indicator at least once during said period of interest, wherein said indicator is selected from the group consisting of skin conductance response (SCR), heart rate and blood pressure; and
determining whether said indicator when measured during said period of interest is characteristic of the truthful or the deceptive response.
6. The method of claim 1 wherein said control level of activity is a level which is characteristic of either the truthful response or the deceptive response by a group of individuals.
7. The method of claim 1 wherein brain activity of said subject is measured by fMRI or BOLD fMRI.
8. The method of claim 1 wherein measuring brain activity of said subject occurs multiple times during said period of interest.
9. A method for determining whether brain activity of a human subject during a response to a question of interest is characteristic of a truthful or a deceptive response, comprising the steps of:
(a) asking said subject at least one question of interest, allowing said subject to provide a response of interest during a period of interest, wherein it is not known beforehand whether said response of interest is truthful or deceptive, and measuring brain activity of said subject during said period of interest;
(b) generating a first brain map of activity prior to or after said period of interest;
(c) generating a second brain map of activity during said period of interest; and
(d) generating a third brain map of activity representing the difference between said first brain map and said second brain map; and
(e) determining whether the brain activity in at least one brain of said third brain map of activity exceeds a predetermined control level of activity,
wherein the brain activity in said at least one brain region of said third brain map of activity is characteristic of said truthful or said deceptive response if it exceeds said predetermined control level of activity.
10. The method of claim 9 wherein said control level of activity is a level which is characteristic of either the truthful response or the deceptive response by a group of individuals.
11. The method of claim 9 wherein said control level of activity is a level which is characteristic of either said truthful response or said deceptive response to control questions by said subject.
12. The method of claim 9 wherein said response is selected from the group consisting of a motor, auditory, visual and pain response.
13. The method of claim 9 wherein said third brain map includes data representing values of statistical significance or probabilities.
14. The method of claim 9 further comprising the steps of:
measuring a physiological indicator at least once during said period of interest, wherein said indicator is selected from the group consisting of skin conductance response (SCR), heart rate and blood pressure; and
determining whether said indicator when measured during said period of interest is characteristic of the truthful or the deceptive response.
15. The method of claim 9 wherein brain activity of said subject is measured by fMRI or BOLD fMRI.
16. The method of claim 9 wherein measuring brain activity of said subject occurs multiple times during said period of interest.
17. A method for determining whether brain activity during a response of a human subject to a question of interest is characteristic of a truthful or a deceptive response, comprising the steps of:
(a) asking said subject at least one truthful control question, allowing said subject to provide a response which is known to be a truthful response, and measuring brain activity of said subject during a truthful control period;
(b) asking said subject at least one deceptive control question, allowing said subject to provide a response which is known to be a deceptive response, and measuring brain activity of said subject during a deceptive control period;
(c) asking said subject at least one question of interest, allowing said subject to provide a response of interest during a period of interest, wherein it is not known beforehand whether said response of interest is truthful or deceptive, and measuring brain activity of said subject during said period of interest;
(d) identifying at least one brain region exhibiting a statistically significant difference in brain activity in said subject when measured during said truthful control period and when measured during said deceptive control period;
(e) generating a first brain map of activity during said period of interest;
(f) generating at least a second brain map of activity during at least one of said truthful control period and said deceptive control period; and
(g) generating at least a third brain map of activity representing the difference between said first brain map and said second brain map; and
(h) determining whether brain activity in at least one brain region of said third brain map of activity exceeds a predetermined control level of activity,
wherein the brain activity in said at least one brain region of said third brain map of activity is characteristic of said truthful or said deceptive response if it exceeds said predetermined control level of activity.
18. The method of claim 17 wherein said third brain map includes data representing values of statistical significance or probabilities.
19. The method of claim 17 further comprising the steps of:
measuring a physiological indicator at least once during said period of interest, wherein said indicator is selected from the group consisting of skin conductance response (SCR), heart rate and blood pressure; and
determining whether said indicator when measured during said period of interest is characteristic of the truthful or the deceptive response.
20. The method of claim 17 wherein brain activity of said subject is measured by fMRI or BOLD fMRI.
21. The method of claim 17 wherein measuring brain activity of said subject occurs multiple times during said period of interest.
US13/191,925 2001-12-13 2011-07-27 Systems and methods for detecting deception by measuring brain activity Abandoned US20120022343A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/191,925 US20120022343A1 (en) 2001-12-13 2011-07-27 Systems and methods for detecting deception by measuring brain activity

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US34113701P 2001-12-13 2001-12-13
US34129701P 2001-12-13 2001-12-13
US39605402P 2002-07-15 2002-07-15
PCT/US2002/040142 WO2003049605A2 (en) 2001-12-13 2002-12-13 System and method for detecting deception
US10/868,045 US8014847B2 (en) 2001-12-13 2004-06-14 Systems and methods for detecting deception by measuring brain activity
US13/191,925 US20120022343A1 (en) 2001-12-13 2011-07-27 Systems and methods for detecting deception by measuring brain activity

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/868,045 Continuation US8014847B2 (en) 2001-12-13 2004-06-14 Systems and methods for detecting deception by measuring brain activity

Publications (1)

Publication Number Publication Date
US20120022343A1 true US20120022343A1 (en) 2012-01-26

Family

ID=35510229

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/868,045 Expired - Fee Related US8014847B2 (en) 2001-12-13 2004-06-14 Systems and methods for detecting deception by measuring brain activity
US13/191,925 Abandoned US20120022343A1 (en) 2001-12-13 2011-07-27 Systems and methods for detecting deception by measuring brain activity

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/868,045 Expired - Fee Related US8014847B2 (en) 2001-12-13 2004-06-14 Systems and methods for detecting deception by measuring brain activity

Country Status (5)

Country Link
US (2) US8014847B2 (en)
EP (1) EP1755447A4 (en)
AU (1) AU2005254077A1 (en)
CA (1) CA2569372A1 (en)
WO (1) WO2005122886A2 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130109930A1 (en) * 2011-10-31 2013-05-02 Eyal YAFFE-ERMOZA Polygraph
WO2016193979A1 (en) * 2015-06-03 2016-12-08 Innereye Ltd. Image classification by brain computer interface
WO2017214490A1 (en) * 2016-06-10 2017-12-14 The Regents Of The University Of California Wearable emotional feedback apparatus for autism spectrum disorder
WO2018174507A1 (en) * 2017-03-23 2018-09-27 사회복지법인 삼성생명공익재단 Neurological disorder diagnosis device and method which use virtual reality
US11273283B2 (en) 2017-12-31 2022-03-15 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to enhance emotional response
US11364361B2 (en) 2018-04-20 2022-06-21 Neuroenhancement Lab, LLC System and method for inducing sleep by transplanting mental states
US11452839B2 (en) 2018-09-14 2022-09-27 Neuroenhancement Lab, LLC System and method of improving sleep
US11717686B2 (en) 2017-12-04 2023-08-08 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to facilitate learning and performance
US11723579B2 (en) 2017-09-19 2023-08-15 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement
US11786694B2 (en) 2019-05-24 2023-10-17 NeuroLight, Inc. Device, method, and app for facilitating sleep

Families Citing this family (111)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1420683A4 (en) * 2001-06-15 2009-08-05 Univ Pennsylvania Functional brain imaging for detecting and assessing deception and concealed recognition, and cognitive/emotional response to information
US8014847B2 (en) 2001-12-13 2011-09-06 Musc Foundation For Research Development Systems and methods for detecting deception by measuring brain activity
US20030210820A1 (en) * 2002-05-07 2003-11-13 Rainer Lachner Method and device for localizing a structure in a measured data set
AU2003241457A1 (en) * 2002-05-17 2003-12-02 Musc Foundation For Research Development Method, apparatus, and system for automatically positioning a probe or sensor
JP2007501657A (en) * 2003-08-08 2007-02-01 クアンタム・インテック・インコーポレーテッド Electrophysiological intuition indicator
WO2006093513A2 (en) * 2004-06-14 2006-09-08 Cephos Corp. Question and control paradigms for detecting deception by measuring brain activity
WO2005122885A2 (en) * 2004-06-14 2005-12-29 Cephos Corp. Systems and methods for detecting deception by measuring brain activity
US7572232B2 (en) * 2006-07-24 2009-08-11 Cardiac Pacemakers, Inc. Cardiac signal display and event detection using multiresolution Z-score transform
US8571629B2 (en) * 2006-11-13 2013-10-29 Truth Test Technologies, Llc Detection of deception and truth-telling using fMRI of the brain
US20090030717A1 (en) 2007-03-29 2009-01-29 Neurofocus, Inc. Intra-modality synthesis of central nervous system, autonomic nervous system, and effector data
US20090112621A1 (en) * 2007-10-30 2009-04-30 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Computational user-health testing responsive to a user interaction with advertiser-configured content
US20090132275A1 (en) * 2007-11-19 2009-05-21 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Determining a demographic characteristic of a user based on computational user-health testing
US20080242949A1 (en) * 2007-03-30 2008-10-02 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Computational user-health testing
US20080319276A1 (en) * 2007-03-30 2008-12-25 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Computational user-health testing
US20090024050A1 (en) * 2007-03-30 2009-01-22 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Computational user-health testing
US20080243005A1 (en) * 2007-03-30 2008-10-02 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Computational user-health testing
US20090112616A1 (en) * 2007-10-30 2009-04-30 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Polling for interest in computational user-health test output
US20080287821A1 (en) * 2007-03-30 2008-11-20 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Computational user-health testing
US20090118593A1 (en) * 2007-11-07 2009-05-07 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Determining a demographic characteristic based on computational user-health testing of a user interaction with advertiser-specified content
US20090112620A1 (en) * 2007-10-30 2009-04-30 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Polling for interest in computational user-health test output
US20080242950A1 (en) * 2007-03-30 2008-10-02 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Computational user-health testing
US8065240B2 (en) * 2007-10-31 2011-11-22 The Invention Science Fund I Computational user-health testing responsive to a user interaction with advertiser-configured content
US20090005653A1 (en) * 2007-03-30 2009-01-01 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Computational user-health testing
US20080243543A1 (en) * 2007-03-30 2008-10-02 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Effective response protocols for health monitoring or the like
US20090005654A1 (en) * 2007-03-30 2009-01-01 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Computational user-health testing
US20090119154A1 (en) * 2007-11-07 2009-05-07 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Determining a demographic characteristic based on computational user-health testing of a user interaction with advertiser-specified content
US20080242947A1 (en) * 2007-03-30 2008-10-02 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Configuring software for effective health monitoring or the like
US20080242952A1 (en) * 2007-03-30 2008-10-02 Searete Llc, A Limited Liablity Corporation Of The State Of Delaware Effective response protocols for health monitoring or the like
JP5361868B2 (en) 2007-05-01 2013-12-04 ニューロフォーカス・インコーポレーテッド Neural information storage system
US9886981B2 (en) 2007-05-01 2018-02-06 The Nielsen Company (Us), Llc Neuro-feedback based stimulus compression device
US8392253B2 (en) 2007-05-16 2013-03-05 The Nielsen Company (Us), Llc Neuro-physiology and neuro-behavioral based stimulus targeting system
US8494905B2 (en) * 2007-06-06 2013-07-23 The Nielsen Company (Us), Llc Audience response analysis using simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI)
US20090030287A1 (en) * 2007-06-06 2009-01-29 Neurofocus Inc. Incented response assessment at a point of transaction
EP2152155A4 (en) * 2007-06-06 2013-03-06 Neurofocus Inc Multi-market program and commercial response monitoring system using neuro-response measurements
JP5542051B2 (en) 2007-07-30 2014-07-09 ニューロフォーカス・インコーポレーテッド System, method, and apparatus for performing neural response stimulation and stimulation attribute resonance estimation
US8386313B2 (en) * 2007-08-28 2013-02-26 The Nielsen Company (Us), Llc Stimulus placement system using subject neuro-response measurements
US8635105B2 (en) * 2007-08-28 2014-01-21 The Nielsen Company (Us), Llc Consumer experience portrayal effectiveness assessment system
KR20100047865A (en) * 2007-08-28 2010-05-10 뉴로포커스, 인크. Consumer experience assessment system
US8392255B2 (en) 2007-08-29 2013-03-05 The Nielsen Company (Us), Llc Content based selection and meta tagging of advertisement breaks
US20090083129A1 (en) 2007-09-20 2009-03-26 Neurofocus, Inc. Personalized content delivery using neuro-response priming data
US8494610B2 (en) 2007-09-20 2013-07-23 The Nielsen Company (Us), Llc Analysis of marketing and entertainment effectiveness using magnetoencephalography
US8332883B2 (en) 2007-10-02 2012-12-11 The Nielsen Company (Us), Llc Providing actionable insights based on physiological responses from viewers of media
WO2009059246A1 (en) 2007-10-31 2009-05-07 Emsense Corporation Systems and methods providing en mass collection and centralized processing of physiological responses from viewers
US20100069775A1 (en) * 2007-11-13 2010-03-18 Michael Milgramm EEG-Related Methods
WO2009064475A1 (en) * 2007-11-13 2009-05-22 Wavesynch Technologies, Inc. Method for real time attitude assessment
US8684926B2 (en) * 2008-02-25 2014-04-01 Ideal Innovations Incorporated System and method for knowledge verification utilizing biopotentials and physiologic metrics
US8626264B1 (en) 2008-04-09 2014-01-07 James T. Beran Obtaining information about brain activity
WO2009146388A1 (en) 2008-05-28 2009-12-03 The Trustees Of Columbia University In The City Of New York Voxel-based methods for assessing subjects using positron emission tomography
US20090318773A1 (en) * 2008-06-24 2009-12-24 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Involuntary-response-dependent consequences
US20100145215A1 (en) * 2008-12-09 2010-06-10 Neurofocus, Inc. Brain pattern analyzer using neuro-response data
US8270814B2 (en) 2009-01-21 2012-09-18 The Nielsen Company (Us), Llc Methods and apparatus for providing video with embedded media
US9357240B2 (en) 2009-01-21 2016-05-31 The Nielsen Company (Us), Llc Methods and apparatus for providing alternate media for video decoders
US8464288B2 (en) 2009-01-21 2013-06-11 The Nielsen Company (Us), Llc Methods and apparatus for providing personalized media in video
US20100249538A1 (en) * 2009-03-24 2010-09-30 Neurofocus, Inc. Presentation measure using neurographics
US20100250325A1 (en) 2009-03-24 2010-09-30 Neurofocus, Inc. Neurological profiles for market matching and stimulus presentation
US20100249636A1 (en) * 2009-03-27 2010-09-30 Neurofocus, Inc. Personalized stimulus placement in video games
US20100279260A1 (en) * 2009-05-03 2010-11-04 Bruce Alan White Method of Constructing Questions For Lie Detection Examinations
US8655437B2 (en) 2009-08-21 2014-02-18 The Nielsen Company (Us), Llc Analysis of the mirror neuron system for evaluation of stimulus
US10987015B2 (en) 2009-08-24 2021-04-27 Nielsen Consumer Llc Dry electrodes for electroencephalography
US9560984B2 (en) 2009-10-29 2017-02-07 The Nielsen Company (Us), Llc Analysis of controlled and automatic attention for introduction of stimulus material
US8209224B2 (en) 2009-10-29 2012-06-26 The Nielsen Company (Us), Llc Intracluster content management using neuro-response priming data
US20110106750A1 (en) * 2009-10-29 2011-05-05 Neurofocus, Inc. Generating ratings predictions using neuro-response data
US8335716B2 (en) 2009-11-19 2012-12-18 The Nielsen Company (Us), Llc. Multimedia advertisement exchange
US8335715B2 (en) 2009-11-19 2012-12-18 The Nielsen Company (Us), Llc. Advertisement exchange using neuro-response data
US8700141B2 (en) * 2010-03-10 2014-04-15 Brainscope Company, Inc. Method and apparatus for automatic evoked potentials assessment
WO2011133548A2 (en) 2010-04-19 2011-10-27 Innerscope Research, Inc. Short imagery task (sit) research method
US8655428B2 (en) 2010-05-12 2014-02-18 The Nielsen Company (Us), Llc Neuro-response data synchronization
US8392251B2 (en) 2010-08-09 2013-03-05 The Nielsen Company (Us), Llc Location aware presentation of stimulus material
US8392250B2 (en) 2010-08-09 2013-03-05 The Nielsen Company (Us), Llc Neuro-response evaluated stimulus in virtual reality environments
US8396744B2 (en) 2010-08-25 2013-03-12 The Nielsen Company (Us), Llc Effective virtual reality environments for presentation of marketing materials
US9775545B2 (en) 2010-09-28 2017-10-03 Masimo Corporation Magnetic electrical connector for patient monitors
EP2621333B1 (en) 2010-09-28 2015-07-29 Masimo Corporation Depth of consciousness monitor including oximeter
GB201111067D0 (en) * 2011-06-29 2011-08-10 Metrasens Ltd Apparatus for detecting ferromagnetic objects and screening people and equipment
US20140371549A1 (en) * 2011-10-31 2014-12-18 Eyal YAFFE-ERMOZA Polygraph
US9569986B2 (en) 2012-02-27 2017-02-14 The Nielsen Company (Us), Llc System and method for gathering and analyzing biometric user feedback for use in social media and advertising applications
US9292858B2 (en) 2012-02-27 2016-03-22 The Nielsen Company (Us), Llc Data collection system for aggregating biologically based measures in asynchronous geographically distributed public environments
US9451303B2 (en) 2012-02-27 2016-09-20 The Nielsen Company (Us), Llc Method and system for gathering and computing an audience's neurologically-based reactions in a distributed framework involving remote storage and computing
US20130307533A1 (en) 2012-05-18 2013-11-21 Metrasens Limited Security system and method of detecting contraband items
EP2882342A4 (en) * 2012-08-10 2015-09-09 Valorisation Recherche Ltd Partnership Method and system for assessing a stimulus property perceived by a subject
US8989835B2 (en) 2012-08-17 2015-03-24 The Nielsen Company (Us), Llc Systems and methods to gather and analyze electroencephalographic data
GB201219097D0 (en) 2012-10-24 2012-12-05 Metrasens Ltd Apparatus for detecting ferromagnetic objects at a protected doorway assembly
DE102012111733A1 (en) * 2012-12-03 2014-06-05 Klaus Glaunsinger Method and device for checking the validity of a person's reaction times
US9320450B2 (en) 2013-03-14 2016-04-26 The Nielsen Company (Us), Llc Methods and apparatus to gather and analyze electroencephalographic data
US11080318B2 (en) * 2013-06-27 2021-08-03 Kodak Alaris Inc. Method for ranking and selecting events in media collections
US10238310B2 (en) 2013-12-16 2019-03-26 Ideal Innovations Incorporated Knowledge discovery based on brainwave response to external stimulation
US11666267B2 (en) 2013-12-16 2023-06-06 Ideal Innovations Inc. Knowledge, interest and experience discovery by psychophysiologic response to external stimulation
US9622702B2 (en) 2014-04-03 2017-04-18 The Nielsen Company (Us), Llc Methods and apparatus to gather and analyze electroencephalographic data
JP2017532170A (en) * 2014-09-04 2017-11-02 リフレクション テクノロジーズ リミテッド polygraph
WO2016057553A1 (en) 2014-10-07 2016-04-14 Masimo Corporation Modular physiological sensors
WO2016097724A1 (en) 2014-12-18 2016-06-23 Metrasens Limited Security system and method of detecting contraband items
US10430664B2 (en) * 2015-03-16 2019-10-01 Rohan Sanil System for automatically editing video
US9936250B2 (en) 2015-05-19 2018-04-03 The Nielsen Company (Us), Llc Methods and apparatus to adjust content presented to an individual
US10660531B1 (en) * 2015-10-16 2020-05-26 Furaxa, Inc. Method and apparatus for non-invasive real-time biomedical imaging of neural and vascular activity
JP6775944B2 (en) * 2015-12-14 2020-10-28 キヤノンメディカルシステムズ株式会社 Image processing device
GB201602652D0 (en) 2016-02-15 2016-03-30 Metrasens Ltd Improvements to magnetic detectors
US9730649B1 (en) 2016-09-13 2017-08-15 Open Water Internet Inc. Optical imaging of diffuse medium
US10034645B1 (en) * 2017-04-13 2018-07-31 The Board Of Trustees Of The Leland Stanford Junior University Systems and methods for detecting complex networks in MRI image data
US10778911B2 (en) 2018-03-31 2020-09-15 Open Water Internet Inc. Optical transformation device for imaging
US10778912B2 (en) 2018-03-31 2020-09-15 Open Water Internet Inc. System and device for optical transformation
US10506181B2 (en) 2018-03-31 2019-12-10 Open Water Internet Inc. Device for optical imaging
US10966612B2 (en) 2018-06-14 2021-04-06 Open Water Internet Inc. Expanding beam optical element
US10962929B2 (en) 2018-09-14 2021-03-30 Open Water Internet Inc. Interference optics for optical imaging device
US10874370B2 (en) 2019-01-28 2020-12-29 Open Water Internet Inc. Pulse measurement in optical imaging
US10955406B2 (en) 2019-02-05 2021-03-23 Open Water Internet Inc. Diffuse optical imaging with multiple beams
US11320370B2 (en) 2019-06-26 2022-05-03 Open Water Internet Inc. Apparatus for directing optical and acoustic signals
US11581696B2 (en) 2019-08-14 2023-02-14 Open Water Internet Inc. Multi-channel laser
US11622686B2 (en) 2019-11-22 2023-04-11 Open Water Internet, Inc. Optical imaging with unshifted reference beam
US11819318B2 (en) 2020-04-27 2023-11-21 Open Water Internet Inc. Optical imaging from light coherence
US11559208B2 (en) 2020-05-19 2023-01-24 Open Water Internet Inc. Imaging with scattering layer
US11259706B2 (en) 2020-05-19 2022-03-01 Open Water Internet Inc. Dual wavelength imaging and out of sample optical imaging
CN115114950B (en) * 2021-07-02 2023-08-04 北京师范大学 Method, device and equipment for testing decision uncertainty

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5295491A (en) * 1991-09-26 1994-03-22 Sam Technology, Inc. Non-invasive human neurocognitive performance capability testing method and system
US5564433A (en) * 1994-12-19 1996-10-15 Thornton; Kirtley E. Method for the display, analysis, classification, and correlation of electrical brain function potentials
US20020082495A1 (en) * 2000-03-29 2002-06-27 Biswal Bharat B. Method for determining the reliability of fMRI parameters
US20030120140A1 (en) * 2001-03-23 2003-06-26 Bango Joseph J. Polygraph utilizing medical imaging

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5137027A (en) * 1987-05-01 1992-08-11 Rosenfeld Joel P Method for the analysis and utilization of P300 brain waves
US4932416A (en) * 1987-05-01 1990-06-12 Rosenfeld Joel P Method for the analysis, display and classification of event related potentials by interpretation of P3 responses
US5113870A (en) * 1987-05-01 1992-05-19 Rossenfeld Joel P Method and apparatus for the analysis, display and classification of event related potentials by interpretation of P3 responses
US4941477A (en) * 1987-09-09 1990-07-17 University Patents, Inc. Method and apparatus for detection of deception
US5170780A (en) * 1991-05-30 1992-12-15 Rosenfeld J Peter Method of credibility assessment based on feedback-elicited P3 responses of brain
US5406956A (en) * 1993-02-11 1995-04-18 Francis Luca Conte Method and apparatus for truth detection
US5363858A (en) * 1993-02-11 1994-11-15 Francis Luca Conte Method and apparatus for multifaceted electroencephalographic response analysis (MERA)
US5622181A (en) * 1994-11-15 1997-04-22 Rosenfeld; J. Peter Method and system for detection of memory deficiency malingering utilizing brain waves
US5707334A (en) * 1995-08-21 1998-01-13 Young; Robert B. Method of treating amygdala related transitory disorders
US5676138A (en) * 1996-03-15 1997-10-14 Zawilinski; Kenneth Michael Emotional response analyzer system with multimedia display
RU2107460C1 (en) * 1996-05-28 1998-03-27 Акционерное общество закрытого типа "Нейроком" Method and device for recording galvanic skin responses
US5995857A (en) * 1996-07-01 1999-11-30 Toomim; I. Hershel Biofeedback of human central nervous system activity using radiation detection
US5876334A (en) * 1997-03-26 1999-03-02 Levy; George S. Lie detector system using reaction time
US5957859A (en) * 1997-07-28 1999-09-28 J. Peter Rosenfeld Ph.D. Method and system for detection of deception using scaled P300 scalp amplitude distribution
US6198958B1 (en) * 1998-06-11 2001-03-06 Beth Israel Deaconess Medical Center, Inc. Method and apparatus for monitoring a magnetic resonance image during transcranial magnetic stimulation
WO2001037717A2 (en) * 1999-11-26 2001-05-31 Applied Spectral Imaging Ltd. System and method for functional brain mapping
US6453194B1 (en) * 2000-03-29 2002-09-17 Daniel A. Hill Method of measuring consumer reaction while participating in a consumer activity
US6356781B1 (en) 2000-03-31 2002-03-12 Lucent Technologies, Inc. Functional magnetic resonance imaging capable of detecting the occurrence of neuronal events with high temporal accuracy
US6996256B2 (en) * 2000-06-08 2006-02-07 Honeywell International Inc. Detection system and method using thermal image analysis
US7010351B2 (en) * 2000-07-13 2006-03-07 Northstar Neuroscience, Inc. Methods and apparatus for effectuating a lasting change in a neural-function of a patient
US6294972B1 (en) * 2000-08-03 2001-09-25 The Mcw Research Foundation, Inc. Method for shimming a static magnetic field in a local MRI coil
US6754524B2 (en) * 2000-08-28 2004-06-22 Research Foundation Of The City University Of New York Method for detecting deception
US6854879B2 (en) * 2001-04-19 2005-02-15 Honeywell International Inc. System and method using thermal image analysis for polygraph testing
US7111980B2 (en) * 2001-04-19 2006-09-26 Honeywell International Inc. System and method using thermal image analysis and slope threshold classification for polygraph testing
US6572528B2 (en) * 2001-04-20 2003-06-03 Mclean Hospital Corporation Magnetic field stimulation techniques
DE10122426A1 (en) * 2001-05-09 2003-01-23 Siemens Ag Method for operating a magnetic resonance device and magnetic resonance device for performing the method
EP1420683A4 (en) 2001-06-15 2009-08-05 Univ Pennsylvania Functional brain imaging for detecting and assessing deception and concealed recognition, and cognitive/emotional response to information
EP1269913B1 (en) * 2001-06-28 2004-08-04 BrainLAB AG Device for transcranial magnetic stimulation and cortical cartography
WO2003049605A2 (en) 2001-12-13 2003-06-19 Musc Foundation For Research Development System and method for detecting deception
US8014847B2 (en) 2001-12-13 2011-09-06 Musc Foundation For Research Development Systems and methods for detecting deception by measuring brain activity
US20040143170A1 (en) * 2002-12-20 2004-07-22 Durousseau Donald R. Intelligent deception verification system
GB2421329B (en) * 2003-06-20 2007-10-24 Brain Fingerprinting Lab Inc Apparatus for a classification guilty knowledge test and integrated system for detection of deception and information
WO2005122885A2 (en) * 2004-06-14 2005-12-29 Cephos Corp. Systems and methods for detecting deception by measuring brain activity

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5295491A (en) * 1991-09-26 1994-03-22 Sam Technology, Inc. Non-invasive human neurocognitive performance capability testing method and system
US5564433A (en) * 1994-12-19 1996-10-15 Thornton; Kirtley E. Method for the display, analysis, classification, and correlation of electrical brain function potentials
US20020082495A1 (en) * 2000-03-29 2002-06-27 Biswal Bharat B. Method for determining the reliability of fMRI parameters
US20030120140A1 (en) * 2001-03-23 2003-06-26 Bango Joseph J. Polygraph utilizing medical imaging

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8870765B2 (en) * 2011-10-31 2014-10-28 Eyal YAFFE-ERMOZA Polygraph
US20130109930A1 (en) * 2011-10-31 2013-05-02 Eyal YAFFE-ERMOZA Polygraph
WO2016193979A1 (en) * 2015-06-03 2016-12-08 Innereye Ltd. Image classification by brain computer interface
US10303971B2 (en) 2015-06-03 2019-05-28 Innereye Ltd. Image classification by brain computer interface
US10948990B2 (en) 2015-06-03 2021-03-16 Innereye Ltd. Image classification by brain computer interface
WO2017214490A1 (en) * 2016-06-10 2017-12-14 The Regents Of The University Of California Wearable emotional feedback apparatus for autism spectrum disorder
WO2018174507A1 (en) * 2017-03-23 2018-09-27 사회복지법인 삼성생명공익재단 Neurological disorder diagnosis device and method which use virtual reality
US20200093414A1 (en) 2017-03-23 2020-03-26 Samsung Life Public Welfare Foundation Nerve disorder diagnosis apparatus and method using virtual reality
US11826160B2 (en) 2017-03-23 2023-11-28 Samsung Life Public Welfare Foundation Nerve disorder diagnosis apparatus and method using virtual reality
US11723579B2 (en) 2017-09-19 2023-08-15 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement
US11717686B2 (en) 2017-12-04 2023-08-08 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to facilitate learning and performance
US11273283B2 (en) 2017-12-31 2022-03-15 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to enhance emotional response
US11478603B2 (en) 2017-12-31 2022-10-25 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to enhance emotional response
US11318277B2 (en) 2017-12-31 2022-05-03 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to enhance emotional response
US11364361B2 (en) 2018-04-20 2022-06-21 Neuroenhancement Lab, LLC System and method for inducing sleep by transplanting mental states
US11452839B2 (en) 2018-09-14 2022-09-27 Neuroenhancement Lab, LLC System and method of improving sleep
US11786694B2 (en) 2019-05-24 2023-10-17 NeuroLight, Inc. Device, method, and app for facilitating sleep

Also Published As

Publication number Publication date
US20050119547A1 (en) 2005-06-02
US8014847B2 (en) 2011-09-06
AU2005254077A1 (en) 2005-12-29
WO2005122886A3 (en) 2007-04-05
EP1755447A2 (en) 2007-02-28
EP1755447A4 (en) 2009-12-09
WO2005122886A2 (en) 2005-12-29
CA2569372A1 (en) 2005-12-29

Similar Documents

Publication Publication Date Title
US8014847B2 (en) Systems and methods for detecting deception by measuring brain activity
US7899524B2 (en) Systems and methods for detecting deception by measuring brain activity
US7729755B2 (en) Questions and control paradigms for detecting deception by measuring brain activity
US8571629B2 (en) Detection of deception and truth-telling using fMRI of the brain
Kanske et al. Dissecting the social brain: Introducing the EmpaToM to reveal distinct neural networks and brain–behavior relations for empathy and Theory of Mind
AU2002344817B2 (en) Functional brain imaging for detecting and assessing deception and concealed recognition, and cognitive/emotional response to information
Mohamed et al. Brain mapping of deception and truth telling about an ecologically valid situation: functional MR imaging and polygraph investigation—initial experience
Deeley et al. Facial emotion processing in criminal psychopathy: Preliminary functional magnetic resonance imaging study
US20060173274A1 (en) Functional magnetic resonance imaging guided transcranial magnetic stimulation deception inhibitor
AU2002344817A1 (en) Functional brain imaging for detecting and assessing deception and concealed recognition, and cognitive/emotional response to information
Niu et al. Comparing test-retest reliability of entropy methods: Complexity analysis of resting-state fMRI
Cho et al. A study of alpha brain wave characteristics from MRI scanning in patients with anxiety disorder
Das et al. Evaluating interhemispheric connectivity during midline object recognition using EEG
Heravi et al. Recurrence quantification analysis of electrooculography signal to a control question test: A new approach for the detection of deception
He et al. Measuring temporal dynamics of resting-state fMRI data
WO2003049605A2 (en) System and method for detecting deception
Yusoff et al. Brain activations evoked by passive and active listening: A preliminary study on multiple subjects
Mohamed et al. Brain Mapping of Deception and Truth Telling About an Ecologically Valid Situation: An fMRI and polygraph investigation
Quinton et al. Facial emotion processing in criminalpsychopathy
Wolfe et al. THE FIRST INTERNATIONAL CONFERENCE
BRAMMER et al. Facial emotion processing in criminal psychopathy: Preliminary

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION