CA2374521A1 - Test question response verification system - Google Patents

Test question response verification system Download PDF

Info

Publication number
CA2374521A1
CA2374521A1 CA002374521A CA2374521A CA2374521A1 CA 2374521 A1 CA2374521 A1 CA 2374521A1 CA 002374521 A CA002374521 A CA 002374521A CA 2374521 A CA2374521 A CA 2374521A CA 2374521 A1 CA2374521 A1 CA 2374521A1
Authority
CA
Canada
Prior art keywords
verification system
test question
question response
response verification
editing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002374521A
Other languages
French (fr)
Other versions
CA2374521C (en
Inventor
Kristian Knowles
Robert Pascale
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NCS Pearson Inc
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2374521A1 publication Critical patent/CA2374521A1/en
Application granted granted Critical
Publication of CA2374521C publication Critical patent/CA2374521C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Abstract

The present invention relates to a system and method for verifying and editing optically imaged responses received from a response provider. 31
CA002374521A 2001-03-05 2002-03-05 Test question response verification system Expired - Lifetime CA2374521C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/799,299 US6751351B2 (en) 2001-03-05 2001-03-05 Test question response verification system
US09/799,299 2001-03-05

Publications (2)

Publication Number Publication Date
CA2374521A1 true CA2374521A1 (en) 2002-09-05
CA2374521C CA2374521C (en) 2008-05-20

Family

ID=25175533

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002374521A Expired - Lifetime CA2374521C (en) 2001-03-05 2002-03-05 Test question response verification system

Country Status (4)

Country Link
US (1) US6751351B2 (en)
EP (1) EP1239438A3 (en)
AU (1) AU778565B2 (en)
CA (1) CA2374521C (en)

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6173154B1 (en) * 1997-07-31 2001-01-09 The Psychological Corporation System and method for imaging test answer sheets having open-ended questions
US6810232B2 (en) * 2001-03-05 2004-10-26 Ncs Pearson, Inc. Test processing workflow tracking system
US7197459B1 (en) * 2001-03-19 2007-03-27 Amazon Technologies, Inc. Hybrid machine/human computing arrangement
US20030035646A1 (en) * 2001-08-20 2003-02-20 Vat 19, Llc Digital video device having a verification code thereon and method of generating a verification code
US20030041270A1 (en) * 2001-08-27 2003-02-27 E-Chain Cheng Intelligent identifying method
US6690913B2 (en) * 2001-12-20 2004-02-10 Kabushiki Kaisha Toshiba Correction support apparatus, correction support method, correction support program, and correction support system
US20030180703A1 (en) * 2002-01-28 2003-09-25 Edusoft Student assessment system
US8892895B1 (en) 2002-05-07 2014-11-18 Data Recognition Corporation Integrated system for electronic tracking and control of documents
US6772081B1 (en) 2002-05-21 2004-08-03 Data Recognition Corporation Priority system and method for processing standardized tests
US8385811B1 (en) 2003-02-11 2013-02-26 Data Recognition Corporation System and method for processing forms using color
US7478756B1 (en) 2003-03-04 2009-01-20 Data Recognition Corporation Method and apparatus for pen based data entry and storage
US8155578B2 (en) * 2004-05-14 2012-04-10 Educational Testing Service Method and system for generating and processing an assessment examination
US20060035204A1 (en) * 2004-08-11 2006-02-16 Lamarche Wesley E Method of processing non-responsive data items
JP2006201935A (en) * 2005-01-19 2006-08-03 Fuji Xerox Co Ltd Image data processor
JP4872214B2 (en) * 2005-01-19 2012-02-08 富士ゼロックス株式会社 Automatic scoring device
US8041347B2 (en) 2005-01-21 2011-10-18 Responsive Innovations, Llc Transmitter controlled communication links
US7330716B2 (en) 2005-01-21 2008-02-12 Responsive Innovations, Llc Wireless communication system
US20060215936A1 (en) * 2005-03-25 2006-09-28 Barnaby Dorfman Systems and methods for the dissemination of content by a network using a facsimile machine
US7284177B2 (en) * 2005-03-31 2007-10-16 Verisity, Ltd. Method and apparatus for functionally verifying a physical device under test
US20060257841A1 (en) * 2005-05-16 2006-11-16 Angela Mangano Automatic paper grading and student progress tracking system
US20090029336A1 (en) * 2005-05-16 2009-01-29 Manja, Inc. Automatic form checking and tracking
US8170466B2 (en) * 2005-05-27 2012-05-01 Ctb/Mcgraw-Hill System and method for automated assessment of constrained constructed responses
US20070048718A1 (en) * 2005-08-09 2007-03-01 Exam Grader, Llc System and Method for Test Creation, Verification, and Evaluation
US8175394B2 (en) 2006-09-08 2012-05-08 Google Inc. Shape clustering in post optical character recognition processing
US7697758B2 (en) * 2006-09-11 2010-04-13 Google Inc. Shape clustering and cluster-level manual identification in post optical character recognition processing
KR101486495B1 (en) * 2006-09-08 2015-02-04 구글 인코포레이티드 Shape clustering in post optical character recognition processing
US7646921B2 (en) * 2006-09-11 2010-01-12 Google Inc. High resolution replication of document based on shape clustering
US7650035B2 (en) * 2006-09-11 2010-01-19 Google Inc. Optical character recognition based on shape clustering and multiple optical character recognition processes
US20080108298A1 (en) * 2006-11-07 2008-05-08 Selen Mats A Certified two way source initiated transfer
US8793756B2 (en) * 2006-12-20 2014-07-29 Dst Technologies, Inc. Secure processing of secure information in a non-secure environment
US9679256B2 (en) 2010-10-06 2017-06-13 The Chancellor, Masters And Scholars Of The University Of Cambridge Automated assessment of examination scripts
US20120189999A1 (en) * 2011-01-24 2012-07-26 Xerox Corporation System and method for using optical character recognition to evaluate student worksheets
US9720890B2 (en) * 2013-08-06 2017-08-01 Educational Testing Service System and method for rendering an assessment item
US9317760B2 (en) 2014-04-14 2016-04-19 Xerox Corporation Methods and systems for determining assessment characters
US10471594B2 (en) * 2015-12-01 2019-11-12 Kindred Systems Inc. Systems, devices, and methods for the distribution and collection of multimodal data associated with robots
US11410569B1 (en) * 2018-11-13 2022-08-09 Teacher Synergy LLC Methods, systems, and media for identifying and scoring assignment answers

Family Cites Families (98)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3405457A (en) 1965-10-23 1968-10-15 Univ Illinois Versatile display teaching system
US3538626A (en) 1968-02-16 1970-11-10 Response Systems Corp Student-responder apparatus
US3762072A (en) 1971-07-16 1973-10-02 Lerali Sa Apparatus for the individual and automatic monitoring of replies given under examination
JPS5147091B2 (en) 1971-09-30 1976-12-13
US3932948A (en) 1973-04-18 1976-01-20 Eastman Kodak Company Audio-visual learning system
US4205780A (en) 1977-03-21 1980-06-03 Teknekron, Inc. Document processing system and method
US4151659A (en) 1978-06-07 1979-05-01 Eric F. Burtis Machine for teaching reading
DE3009211C2 (en) 1980-03-11 1983-08-18 Volker Prof. Dr. 6905 Schriesheim Hepp Mobile event module
US4518361A (en) 1982-08-05 1985-05-21 Conway Malcolm J Method and apparatus for effecting and evaluating action upon visual imaging
US4798543A (en) 1983-03-31 1989-01-17 Bell & Howell Company Interactive training method and system
US4553261A (en) 1983-05-31 1985-11-12 Horst Froessl Document and data handling and retrieval system
US4478584A (en) 1983-08-26 1984-10-23 Kathryn Kaney Method for recording uncoded scores or ratings by multiple evaluators on a single automatic machine scannable document
US4705479A (en) 1984-07-09 1987-11-10 Maron Melvin J Process of teaching
US4899276A (en) 1984-08-14 1990-02-06 International Business Machines Corporation Field-directed screen help technique
DE3529301A1 (en) 1984-08-28 1986-03-27 Jost von Dr. Grüningen Fellenberg Psychotechnical method and device for conducting the method
US4694352A (en) 1984-09-21 1987-09-15 Canon Kabushiki Kaisha Image information processing system
US4715818A (en) 1984-12-04 1987-12-29 Ronald Lewis Shapiro Computer training system
US4648062A (en) 1985-02-01 1987-03-03 International Business Machines Corporation Method for providing an on line help facility for interactive information handling systems
US4708503A (en) 1985-03-21 1987-11-24 Meadowbrook Industries, Inc. Work carrier for use in computer printing
US4845739A (en) 1985-07-10 1989-07-04 Fdr Interactive Technologies Telephonic-interface statistical analysis system
US4908759A (en) 1985-08-29 1990-03-13 Bell Communications Research, Inc. Hierarchical database conversion with conditional write
US4671772A (en) 1985-10-22 1987-06-09 Keilty, Goldsmith & Boone Performance appraisal and training system and method of utilizing same
US4741047A (en) 1986-03-20 1988-04-26 Computer Entry Systems Corporation Information storage, retrieval and display system
US4764120A (en) 1986-05-27 1988-08-16 Mcdonald's Corporation Student response system
US4930077A (en) 1987-04-06 1990-05-29 Fan David P Information processing expert system for text analysis and predicting public opinion based information available to the public
US4760246A (en) 1987-04-20 1988-07-26 Cognitronics Corporation Mark-reading apparatus for use with answer sheets
BE1000649A6 (en) 1987-06-17 1989-02-28 Foret Eric Gathering of responses to surveys and competitions - using card with preformed identification coding and set of response windows which can be optically scanned for computer
US4867685A (en) 1987-09-24 1989-09-19 The Trustees Of The College Of Aeronautics Audio visual instructional system
US4996642A (en) 1987-10-01 1991-02-26 Neonics, Inc. System and method for recommending items
US4895518A (en) 1987-11-02 1990-01-23 The University Of Michigan Computerized diagnostic reasoning evaluation system
US4878175A (en) 1987-11-03 1989-10-31 Emtek Health Care Systems Method for generating patient-specific flowsheets by adding/deleting parameters
US5147205A (en) 1988-01-29 1992-09-15 Gross Theodore D Tachistoscope and method of use thereof for teaching, particularly of reading and spelling
US4937439A (en) 1988-05-13 1990-06-26 National Computer Systems, Inc. Method and system for creating and scanning a customized survey form
US5058185A (en) 1988-06-27 1991-10-15 International Business Machines Corporation Object management and delivery system having multiple object-resolution capability
US5100329A (en) 1990-06-22 1992-03-31 Deesen Kenneth C Computer assisted coaching method
US5054096A (en) 1988-10-24 1991-10-01 Empire Blue Cross/Blue Shield Method and apparatus for converting documents into electronic data for transaction processing
US5072383A (en) 1988-11-19 1991-12-10 Emtek Health Care Systems, Inc. Medical information system with automatic updating of task list in response to entering orders and charting interventions on associated forms
US4958284A (en) 1988-12-06 1990-09-18 Npd Group, Inc. Open ended question analysis system and method
US5003613A (en) 1988-12-21 1991-03-26 Recognition Equipment Incorporated Document processing system and method
US5105354A (en) 1989-01-23 1992-04-14 Nippon Kayaku Kabushiki Kaisha Method and apparatus for correlating respiration and heartbeat variability
US5086385A (en) 1989-01-31 1992-02-04 Custom Command Systems Expandable home automation system
US5140650A (en) 1989-02-02 1992-08-18 International Business Machines Corporation Computer-implemented method for automatic extraction of data from printed forms
US5002491A (en) 1989-04-28 1991-03-26 Comtek Electronic classroom system enabling interactive self-paced learning
US4978305A (en) 1989-06-06 1990-12-18 Educational Testing Service Free response test grading method
US5011413A (en) 1989-07-19 1991-04-30 Educational Testing Service Machine-interpretable figural response testing
US5211564A (en) 1989-07-19 1993-05-18 Educational Testing Service Computerized figural response testing system and method
US5035625A (en) 1989-07-24 1991-07-30 Munson Electronics, Inc. Computer game teaching method and system
CA1321026C (en) 1989-09-28 1993-08-03 Arny I. Sokoloff Method and apparatus for optically reading pre-printed survey pages
US5059127A (en) 1989-10-26 1991-10-22 Educational Testing Service Computerized mastery testing system, a computer administered variable length sequential testing system for making pass/fail decisions
US5140139A (en) * 1989-11-13 1992-08-18 Cognitronics Corporation Preparing mark/read documents with markable boxes and locating the boxes from the document scan data
US5318450A (en) 1989-11-22 1994-06-07 Gte California Incorporated Multimedia distribution system for instructional materials
US5344132A (en) 1990-01-16 1994-09-06 Digital Image Systems Image based document processing and information management system and apparatus
US5038392A (en) 1990-02-12 1991-08-06 International Business Machines Corporation Method and apparatus for adaptive image processing by recognizing a characterizing indicium in a captured image of a document
US5023435A (en) 1990-03-06 1991-06-11 Deniger David B Response form processing system
US5119433A (en) 1990-03-12 1992-06-02 International Business Machines Corporation Method and system for locating the amount field on a document
US5151948A (en) 1990-03-12 1992-09-29 International Business Machines Corporation System and method for processing documents having amounts recorded thereon
US5176520A (en) 1990-04-17 1993-01-05 Hamilton Eric R Computer assisted instructional delivery system and method
USRE34476E (en) 1990-05-14 1993-12-14 Norwood Donald D Hybrid information management system for handwriting and text
US5195033A (en) 1990-06-08 1993-03-16 Assessment Systems, Inc. Testing system including removable storage means for transfer of test related data and means for issuing a certification upon successful completion of the test
US5204813A (en) 1990-06-08 1993-04-20 Assessment Systems, Inc. Computer-controlled testing process and device for administering an examination
US5134669A (en) 1990-06-13 1992-07-28 National Computer Systems Image processing system for documentary data
US5103490A (en) 1990-06-13 1992-04-07 National Computer Systems, Inc. Method and apparatus for storing and merging multiple optically scanned images
US5180309A (en) 1990-12-04 1993-01-19 United States Of America As Represented By The Secretary Of The Navy Automated answer evaluation and scoring system and method
JPH04241381A (en) 1991-01-16 1992-08-28 Brother Ind Ltd Electronic learning machine
JPH04246791A (en) 1991-02-01 1992-09-02 Hitachi Ltd Questionnaire data collecting and analyzing system
US5258855A (en) 1991-03-20 1993-11-02 System X, L. P. Information processing methodology
US5634101A (en) 1991-05-31 1997-05-27 R. Alan Blau & Associates, Co. Method and apparatus for obtaining consumer information
US5452379A (en) 1991-09-13 1995-09-19 Meadowbrook Industries, Ltd. Image capture and storage techniques in association with optical mark reading
US5259766A (en) 1991-12-13 1993-11-09 Educational Testing Service Method and system for interactive computer science testing, anaylsis and feedback
DE4141920A1 (en) 1991-12-19 1993-06-24 Mathias Zirm METHOD FOR LEARNING MICRO-SURGICAL OPERATING TECHNIQUES AND DEVICE FOR EXERCISING THE METHOD
US5294229A (en) 1992-01-27 1994-03-15 Jonathan Hartzell Teacher and parent interactive communication system incorporating pocket sized portable audio numeric terminals
US5379213A (en) 1992-01-28 1995-01-03 Fleetwood Furniture Company, Inc. Test scoring system and method
US5267865A (en) 1992-02-11 1993-12-07 John R. Lee Interactive computer aided natural learning method and apparatus
US5418865A (en) 1992-03-20 1995-05-23 Xerox Corporation Mark sensing on a form
US5302132A (en) 1992-04-01 1994-04-12 Corder Paul R Instructional system and method for improving communication skills
US5310349A (en) 1992-04-30 1994-05-10 Jostens Learning Corporation Instructional management system
US5672060A (en) 1992-07-08 1997-09-30 Meadowbrook Industries, Ltd. Apparatus and method for scoring nonobjective assessment materials through the application and use of captured images
US5987149A (en) 1992-07-08 1999-11-16 Uniscore Incorporated Method for scoring and control of scoring open-ended assessments using scorers in diverse locations
US5565316A (en) 1992-10-09 1996-10-15 Educational Testing Service System and method for computer based testing
US5416312A (en) 1992-11-20 1995-05-16 Cherloc Document bearing an image or a text and provided with an indexing frame, and associated document analysis system
WO1994015272A1 (en) 1992-12-22 1994-07-07 Morgan Michael W Pen-based electronic teaching system
US5433615A (en) 1993-02-05 1995-07-18 National Computer Systems, Inc. Categorized test item reporting system
US5321611A (en) 1993-02-05 1994-06-14 National Computer Systems, Inc. Multiple test scoring system
US5437554A (en) 1993-02-05 1995-08-01 National Computer Systems, Inc. System for providing performance feedback to test resolvers
JP3693691B2 (en) 1993-12-30 2005-09-07 株式会社リコー Image processing device
US5544255A (en) 1994-08-31 1996-08-06 Peripheral Vision Limited Method and system for the capture, storage, transport and authentication of handwritten signatures
DK0934581T3 (en) 1996-09-25 2003-03-24 Sylvan Learning Systems Inc System for automated testing and electronic dissemination of curriculum and student administration
US5915973A (en) 1997-03-11 1999-06-29 Sylvan Learning Systems, Inc. System for administration of remotely-proctored, secure examinations and methods therefor
CA2284912C (en) 1997-03-21 2009-02-24 Educational Testing Service System and method for on-line essay evaluation
US5991595A (en) 1997-03-21 1999-11-23 Educational Testing Service Computerized system for scoring constructed responses and methods for training, monitoring, and evaluating human rater's scoring of constructed responses
US6295439B1 (en) 1997-03-21 2001-09-25 Educational Testing Service Methods and systems for presentation and evaluation of constructed responses assessed by human evaluators
US6120299A (en) 1997-06-06 2000-09-19 Educational Testing Service System and method for interactive scoring of standardized test responses
US6181909B1 (en) 1997-07-22 2001-01-30 Educational Testing Service System and method for computer-based automatic essay scoring
US6173154B1 (en) 1997-07-31 2001-01-09 The Psychological Corporation System and method for imaging test answer sheets having open-ended questions
US6112049A (en) 1997-10-21 2000-08-29 The Riverside Publishing Company Computer network based testing system
US6267601B1 (en) 1997-12-05 2001-07-31 The Psychological Corporation Computerized system and method for teaching and assessing the holistic scoring of open-ended questions
US6042384A (en) * 1998-06-30 2000-03-28 Bookette Software Company Computerized systems for optically scanning and electronically scoring and reporting test results
US6577846B2 (en) 2001-02-12 2003-06-10 Ctb-Mcgraw Hill, Llc Methods for range finding of open-ended assessments

Also Published As

Publication number Publication date
US20020123028A1 (en) 2002-09-05
US6751351B2 (en) 2004-06-15
AU2031902A (en) 2002-09-12
CA2374521C (en) 2008-05-20
AU778565B2 (en) 2004-12-09
EP1239438A2 (en) 2002-09-11
EP1239438A3 (en) 2003-02-19

Similar Documents

Publication Publication Date Title
CA2374521A1 (en) Test question response verification system
AU2002365045A1 (en) System and method for automated test-case generation for software
AU2002245478A1 (en) Apparatus and method for utilizing an incentive point system based on disc and user identification
WO2002077813A8 (en) Development and testing system and method
WO2004013737A3 (en) System and method for determinig the identity of a party associated with a transaction
DE69634241D1 (en) DEVICE FOR CHECKING THE OUTPUT POWER, PROJECTION DISPLAY DEVICE
AU2001292672A1 (en) System and method for communicating software debug, diagnostic and maintenance information between devices
GB0217141D0 (en) System and method for providing an information network on the internet
AU2002342082A1 (en) System and method for measuring rating reliability through rater prescience
AU2002237962A1 (en) Method and system for testing a network system
AU3226400A (en) System and method for evaluating a document and creating a record of the evaluation process and an associated transaction
AU2002347871A1 (en) System and method for remotely administered, interactive hearing tests
HK1053510A1 (en) Test element analysis system, test element and method
AU2001226354A1 (en) Fixative system, method and composition for biological testing
BR0009919B1 (en) test system for the verification of a well, and the method of verification of a well.
AU1578495A (en) Method of detecting service interactions in intelligent networks
DE69630572D1 (en) Optical scanner, lens and converging optical system for optical scanner and optical disc device
AU5272901A (en) Method for producing identification code, and method and system for giving electronic notice service and electronic meter reading service by using the same
AU2001267055A1 (en) System and method for providing an individualized secure repository
BR9804676A (en) Process for testing an automated clutch device.
AU2002361075A1 (en) Test result analysis apparatus, method, and program, and learning support system and method
AU3193900A (en) Exposure system and aberration measurement method for its projection optical system, and production method for device
AU2002332102A1 (en) System, method, and apparatus for disease susceptibility testing
EP1629478A4 (en) Authentication system and method for an interactive optical disc
AU2003289427A1 (en) Aberration measuring method, exposure method and exposure system

Legal Events

Date Code Title Description
EEER Examination request
MKEX Expiry

Effective date: 20220307