WO2003034637A3 - System and method for measuring rating reliability through rater prescience - Google Patents

System and method for measuring rating reliability through rater prescience Download PDF

Info

Publication number
WO2003034637A3
WO2003034637A3 PCT/US2002/033512 US0233512W WO03034637A3 WO 2003034637 A3 WO2003034637 A3 WO 2003034637A3 US 0233512 W US0233512 W US 0233512W WO 03034637 A3 WO03034637 A3 WO 03034637A3
Authority
WO
WIPO (PCT)
Prior art keywords
prescience
raters
rater
measuring
rating
Prior art date
Application number
PCT/US2002/033512
Other languages
French (fr)
Other versions
WO2003034637A2 (en
Inventor
Gary Robinson
Original Assignee
Transpose Llc
Gary Robinson
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Transpose Llc, Gary Robinson filed Critical Transpose Llc
Priority to AU2002342082A priority Critical patent/AU2002342082A1/en
Priority to US10/325,693 priority patent/US20040030525A1/en
Publication of WO2003034637A2 publication Critical patent/WO2003034637A2/en
Priority to US10/837,354 priority patent/US20040225577A1/en
Publication of WO2003034637A3 publication Critical patent/WO2003034637A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0207—Discounts or incentives, e.g. coupons or rebates

Abstract

A plurality of users (200) are able to review items (206) as raters and provide ratings (210) for the reviewed items. In aggregating the rating values to provide a resolved rating value for the item, the prescience of the raters is evaluated. By establishing levels of reliability of the raters, it is possible to improve the relevance of the resolved rating values and to reward those providing highly reliable ratings. In this manner it is possible to independently validate each of the user's (200) ratings and use that information to validate the user (200).
PCT/US2002/033512 2001-10-18 2002-10-18 System and method for measuring rating reliability through rater prescience WO2003034637A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
AU2002342082A AU2002342082A1 (en) 2001-10-18 2002-10-18 System and method for measuring rating reliability through rater prescience
US10/325,693 US20040030525A1 (en) 2001-10-18 2002-12-19 Method and system for identifying high-quality items
US10/837,354 US20040225577A1 (en) 2001-10-18 2003-04-30 System and method for measuring rating reliability through rater prescience

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US34554801P 2001-10-18 2001-10-18
US60/345,548 2001-10-18

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US10/837,354 Continuation US20040225577A1 (en) 2001-10-18 2003-04-30 System and method for measuring rating reliability through rater prescience

Publications (2)

Publication Number Publication Date
WO2003034637A2 WO2003034637A2 (en) 2003-04-24
WO2003034637A3 true WO2003034637A3 (en) 2004-04-22

Family

ID=23355463

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2002/033512 WO2003034637A2 (en) 2001-10-18 2002-10-18 System and method for measuring rating reliability through rater prescience

Country Status (3)

Country Link
US (1) US20040225577A1 (en)
AU (1) AU2002342082A1 (en)
WO (1) WO2003034637A2 (en)

Families Citing this family (74)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7664669B1 (en) 1999-11-19 2010-02-16 Amazon.Com, Inc. Methods and systems for distributing information within a dynamically defined community
US8290809B1 (en) 2000-02-14 2012-10-16 Ebay Inc. Determining a community rating for a user using feedback ratings of related users in an electronic environment
US9614934B2 (en) 2000-02-29 2017-04-04 Paypal, Inc. Methods and systems for harvesting comments regarding users on a network-based facility
US7428505B1 (en) 2000-02-29 2008-09-23 Ebay, Inc. Method and system for harvesting feedback and comments regarding multiple items from users of a network-based transaction facility
US20020078152A1 (en) 2000-12-19 2002-06-20 Barry Boone Method and apparatus for providing predefined feedback
US7428496B1 (en) 2001-04-24 2008-09-23 Amazon.Com, Inc. Creating an incentive to author useful item reviews
US7885849B2 (en) * 2003-06-05 2011-02-08 Hayley Logistics Llc System and method for predicting demand for items
US7890363B2 (en) * 2003-06-05 2011-02-15 Hayley Logistics Llc System and method of identifying trendsetters
US7685117B2 (en) * 2003-06-05 2010-03-23 Hayley Logistics Llc Method for implementing search engine
US8103540B2 (en) * 2003-06-05 2012-01-24 Hayley Logistics Llc System and method for influencing recommender system
US8140388B2 (en) 2003-06-05 2012-03-20 Hayley Logistics Llc Method for implementing online advertising
US7689432B2 (en) * 2003-06-06 2010-03-30 Hayley Logistics Llc System and method for influencing recommender system & advertising based on programmed policies
JP2005056009A (en) * 2003-08-08 2005-03-03 Hitachi Ltd Online shopping method and system
US20050138049A1 (en) * 2003-12-22 2005-06-23 Greg Linden Method for personalized news
US7389285B2 (en) * 2004-01-22 2008-06-17 International Business Machines Corporation Process for distributed production and peer-to-peer consolidation of subjective ratings across ad-hoc networks
US8005835B2 (en) * 2004-03-15 2011-08-23 Yahoo! Inc. Search systems and methods with integration of aggregate user annotations
JP2005309946A (en) * 2004-04-23 2005-11-04 Hitachi Ltd System, method, and program for providing content search service
JP2006230697A (en) * 2005-02-24 2006-09-07 Aruze Corp Game device and game system
US8566144B2 (en) * 2005-03-31 2013-10-22 Amazon Technologies, Inc. Closed loop voting feedback
US10510087B2 (en) * 2005-07-07 2019-12-17 Sermo, Inc. Method and apparatus for conducting an information brokering service
US8249915B2 (en) * 2005-08-04 2012-08-21 Iams Anthony L Computer-implemented method and system for collaborative product evaluation
US8010480B2 (en) * 2005-09-30 2011-08-30 Google Inc. Selecting high quality text within identified reviews for display in review snippets
US20070078670A1 (en) * 2005-09-30 2007-04-05 Dave Kushal B Selecting high quality reviews for display
US8438469B1 (en) 2005-09-30 2013-05-07 Google Inc. Embedded review and rating information
US7827052B2 (en) * 2005-09-30 2010-11-02 Google Inc. Systems and methods for reputation management
WO2007070558A2 (en) * 2005-12-12 2007-06-21 Meadan, Inc. Language translation using a hybrid network of human and machine translators
US20070192130A1 (en) * 2006-01-31 2007-08-16 Haramol Singh Sandhu System and method for rating service providers
US20080140477A1 (en) * 2006-05-24 2008-06-12 Avadis Tevanian Online Community-Based Vote Security Performance Predictor
US8615440B2 (en) * 2006-07-12 2013-12-24 Ebay Inc. Self correcting online reputation
US8494436B2 (en) * 2006-11-16 2013-07-23 Watertown Software, Inc. System and method for algorithmic selection of a consensus from a plurality of ideas
US8843385B2 (en) * 2006-12-11 2014-09-23 Ecole Polytechnique Federale De Lausanne (Epfl) Quality of service monitoring of a service level agreement using a client based reputation mechanism encouraging truthful feedback
WO2008073053A1 (en) * 2006-12-14 2008-06-19 Jerry Jie Ji Method and system for online collaborative ranking and reviewing of classified goods or service
JP5151991B2 (en) * 2006-12-18 2013-02-27 日本電気株式会社 Polarity estimation system, information distribution system, polarity estimation method, polarity estimation program, and evaluation polarity estimation program
JP2008158712A (en) * 2006-12-22 2008-07-10 Fujitsu Ltd Evaluation information management method, evaluation information management system and evaluation information management program
US20080189634A1 (en) * 2007-02-01 2008-08-07 Avadis Tevanian Graphical Prediction Editor
US20080270915A1 (en) * 2007-04-30 2008-10-30 Avadis Tevanian Community-Based Security Information Generator
US8161083B1 (en) * 2007-09-28 2012-04-17 Emc Corporation Creating user communities with active element manager
US10083420B2 (en) * 2007-11-21 2018-09-25 Sermo, Inc Community moderated information
WO2009073664A2 (en) * 2007-12-04 2009-06-11 Google Inc. Rating raters
GB2455325A (en) * 2007-12-05 2009-06-10 Low Carbon Econonmy Ltd Rating of a data item
US8150842B2 (en) 2007-12-12 2012-04-03 Google Inc. Reputation of an author of online content
US20170169020A9 (en) * 2007-12-27 2017-06-15 Yohoo! Inc. System and method for annotation and ranking reviews personalized to prior user experience
US9298815B2 (en) 2008-02-22 2016-03-29 Accenture Global Services Limited System for providing an interface for collaborative innovation
US9208262B2 (en) 2008-02-22 2015-12-08 Accenture Global Services Limited System for displaying a plurality of associated items in a collaborative environment
US20090216578A1 (en) * 2008-02-22 2009-08-27 Accenture Global Services Gmbh Collaborative innovation system
US20090216608A1 (en) * 2008-02-22 2009-08-27 Accenture Global Services Gmbh Collaborative review system
US20100185498A1 (en) * 2008-02-22 2010-07-22 Accenture Global Services Gmbh System for relative performance based valuation of responses
AU2008100718B4 (en) * 2008-04-11 2009-03-26 Kieran Stafford Means for navigating data using a graphical interface
US9639609B2 (en) * 2009-02-24 2017-05-02 Microsoft Technology Licensing, Llc Enterprise search method and system
JP5788866B2 (en) * 2009-04-20 2015-10-07 コーニンクレッカ フィリップス エヌ ヴェ Method and system for rating items
US20110041075A1 (en) * 2009-08-12 2011-02-17 Google Inc. Separating reputation of users in different roles
US9141966B2 (en) * 2009-12-23 2015-09-22 Yahoo! Inc. Opinion aggregation system
US20110166900A1 (en) * 2010-01-04 2011-07-07 Bank Of America Corporation Testing and Evaluating the Recoverability of a Process
US20120042354A1 (en) * 2010-08-13 2012-02-16 Morgan Stanley Entitlement conflict enforcement
WO2012039773A1 (en) * 2010-09-21 2012-03-29 Servio, Inc. Reputation system to evaluate work
US8433620B2 (en) * 2010-11-04 2013-04-30 Microsoft Corporation Application store tastemaker recommendations
US8650023B2 (en) * 2011-03-21 2014-02-11 Xerox Corporation Customer review authoring assistant
US8214904B1 (en) * 2011-12-21 2012-07-03 Kaspersky Lab Zao System and method for detecting computer security threats based on verdicts of computer users
US8209758B1 (en) * 2011-12-21 2012-06-26 Kaspersky Lab Zao System and method for classifying users of antivirus software based on their level of expertise in the field of computer security
US8214905B1 (en) * 2011-12-21 2012-07-03 Kaspersky Lab Zao System and method for dynamically allocating computing resources for processing security information
US8600796B1 (en) * 2012-01-30 2013-12-03 Bazaarvoice, Inc. System, method and computer program product for identifying products associated with polarized sentiments
WO2014065868A1 (en) 2012-10-23 2014-05-01 Aperio Technologies, Inc. Systems and methods for an image repository for pathology
WO2014123553A1 (en) * 2013-02-05 2014-08-14 Utilidata, Inc. Cascade adaptive regulator tap manager method and system
US20150073700A1 (en) * 2013-09-12 2015-03-12 PopWorld Inc. Data processing system and method for generating guiding information
US20150154527A1 (en) * 2013-11-29 2015-06-04 LaborVoices, Inc. Workplace information systems and methods for confidentially collecting, validating, analyzing and displaying information
US20160350685A1 (en) * 2014-02-04 2016-12-01 Dirk Helbing Interaction support processor
US10726376B2 (en) * 2014-11-04 2020-07-28 Energage, Llc Manager-employee communication
US10692027B2 (en) 2014-11-04 2020-06-23 Energage, Llc Confidentiality protection for survey respondents
US10380656B2 (en) 2015-02-27 2019-08-13 Ebay Inc. Dynamic predefined product reviews
US20200105419A1 (en) * 2018-09-28 2020-04-02 codiag AG Disease diagnosis using literature search
US11487799B1 (en) * 2021-02-26 2022-11-01 Heir Apparent, Inc. Systems and methods for determining and rewarding accuracy in predicting ratings of user-provided content
US11151665B1 (en) 2021-02-26 2021-10-19 Heir Apparent, Inc. Systems and methods for participative support of content-providing users
US20220343190A1 (en) * 2021-04-22 2022-10-27 Capital One Services, Llc Systems for automatic detection, rating and recommendation of entity records and methods of use thereof
CN114863683B (en) * 2022-05-11 2023-07-04 湖南大学 Heterogeneous Internet of vehicles edge computing unloading scheduling method based on multi-objective optimization

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5717865A (en) * 1995-09-25 1998-02-10 Stratmann; William C. Method for assisting individuals in decision making processes
EP1065607A2 (en) * 1999-06-29 2001-01-03 Xerox Corporation System and method of predicting a user's rating for an item in a collaborative filtering system

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5696907A (en) * 1995-02-27 1997-12-09 General Electric Company System and method for performing risk and credit analysis of financial service applications
US5909669A (en) * 1996-04-01 1999-06-01 Electronic Data Systems Corporation System and method for generating a knowledge worker productivity assessment
US20010013009A1 (en) * 1997-05-20 2001-08-09 Daniel R. Greening System and method for computer-based marketing
US6064980A (en) * 1998-03-17 2000-05-16 Amazon.Com, Inc. System and methods for collaborative recommendations
US6405175B1 (en) * 1999-07-27 2002-06-11 David Way Ng Shopping scouts web site for rewarding customer referrals on product and price information with rewards scaled by the number of shoppers using the information
US6347332B1 (en) * 1999-12-30 2002-02-12 Edwin I. Malet System for network-based debates
WO2001059625A1 (en) * 2000-02-10 2001-08-16 Involve Technology, Llc System for creating and maintaining a database of information utilizing user opinions
US7617127B2 (en) * 2000-04-28 2009-11-10 Netflix, Inc. Approach for estimating user ratings of items
US6895385B1 (en) * 2000-06-02 2005-05-17 Open Ratings Method and system for ascribing a reputation to an entity as a rater of other entities

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5717865A (en) * 1995-09-25 1998-02-10 Stratmann; William C. Method for assisting individuals in decision making processes
EP1065607A2 (en) * 1999-06-29 2001-01-03 Xerox Corporation System and method of predicting a user's rating for an item in a collaborative filtering system

Also Published As

Publication number Publication date
WO2003034637A2 (en) 2003-04-24
AU2002342082A1 (en) 2003-04-28
US20040225577A1 (en) 2004-11-11

Similar Documents

Publication Publication Date Title
WO2003034637A3 (en) System and method for measuring rating reliability through rater prescience
Dowler Inequalities in diet and physical activity in Europe
WO2005104760A3 (en) Closing in an elctronic market
WO2007008336A3 (en) Website user account linking
WO2005033840A3 (en) An optimal method, system, and storage medium for resolving demand and supply imbalances
WO2006055064A3 (en) Automated user evaluation and lifecycle management for digital products, services and content
WO2005006283A3 (en) Rendering advertisements with documents having one or more topics using user topic interest information
GB2401464A (en) Document generation system and method
WO2006044689A3 (en) Food product contamination event management system and method
TW200606815A (en) Selection of coding models for encoding an audio signal
WO2006029283A3 (en) System for searching and solving for insurance products
WO2003021382A3 (en) Systems and methods for sharing excess profits
WO2008108000A1 (en) Gratitude providing system and gratitude providing method
WO2006002179A3 (en) Evaluating the relevance of documents and systems and methods therefor
WO2004107095A3 (en) Lifecycle profitability tool for leasable assets
WO2007020466A3 (en) Data classification apparatus and method
WO2004095218A3 (en) Method and system for offering and selling a multi-purpose currency option
WO2007025211A3 (en) Methods and systems for ranking and investing in financial instruments
DE60323278D1 (en) Data Output System
WO2002079901A3 (en) Customer preference system
Neumark et al. Minimum wages and low-wage workers: how well does reality match the rhetoric
WO2006041754A3 (en) System and method for increasing pay-per-download revenues
Somerton Dupuis What motivates a consumer to make an online purchase Tracy Somerton Dupuis.
Kaicker et al. Time-series Analyses of Food Commodity Prices in Meghalaya (July 2019-June 2020)
Coughlin et al. Constructing and using national and regional TWEXs: the case for chaining

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BY BZ CA CH CN CO CR CU CZ DE DM DZ EC EE ES FI GB GD GE GH HR HU ID IL IN IS JP KE KG KP KR LC LK LR LS LT LU LV MA MD MG MN MW MX MZ NO NZ OM PH PL PT RU SD SE SG SI SK SL TJ TM TN TR TZ UA UG US UZ VN YU ZA ZM

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ UG ZM ZW AM AZ BY KG KZ RU TJ TM AT BE BG CH CY CZ DK EE ES FI FR GB GR IE IT LU MC PT SE SK TR BF BJ CF CG CI GA GN GQ GW ML MR NE SN TD TG

WWE Wipo information: entry into national phase

Ref document number: 10837354

Country of ref document: US

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP