US20130046618A1 - Ad placement - Google Patents

Ad placement Download PDF

Info

Publication number
US20130046618A1
US20130046618A1 US13/620,907 US201213620907A US2013046618A1 US 20130046618 A1 US20130046618 A1 US 20130046618A1 US 201213620907 A US201213620907 A US 201213620907A US 2013046618 A1 US2013046618 A1 US 2013046618A1
Authority
US
United States
Prior art keywords
advertisement
recited
user
readable storage
computer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/620,907
Inventor
John B. Ferber
Scott Ferber
Stein E. Kretsinger
Robert Luenberger
David Luenberger
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Meta Platforms Inc
Original Assignee
Facebook Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Facebook Inc filed Critical Facebook Inc
Priority to US13/620,907 priority Critical patent/US20130046618A1/en
Assigned to AOL ADVERTISING INC. reassignment AOL ADVERTISING INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: PLATFORM-A INC.
Assigned to PLATFORM-A, INC. reassignment PLATFORM-A, INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: ADVERTISING.COM, INC.
Assigned to FACEBOOK, INC. reassignment FACEBOOK, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AOL ADVERTISING INC.
Assigned to ADVERTISING.COM, INC. reassignment ADVERTISING.COM, INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: LUENBERGER, DAVID, KRETSINGER, STEIN E., LUENBERGER, ROBERT, FERBER, JOHN B., FERBER, SCOTT
Publication of US20130046618A1 publication Critical patent/US20130046618A1/en
Assigned to META PLATFORMS, INC. reassignment META PLATFORMS, INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: FACEBOOK, INC.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0242Determining effectiveness of advertisements
    • G06Q30/0244Optimization
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0242Determining effectiveness of advertisements
    • G06Q30/0246Traffic
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • G06Q30/0254Targeted advertisements based on statistics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • G06Q30/0269Targeted advertisements based on user profile or attribute
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0277Online advertisement

Definitions

  • This invention relates generally to the allocation (e.g. as in a market or exchange) of the supply of a class of products/services with the demand for a class of products/services in an optimal manner (i.e. system-wide best solution since the values of different allocation strategies may vary significantly) that quantifies and accounts for the uncertainty surrounding the supply and demand of different products/services. More particularly, the present invention comprises a system and method for the optimal placement of ads on Web pages.
  • Optimal ad placement has become a critical competitive advantage in the Internet advertising business. Consumers are spending an ever-increasing amount of time online looking for information.
  • the information provided by Internet content providers, is viewed on a page-by-page basis.
  • Each page can contain written and graphical information as well as one or more ads.
  • Key advantages of the Internet, relative to other information media, are that each page can be customized to fit a customer profile and ads can contain links to other Internet pages.
  • ads can be directly targeted at different customer segments and the ads themselves are direct connections to well-designed Internet pages.
  • any content including information or messages, as well as advertisements, delivered over any Internet enabled distribution channel, such as via e-mail, wireless devices (including, but not limited to phones, pagers, PDAs, desktop displays, and digital billboards), or other media, such as ATM terminals.
  • wireless devices including, but not limited to phones, pagers, PDAs, desktop displays, and digital billboards
  • other media such as ATM terminals.
  • advertisement is also meant to include any content, including information or messages, as well as advertisements, such as, but not limited to, Web banners, product offerings, special non-commercial or commercial messages, or any other sort of displayed or audio information.
  • Web page “Web site,” and “site” are meant to include any sort of information display or presentation over an Internet enabled distribution channel that may have customizable areas (including the entire area) and may be visual, audio, or both. They may be segmented and or customized by factors such as time and location.
  • Internet browser is any means that decodes and displays the above-defined Web pages or sites, whether by software, hardware, or utility, including diverse means not typically considered as a browser, such as games.
  • Internet is meant to include all TCP/IP based communication channels, without limitation to any particular communication protocol or channel, including, but not limited to, e-mail, News via NNTP, and the WWW via HTTP and WAP (using, e.g., HTML, DHTML, XHTML, XML, SGML, VRML, ASP, CGI, CSS, SSI, Flash, Java, JaysScript, Perl, Python, Rexx, SMIL, Tcl, VBScript, HDML, WML, WMLScript, etc.).
  • customer or “user” refers to any consumer, viewer, or visitor of the above-defined Web pages or sites and can also refer to the aggregation of individual customers into certain groupings.
  • Clicks and “click-thru-rate” or “CTR” refers to any sort of definable, trackable, and/or measurable action or response that can occur via the Internet and can include any desired action or reasonable measure of performance activity by the customer, including, but not limited to, mouse clicks, impressions delivered, sales generated, and conversions from visitors to buyers.
  • references to customers “viewing” ads is meant to include any presentation, whether visual, aural, or a combination thereof.
  • revenue refers to any meaningful measure of value, including, but not limited to, revenue, profits, expenses, customer lifetime value, and net present value (NPV).
  • the Internet ad placement technology of the present invention provides an optimal strategic framework for selecting which ad a customer will view next. It maximizes the overall expected ad placement revenue (or any other measure of value), trading off the desire for learning with revenue generation.
  • the technology can be executed in “real-time” and updates the strategy space for every customer.
  • Ad placements are compensated based on the number of successful responses that they generate. This usually means that compensation occurs every time a customer responds to (e.g., clicks) an ad.
  • Customers respond to ads according to their interests and demands. Thus, a key necessity is to obtain a reliable characteristic profile of each customer. Only with given information about the customer can ads be provided that are targeted towards each customer.
  • an ad placement technology that optimally decides which ad to show. At the instant a customer opens a page, it is necessary to place an ad. The ad placement technology must incorporate the customer's likely response to each ad and the financial gains resulting from a customer's selection of an ad.
  • a successful ad placement technology must overcome several critical complications. First, the ad placement algorithm must be sufficiently fast to ensure “real-time” placement. Second, a key element of the technology is its ability to learn through continuous updating. Little information is available about new ads. However, as ads are placed, it can be learned how they relate to various customer profiles. Thus, the technology should both be able to learn and trade off learning versus revenue generation. Finally, the ad placement technology must be able to detect ineffective ads and incorporate minimum and maximum ad placement and ad selection constraints.
  • This invention concerns optimal ad selection for Internet-delivered ads, such as for Web pages, by selecting and updating an attribute set, obtaining and updating an ad-attribute profile, and optimally choosing the next ad.
  • the present invention associates a set of attributes with each customer. The attributes reflect the customers' interests and they incorporate the characteristics that impact ad selection. Similarly, the present invention associates with each ad an ad-attribute profile in order to calculate a customer's estimated ad selection probability and measure the uncertainty in that estimate.
  • An ad selection algorithm optimally selects which ad to show based on the click probability estimates and the uncertainties regarding these estimates.
  • FIG. 1 illustrates the possible use of the present invention in a prior art direct marketing system.
  • FIG. 2 illustrates a first embodiment of the present invention for brand name and mass appeal products.
  • FIG. 3 illustrates a second embodiment of the present invention for lots and niche products.
  • FIG. 4 illustrates a schematic of the present invention.
  • FIG. 5 illustrates the Integrated Channel Management system of the present invention.
  • FIG. 6 illustrates a schematic of the system of the present invention.
  • FIG. 7 illustrates a schematic of the process of the present invention.
  • FIG. 8 illustrates a matching of supply and demand for advertising on Internet enabled distribution channels.
  • the present invention comprises a system and method of optimal ad placement.
  • This invention divides the optimal ad selection problem into three parts: (1) how to select and update the attribute set, (2) how to obtain and update the ad-attribute profile, and (3) how to optimally choose the next ad.
  • the application of the present invention will be illustrated with respect to reconciling the supply of Web pages with the demand for ads on those Web pages in an optimal manner that maximizes revenue. It is assumed that each Web page can only promote one ad at a time, although that is not a limitation of the present invention.
  • the ad provider pays on a per click (ad selection) basis.
  • a typical employment of the invention is illustrated in FIG. 1 , wherein customer and client (ad) data 110 is input, turned into information 120 for modeling and used for ad serving 130 , as illustrated in FIG. 8 .
  • the present invention associates a set of attributes with each customer.
  • the attributes reflect the customers' interests and they incorporate the characteristics that impact ad selection.
  • the present invention associates with each ad an ad-attribute profile.
  • the ad-attribute profile has two uses, to calculate a customer's estimated ad selection probability, and to measure the uncertainty in that estimate.
  • the ad selection algorithm optimally selects which ad to show based on the click probability estimates and the uncertainties regarding these estimates. That is, it optimally trades off current revenue potential with future revenue potential represented by the uncertainty surrounding these estimates. Ads that have been frequently placed will have a well-documented current revenue potential while new ads with few placements represent the possibility of high future potential.
  • the present invention divides attributes into a long-term and a short-term attribute sets.
  • the long-term attribute set measures how much time customers spend in different interest categories such as business, sports, and health.
  • the short-term attributes detect when a customer is searching for specific products.
  • Long-term customer attributes in the present invention are updated, depending on time and network constraints, on a placement-by-placement or on a time period-by-time period (for example day-by-day) basis.
  • the attributes measure, for example, how much time on a percentage basis a customer spends in each interest group (i.e., sports, gardening, etc.). Thus, suppose that the customer chooses sports half the time and finance half the time. Then sports and finance attributes are each 50% and the remaining attributes are 0%.
  • the attributes together cover all the distinctive characteristics of the customers. There are two ways the attributes are structured.
  • the present invention has a common set of attributes that are always updated.
  • the present invention has two sets of attributes, a base set given by easily available data, and a second set of attributes that are revealed as the customer carries out certain actions.
  • the short-term attribute set of the present invention signals every time there is a specific interest for a particular service or product. For example, suppose a customer is currently shopping for a computer. Such an event can be detected by specifically marking sites that perform computer comparison tests. The probability that the customer selects a computer ad will be high.
  • the ad-attribute profile of the present invention measures how sensitive the ad is to the various attributes and thus how likely it is that a customer will react when shown an ad. As the profile for a given customer is not known ahead of time, it must be estimated. This profile estimation algorithm provides an efficient means for updating the attribute estimates in “real time.” It is not necessary to store the complete history of customers' responses, but only a set of sufficient statistics for each ad.
  • the sufficient statistics are one square matrix variable with dimension equal to the number of attributes, one vector variable with dimension equal to the number of attributes, and two scalars. Furthermore, the sufficient statistics can be quickly calculated.
  • the profile estimation algorithm also records the uncertainty of each ad-attribute.
  • the uncertainty conceals an ad's effectiveness (as measured by the true click probability).
  • an ad's effectiveness directly drives the revenue generation it is important to quickly derive a good estimate.
  • the uncertainty regarding an ad's effectiveness decreases as the number of times it is shown increases.
  • the ad selector of the present invention places ads in a way that maximizes the expected overall long-term ad placement revenue (or any other measure of value).
  • the ad placement revenue is the compensation received every time an ad is clicked. For the moment, suppose that it is known with certainty the ad-attribute profile for each ad. This means that the probabilities that the customer will react to the ads can be calculated. Multiplying the probabilities with the compensations of the corresponding ads yield the expected ad placement revenues for all ads. The choice that maximizes the expected overall ad placement revenue is then simply the ad with the highest expected ad placement revenue (or any other measure of value).
  • This ad-placement algorithm incorporates the uncertainty as well as the expected ad revenue in the selection criterion.
  • the uncertainty is a reflection of the ad's potential upside. That is, it is more likely that the probability of an ad with high uncertainty is significantly higher than its' estimated value than an ad with low uncertainty. Only by testing can the present invention determine whether it is actually true. If true it is clear that there is much to gain in the future.
  • the ad-placement selection rule works by for each ad combining the volatility and the expected value of the ad placement revenue in a certain way.
  • This rule is based on a dynamic programming approach. This approach yields the true optimal selection algorithm among all possible non-anticipating selection algorithms.
  • the present invention adapts the dynamic programming solution to obtain a strategy that can be updated in real-time.
  • the basic modeling technique of the present invention is outlined below and illustrated in FIG. 7 .
  • Customer attributes 702 may be time-based, geography based, or any other segmentable and tractable attribute.
  • the present invention maintains a customer matrix:
  • Attribute 1 Attribute 2 . . . Attribute MA ID_1 A_11 A_12 . . . A_1MA ID_2 A_21 A_22 . . . A_2MA ID_L A_L1 A_L2 . . . A_LMA And an ad matrix:
  • Attribute 1 Attribute MA Ad ID weight . . . weight Ad_1 W_11 . . . W_1MA Ad_2 W_21 . . . W_2MA Ad_N W_N1 . . . W_NMA
  • ⁇ k 1 MA ⁇ ⁇ ( A_xk ) ⁇ ( W_ik ) .
  • a customer accesses a participating Web site at illustrated 201 , 301 , an ad server determines the best ad to place (highest score of 150) . 19 at 202 , 302 , the ad is served to the Web site at 203 , 303 and a click by the customer directes him to the advertisers Web site at 204 , 304 .
  • the present invention alters the above structure by carrying not just the mean but the standard deviation of each estimated random variable as well.
  • the ad selection process then works by combining the estimated probability and the standard deviation in a certain way for each ad and then comparing. When done properly, this is the optimal way to balance earning and learning.
  • Updates of the standard deviation can be calculated quickly as they can be based on the updates of the estimated probabilities.
  • the present invention is also able to learn more about a given customer from other customers than the above is yet capturing.
  • a particular ad is very popular with males and this system is considering showing it to a particular customer.
  • the present invention has an attribute for gender, but doesn't yet know if this particular customer is male or female.
  • interest level in sports there is lots of other data about the customer, such as interest level in sports.
  • the present invention can estimate the probability that this customer is male.
  • the present invention may find, for instance, that interest in sports is highly indicative of being male.
  • a key aspect of the present invention is identifying attributes that are predictive of behavior. This step requires analyzing real data, and should be re-visited periodically. Second, for numerical stability, the present invention must choose attributes that are not too similar to one another. There are several ways to choose a representative attribute set, basically by selecting orthogonal attributes. Third, the present invention needs concrete policies for deleting non-helpful attributes and splitting ones that are particularly useful. Finally, there are several statistical/data-analysis methods the present invention can employ to create updating procedures for the values of each attribute. The right procedure will depend on initial statistical tests and is also a step that should be re-visited at a later stage.
  • the present invention divides attributes into a long-term and a short-term attribute sets.
  • the long-term attribute set measures how much time customers spend in different interest categories such as business, sports, and health. Thus, suppose that the customer chooses sports half the time and finance half the time. Then sports and finance attributes are each 50% and the remaining attributes are 0%.
  • the short-term attributes detect when a customer is searching for specific products. For example, a customer shopping for a new computer will likely visit sites that relate to computer sales. Such sites can be marked and computer ads placed on such sites have high probabilities of being selected, while general interest ads have markedly lower probability of being selected.
  • Every Web site used with the present invention sends a request for an ad every time a user accesses the site.
  • the request is sent to the ad manager.
  • the ad manager has a lookup table specifying ads and associated probabilities defining the ads that should be shown next for every site. This lookup table is updated frequently, such as every hour or on any other relevant time unit basis.
  • the system records that the ad has been shown and whether or not there was a click.
  • the system holds a database with the number of impressions and clicks for each ad on each site by hour.
  • the system also maintains a list of the total and remaining paid clicks for each ad, and a list of payments per click for each ad.
  • the goal of the optimizer-scheduler is to place ads on Web sites in such a way as to maximize the overall value for the advertising serving entity.
  • This value may be a combination of impression, clicks, conversions, and other value that may be obtained by placing an ad on a particular site.
  • the probability of a given ad being clicked on varies from site to site.
  • the present invention does not know these probabilities beforehand but, rather, the present invention continuously refines this estimate as more observations are made. There is value in obtaining additional information about these probabilities and this is accounted for in the algorithm.
  • Arrangements with Web sites tend to be fairly long-term. Arrangements with advertisers tend to be composed of campaigns, each lasting from days to weeks. The advertisers typically purchase a certain number of clicks. While not always spelled out explicitly, the understanding is that these clicks will occur reasonably uniformly over the campaign's lifetime. Of course, there is no way to guarantee that an ad does not fall behind schedule (it is possible that nobody chooses to click on the ad).
  • the present invention can, however, ensure (assuming that there is a reasonably rich set of ads) that no ad gets significantly ahead of schedule. This is captured via a tunable parameter within the algorithm.
  • the arrangement with the advertiser is simply to show the ad a specified number of times.
  • the system of the present invention serves the requested ad according to attributes described above while simultaneously tracking the number of times the ad is displayed.
  • ⁇ j max ( Average i ; n i , j > 500 ⁇ ( p i , j ) , 0.001 )
  • p i , j k i , j n i , j + ⁇ j ⁇ 2 n i , j .
  • the system sends the number of impressions and the number of clicks for each ad at each site to the ad manager.
  • the present invention computes the value of c i that corresponds to a perfectly smooth delivery of clicks from the current time on. Note that in the linear program (LP), the present invention will not require that this be hit exactly, but rather within a pre-set tolerance.
  • Step 1 Define:
  • p ⁇ i , j p i , j + ⁇ ⁇ p i , j ⁇ ( 1 - p i , j ) n i , j - 1
  • v i,j ⁇ circumflex over (p) ⁇ i,j s i if ad i is click-based or conversion-based, and s i if it is impression-based.
  • This framework allows for a number of additional constraints to be added in a natural way.
  • the probability that users visiting Web site j will click on ad i was estimated by dividing the number of clicks on ad i at Web site j with the number of impressions of ad i at Web site j, but can be estimated by any other reasonable method.
  • This approach contains two steps. In the first step we estimate the principal component vectors whereas in the second step we estimate the banner ads' click probabilities. Each step are updated as new information becomes available.
  • the advantage to using the principal component approach is significant. For example, if there are 100 Web sites and 5 principal components then the conventional approach requires approximately 20 times as many impressions as the principal component approach to reach the same level of accuracy.
  • y i [ y i , 1 , y i , 2 , ... , y i , m ] ⁇ ⁇
  • ⁇ y i , j ( p i , j - 1 ) ⁇ i , j .
  • the present invention When using principal components estimation, the present invention identifies ads that have been shown a large number of times at many Web sites. These are the ads that will be used to calculate the principal components.
  • ⁇ j ⁇ i ⁇ p i , j Count ⁇ ( i ⁇ ⁇ on ⁇ ⁇ j )
  • ⁇ i,j p i,j *(1 ⁇ p i,j )/ n
  • the objective of the principal component approach is to efficiently and quickly obtain ad probabilities for a majority of banners. In addition to finding the probabilities for the majority it is also necessary to identify banners where the principal components do not capture a significant portion of the observed probabilities.
  • a maximum likelihood approach can be used to integrate this aspect into the probability estimation routine.
  • the variance is determined by the process that determines the principal components.
  • root 1 1 + av i - ( 1 + av i ) 2 - 4 ⁇ ( av i - n i ⁇ ⁇ 2 ) 2
  • n i av i ⁇ 2
  • the subset J can, of course, involve multiple levels of categories, generally chosen by the advertiser.
  • a typical subset could be something like ‘all of the sports related—Spanish language—G-rated sites.’
  • a Web site would be able to do this by both blocking entire categories, such as R-rated sites, and by selecting particular ads for exclusion, such as one of a direct competitor.
  • CTR Click-Thru-Rate
  • Automatic clustering of small Web sites can be employed in a manner that effectively improves overall Click-Thru-Rates.
  • the process starts by matching each ad with a campaign type, which is assigned through a GUI.
  • a campaign type There are types for ‘Personal Finance’, ‘Sports’, ‘Computers and Technology’, and the like.
  • Each cluster will correspond to one of these types.
  • the database contains information on all the campaign types that each Webmaster showed. Not all webmasters-type pairs in the database will be used to perform the computations; in one embodiment, only those that meet the following requirements:
  • the CTR for a type must be less than 100%
  • the set of campaign types for a Webmaster must be a superset of the clustering types: ⁇ circumflex over (T) ⁇ ⁇ T m , where m represents a particular Webmaster.
  • Each Webmaster will be assigned to one and only one cluster, so it will have a corresponding cluster ID, ID m . Only one more piece of information is needed to determine the cluster ID of each Webmaster: p-hat.
  • is a learning parameter m is the Webmaster
  • i is the campaign type
  • imps m,i refers to the number of impressions for the Webmaster-campaign type pair.
  • Each j corresponds to a clustering type, as defined before.
  • the object is to look for the max p-hat for each Webmaster.
  • the type associated with the max p-hat will be cluster assigned to the Webmaster.
  • the present invention translates the type to its cluster ID.
  • clusters it could be the case that once clusters are formed, the total number of impressions for one of them will be over 20% or any other reasonable set percentage of the total number of impressions for all the clusters.
  • it is desirable to split the cluster by applying the clustering process to those Webmasters in the largest cluster, and by forming a new set of two clustering types for them that excluded the type associated with the cluster. For instance, if cluster 3 with associated type ‘Sports’ is the target, then a new clustering type set might be ⁇ ‘Entertainment’, ‘Health’ ⁇ , which will be chosen because they are the two types with the most and second-most impressions.
  • Each Webmaster will be assigned a new cluster ID using the same “max p-hat” criteria.
  • the splitting process is repeated until no cluster has more than 20% of all the impressions.
  • An allocator 500 can be used to serve full-sized 510 , odd-sized 520 , and other type 530 ads using the following algorithm:
  • ⁇ j 1 m ⁇ ⁇ ( ⁇ l . j ⁇ p l . j ⁇ d j + ⁇ m , j ⁇ p m , j ⁇ d j ) ⁇ ( 1 + ⁇ ) ⁇ ( c l + c m ) .
  • the method of the present invention can be practiced by conventional servers 620 , 630 , such as Pentium III based systems operating with Windows NT, interacting over the Internet 600 to collect attribute information about customers 640 and ads from database 610 , and then serve the ads to the customers 640 operating Internet enabled devices with browsers, such as Apple Macintosh or Windows-based personal computers with browser clients like Internet Explorer or Netscape Navigator, as shown in FIG. 6 .
  • browsers such as Apple Macintosh or Windows-based personal computers with browser clients like Internet Explorer or Netscape Navigator, as shown in FIG. 6 .
  • Conventional PCs which may be Pentium based or Apple Macintosh type processors, are all suitable processors for exercising the present invention.
  • the server of the present invention can be an Intel Pentium type server, Sun server or other server suitable for serving advertisements.

Abstract

This invention concerns optimal ad selection for Web pages by selecting and updating an attribute set, obtaining and updating an ad-attribute profile, and optimally choosing the next ad. The present invention associates a set of attributes with each customer. The attributes reflect the customers' interests and they incorporate the characteristics that impact ad selection. Similarly, the present invention associates with each ad an ad-attribute profile in order to calculate a customer's estimated ad selection probability and measure the uncertainty in that estimate. An ad selection algorithm optimally selects which ad to show based on the click probability estimates and the uncertainties regarding these estimates.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of U.S. application Ser. No. 12/700,696 filed on Feb. 4, 2010, which is a continuation of U.S. application Ser. No. 09/610,197 filed on Jul. 1, 2000, which claims the benefit of U.S. Provisional Application Ser. No. 60/164,253 filed on Nov. 8, 1999, all of which are hereby incorporated by reference in their entirety.
  • BACKGROUND OF THE INVENTION
  • This invention relates generally to the allocation (e.g. as in a market or exchange) of the supply of a class of products/services with the demand for a class of products/services in an optimal manner (i.e. system-wide best solution since the values of different allocation strategies may vary significantly) that quantifies and accounts for the uncertainty surrounding the supply and demand of different products/services. More particularly, the present invention comprises a system and method for the optimal placement of ads on Web pages.
  • Optimal ad placement has become a critical competitive advantage in the Internet advertising business. Consumers are spending an ever-increasing amount of time online looking for information. The information, provided by Internet content providers, is viewed on a page-by-page basis. Each page can contain written and graphical information as well as one or more ads. Key advantages of the Internet, relative to other information media, are that each page can be customized to fit a customer profile and ads can contain links to other Internet pages. Thus, ads can be directly targeted at different customer segments and the ads themselves are direct connections to well-designed Internet pages. Although the present example has been described with respect to traditional Web browsing on a Web page, the same principals apply for any content, including information or messages, as well as advertisements, delivered over any Internet enabled distribution channel, such as via e-mail, wireless devices (including, but not limited to phones, pagers, PDAs, desktop displays, and digital billboards), or other media, such as ATM terminals.
  • Therefore, as used herein, the term “ad” is also meant to include any content, including information or messages, as well as advertisements, such as, but not limited to, Web banners, product offerings, special non-commercial or commercial messages, or any other sort of displayed or audio information.
  • The terms “Web page,” “Web site,” and “site” are meant to include any sort of information display or presentation over an Internet enabled distribution channel that may have customizable areas (including the entire area) and may be visual, audio, or both. They may be segmented and or customized by factors such as time and location. The term “Internet browser” is any means that decodes and displays the above-defined Web pages or sites, whether by software, hardware, or utility, including diverse means not typically considered as a browser, such as games.
  • The term “Internet” is meant to include all TCP/IP based communication channels, without limitation to any particular communication protocol or channel, including, but not limited to, e-mail, News via NNTP, and the WWW via HTTP and WAP (using, e.g., HTML, DHTML, XHTML, XML, SGML, VRML, ASP, CGI, CSS, SSI, Flash, Java, JaysScript, Perl, Python, Rexx, SMIL, Tcl, VBScript, HDML, WML, WMLScript, etc.).
  • The term “customer” or “user” refers to any consumer, viewer, or visitor of the above-defined Web pages or sites and can also refer to the aggregation of individual customers into certain groupings. “Clicks” and “click-thru-rate” or “CTR” refers to any sort of definable, trackable, and/or measurable action or response that can occur via the Internet and can include any desired action or reasonable measure of performance activity by the customer, including, but not limited to, mouse clicks, impressions delivered, sales generated, and conversions from visitors to buyers. Additionally, references to customers “viewing” ads is meant to include any presentation, whether visual, aural, or a combination thereof.
  • The term “revenue” refers to any meaningful measure of value, including, but not limited to, revenue, profits, expenses, customer lifetime value, and net present value (NPV).
  • The Internet ad placement technology of the present invention provides an optimal strategic framework for selecting which ad a customer will view next. It maximizes the overall expected ad placement revenue (or any other measure of value), trading off the desire for learning with revenue generation. The technology can be executed in “real-time” and updates the strategy space for every customer.
  • At its core, the problem is to place the right ad to the right customer. Ad placements are compensated based on the number of successful responses that they generate. This usually means that compensation occurs every time a customer responds to (e.g., clicks) an ad. Customers respond to ads according to their interests and demands. Thus, a key necessity is to obtain a reliable characteristic profile of each customer. Only with given information about the customer can ads be provided that are targeted towards each customer. Second, there is a need to estimate how different customers will react to different ads. That is, a customer-ad response relation is required. Finally, there is a need for an ad placement technology that optimally decides which ad to show. At the instant a customer opens a page, it is necessary to place an ad. The ad placement technology must incorporate the customer's likely response to each ad and the financial gains resulting from a customer's selection of an ad.
  • A successful ad placement technology must overcome several critical complications. First, the ad placement algorithm must be sufficiently fast to ensure “real-time” placement. Second, a key element of the technology is its ability to learn through continuous updating. Little information is available about new ads. However, as ads are placed, it can be learned how they relate to various customer profiles. Thus, the technology should both be able to learn and trade off learning versus revenue generation. Finally, the ad placement technology must be able to detect ineffective ads and incorporate minimum and maximum ad placement and ad selection constraints.
  • BRIEF SUMMARY OF THE INVENTION
  • This invention concerns optimal ad selection for Internet-delivered ads, such as for Web pages, by selecting and updating an attribute set, obtaining and updating an ad-attribute profile, and optimally choosing the next ad. The present invention associates a set of attributes with each customer. The attributes reflect the customers' interests and they incorporate the characteristics that impact ad selection. Similarly, the present invention associates with each ad an ad-attribute profile in order to calculate a customer's estimated ad selection probability and measure the uncertainty in that estimate. An ad selection algorithm optimally selects which ad to show based on the click probability estimates and the uncertainties regarding these estimates.
  • It is therefore an object of the present invention to integrate the optimization and scheduling of web-based ad serving.
  • It is another object of the present invention to provide an optimal strategic framework for selecting which ad a customer will view next.
  • It is also an object of the present invention to maximize the overall expected ad placement revenue (or any other measure of value), trading off the desire for learning with revenue generation.
  • It is another object of the present invention to place ads on Web sites in such a way as to maximize the overall value for the ad serving entity, whether based on impressions, clicks, conversions, or combinations thereof.
  • It is an object of the present invention to provide an ad placement algorithm that is sufficiently fast to ensure “real-time” ad placement.
  • It is an object of the present invention to provide an ad placement technology that has the ability to learn through continuous updating.
  • It is another object of the present invention to provide an ad placement technology that is able to detect ineffective ads and incorporate minimum and maximum ad placement and ad selection constraints.
  • It is an object of the present invention to provide an estimate of the probability a customer will click an ad by estimating a principal component vector as well as the ad's click probabilities.
  • It is yet another object of the present invention to provide binomial updating of click probabilities using principal components, as well as category restrictions and ad blocking.
  • It is yet another object of the present invention to provide automatic clustering of Web pages in a manner that effectively improves overall Click-Thru-Rates.
  • It is another object of the present invention to provide optimal delivery of content, messages, and/or ads to customers by any Internet enabled distribution channel.
  • It is a final object of the present invention to optimize ad placement across a diverse set of media, such as banners, e-mail, and wireless, in an integrated manner via an allocator.
  • These and other objectives of the present invention will become apparent from a review of the detailed description that follows.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 illustrates the possible use of the present invention in a prior art direct marketing system.
  • FIG. 2 illustrates a first embodiment of the present invention for brand name and mass appeal products.
  • FIG. 3 illustrates a second embodiment of the present invention for lots and niche products.
  • FIG. 4 illustrates a schematic of the present invention.
  • FIG. 5 illustrates the Integrated Channel Management system of the present invention.
  • FIG. 6 illustrates a schematic of the system of the present invention.
  • FIG. 7 illustrates a schematic of the process of the present invention.
  • FIG. 8 illustrates a matching of supply and demand for advertising on Internet enabled distribution channels.
  • DETAILED DESCRIPTION OF THE INVENTION
  • The present invention comprises a system and method of optimal ad placement. This invention divides the optimal ad selection problem into three parts: (1) how to select and update the attribute set, (2) how to obtain and update the ad-attribute profile, and (3) how to optimally choose the next ad. For purposes of this description, the application of the present invention will be illustrated with respect to reconciling the supply of Web pages with the demand for ads on those Web pages in an optimal manner that maximizes revenue. It is assumed that each Web page can only promote one ad at a time, although that is not a limitation of the present invention. Furthermore, the ad provider pays on a per click (ad selection) basis. A typical employment of the invention is illustrated in FIG. 1, wherein customer and client (ad) data 110 is input, turned into information 120 for modeling and used for ad serving 130, as illustrated in FIG. 8.
  • The present invention associates a set of attributes with each customer. The attributes reflect the customers' interests and they incorporate the characteristics that impact ad selection.
  • Similarly, the present invention associates with each ad an ad-attribute profile. The ad-attribute profile has two uses, to calculate a customer's estimated ad selection probability, and to measure the uncertainty in that estimate.
  • The ad selection algorithm optimally selects which ad to show based on the click probability estimates and the uncertainties regarding these estimates. That is, it optimally trades off current revenue potential with future revenue potential represented by the uncertainty surrounding these estimates. Ads that have been frequently placed will have a well-documented current revenue potential while new ads with few placements represent the possibility of high future potential.
  • As customers have long-term interests as well as short-term demands the present invention divides attributes into a long-term and a short-term attribute sets. The long-term attribute set measures how much time customers spend in different interest categories such as business, sports, and health. The short-term attributes detect when a customer is searching for specific products.
  • Long-Term Attributes
  • Long-term customer attributes in the present invention are updated, depending on time and network constraints, on a placement-by-placement or on a time period-by-time period (for example day-by-day) basis. The attributes measure, for example, how much time on a percentage basis a customer spends in each interest group (i.e., sports, gardening, etc.). Thus, suppose that the customer chooses sports half the time and finance half the time. Then sports and finance attributes are each 50% and the remaining attributes are 0%.
  • Customer interests also change. To accommodate this factor the present invention implements either a moving average or an exponentially-weighted approach to updating each customer's long term attributes. Both of these statistical methods put more emphasis on recent information and can be updated easily.
  • The attributes together cover all the distinctive characteristics of the customers. There are two ways the attributes are structured. The present invention has a common set of attributes that are always updated. Alternatively, the present invention has two sets of attributes, a base set given by easily available data, and a second set of attributes that are revealed as the customer carries out certain actions.
  • Short-Term Attributes
  • The short-term attribute set of the present invention signals every time there is a specific interest for a particular service or product. For example, suppose a customer is currently shopping for a computer. Such an event can be detected by specifically marking sites that perform computer comparison tests. The probability that the customer selects a computer ad will be high.
  • Ad-Attribute Profiles
  • Customers also respond differently to different ads. The ad-attribute profile of the present invention measures how sensitive the ad is to the various attributes and thus how likely it is that a customer will react when shown an ad. As the profile for a given customer is not known ahead of time, it must be estimated. This profile estimation algorithm provides an efficient means for updating the attribute estimates in “real time.” It is not necessary to store the complete history of customers' responses, but only a set of sufficient statistics for each ad. The sufficient statistics are one square matrix variable with dimension equal to the number of attributes, one vector variable with dimension equal to the number of attributes, and two scalars. Furthermore, the sufficient statistics can be quickly calculated.
  • The profile estimation algorithm also records the uncertainty of each ad-attribute. The uncertainty conceals an ad's effectiveness (as measured by the true click probability). As an ad's effectiveness directly drives the revenue generation it is important to quickly derive a good estimate. The uncertainty regarding an ad's effectiveness decreases as the number of times it is shown increases.
  • Optimal Selection
  • The ad selector of the present invention places ads in a way that maximizes the expected overall long-term ad placement revenue (or any other measure of value). The ad placement revenue is the compensation received every time an ad is clicked. For the moment, suppose that it is known with certainty the ad-attribute profile for each ad. This means that the probabilities that the customer will react to the ads can be calculated. Multiplying the probabilities with the compensations of the corresponding ads yield the expected ad placement revenues for all ads. The choice that maximizes the expected overall ad placement revenue is then simply the ad with the highest expected ad placement revenue (or any other measure of value).
  • Unfortunately, one does not know with certainty the ad attribute profiles. This means that the above selection algorithm, if employed using the estimated ad-attribute profile, would not correctly account for revenue generation opportunities of those ads that have not been shown, because it would not incorporate the huge estimation uncertainty of those ads.
  • This ad-placement algorithm incorporates the uncertainty as well as the expected ad revenue in the selection criterion. Conceptually, the uncertainty is a reflection of the ad's potential upside. That is, it is more likely that the probability of an ad with high uncertainty is significantly higher than its' estimated value than an ad with low uncertainty. Only by testing can the present invention determine whether it is actually true. If true it is clear that there is much to gain in the future.
  • The ad-placement selection rule works by for each ad combining the volatility and the expected value of the ad placement revenue in a certain way. This rule is based on a dynamic programming approach. This approach yields the true optimal selection algorithm among all possible non-anticipating selection algorithms. The present invention adapts the dynamic programming solution to obtain a strategy that can be updated in real-time.
  • The basic modeling technique of the present invention is outlined below and illustrated in FIG. 7.
  • Basic Modeling
  • There are L customers 700 for each of whom the present invention tracks the value of MA customer attributes 702. Customer attributes 702 may be time-based, geography based, or any other segmentable and tractable attribute. There are N different ads in campaign 704.
  • The present invention maintains a customer matrix:
  • Customer ID Attribute 1 Attribute 2 . . . Attribute MA
    ID_1 A_11 A_12 . . . A_1MA
    ID_2 A_21 A_22 . . . A_2MA
    ID_L A_L1 A_L2 . . . A_LMA

    And an ad matrix:
  • Attribute 1 Attribute MA
    Ad ID weight . . . weight
    Ad_1 W_11 . . . W_1MA
    Ad_2 W_21 . . . W_2MA
    Ad_N W_N1 . . . W_NMA
  • Approach 1
    • 1. The estimated probability of customer x clicking on ad i is given by
  • k = 1 MA ( A_xk ) ( W_ik ) .
    • 2. Every time a customer visits a Web site within the network, the data is collected 712 and the attributes of that customer are updated 714.
    • 3. Every time a customer is shown an ad, the attribute weightings for that ad are updated 716 depending on how the customer responded.
  • The calculation of which ad to show 710 is then clearly quick to compute as it is essentially (MA)(N) multiplications and additions and then a comparison of the determined probabilities 708. With some careful thought, the updates of the customer and ad matrices can also be done rapidly and with numerical stability.
  • As the present invention collects more data, this method continues to ref=the estimates and thus is referred to as Bayesian. Ads may lose their effectiveness over time, and people's attributes will certainly evolve over time. To capture this there are several updating methods that weight recent data more heavily. All of these methods can be updated quickly and require little storage.
  • In use, as shown in FIGS. 2 and 3, a customer accesses a participating Web site at illustrated 201, 301, an ad server determines the best ad to place (highest score of 150) . 19 at 202, 302, the ad is served to the Web site at 203, 303 and a click by the customer directes him to the advertisers Web site at 204, 304.
  • Adding Uncertainty and Optimizing for Earning vs. Learning
  • Intuitively, there is a big difference between an ad that has been shown 100 times and been selected once and an ad that has been shown 10,000 times and been selected 100 times, even though each has been selected 1% of the times it has been shown. It is somehow worth something to us to learn more about the first ad, as it is quite possible that it will turn out to be a very popular ad.
  • The present invention alters the above structure by carrying not just the mean but the standard deviation of each estimated random variable as well.
  • The ad selection process then works by combining the estimated probability and the standard deviation in a certain way for each ad and then comparing. When done properly, this is the optimal way to balance earning and learning.
  • Updates of the standard deviation can be calculated quickly as they can be based on the updates of the estimated probabilities.
  • Adding Structure to the Matrices
  • The present invention is also able to learn more about a given customer from other customers than the above is yet capturing. As a simple example, imagine that one has discovered that a particular ad is very popular with males and this system is considering showing it to a particular customer. The present invention has an attribute for gender, but doesn't yet know if this particular customer is male or female. However, there is lots of other data about the customer, such as interest level in sports. By looking at the attributes of all other customers, and the associated correlations, the present invention can estimate the probability that this customer is male. The present invention may find, for instance, that interest in sports is highly indicative of being male.
  • Choosing the Attributes
  • A key aspect of the present invention is identifying attributes that are predictive of behavior. This step requires analyzing real data, and should be re-visited periodically. Second, for numerical stability, the present invention must choose attributes that are not too similar to one another. There are several ways to choose a representative attribute set, basically by selecting orthogonal attributes. Third, the present invention needs concrete policies for deleting non-helpful attributes and splitting ones that are particularly useful. Finally, there are several statistical/data-analysis methods the present invention can employ to create updating procedures for the values of each attribute. The right procedure will depend on initial statistical tests and is also a step that should be re-visited at a later stage.
  • As customers have long-term interests as well as short-term demands the present invention divides attributes into a long-term and a short-term attribute sets. The long-term attribute set measures how much time customers spend in different interest categories such as business, sports, and health. Thus, suppose that the customer chooses sports half the time and finance half the time. Then sports and finance attributes are each 50% and the remaining attributes are 0%.
  • The short-term attributes detect when a customer is searching for specific products. For example, a customer shopping for a new computer will likely visit sites that relate to computer sales. Such sites can be marked and computer ads placed on such sites have high probabilities of being selected, while general interest ads have markedly lower probability of being selected.
  • Searching among the short-term attributes, for ads to show, will be quick as they only flag high probability events.
  • Advanced Modeling with Integrated Optimization and Scheduling
  • Every Web site used with the present invention sends a request for an ad every time a user accesses the site. The request is sent to the ad manager. The ad manager has a lookup table specifying ads and associated probabilities defining the ads that should be shown next for every site. This lookup table is updated frequently, such as every hour or on any other relevant time unit basis.
  • The system records that the ad has been shown and whether or not there was a click. The system holds a database with the number of impressions and clicks for each ad on each site by hour. The system also maintains a list of the total and remaining paid clicks for each ad, and a list of payments per click for each ad.
  • Basics
  • The goal of the optimizer-scheduler is to place ads on Web sites in such a way as to maximize the overall value for the advertising serving entity. This value may be a combination of impression, clicks, conversions, and other value that may be obtained by placing an ad on a particular site. The probability of a given ad being clicked on varies from site to site. The present invention does not know these probabilities beforehand but, rather, the present invention continuously refines this estimate as more observations are made. There is value in obtaining additional information about these probabilities and this is accounted for in the algorithm.
  • Arrangements with Web sites tend to be fairly long-term. Arrangements with advertisers tend to be composed of campaigns, each lasting from days to weeks. The advertisers typically purchase a certain number of clicks. While not always spelled out explicitly, the understanding is that these clicks will occur reasonably uniformly over the campaign's lifetime. Of course, there is no way to guarantee that an ad does not fall behind schedule (it is possible that nobody chooses to click on the ad). The present invention can, however, ensure (assuming that there is a reasonably rich set of ads) that no ad gets significantly ahead of schedule. This is captured via a tunable parameter within the algorithm.
  • Occasionally, the arrangement with the advertiser is simply to show the ad a specified number of times. The system of the present invention serves the requested ad according to attributes described above while simultaneously tracking the number of times the ad is displayed.
  • While taking the full lifetime of each campaign into account, the algorithm explicitly plans for the next 24 hours or other such reasonable period, and then re-optimizes more frequently, such as every hour.
  • Definitions System Variables
    • m denotes the number of Web sites or any reasonable partition of the Web sites in the network.
    • n denotes the number of ad campaigns or any reasonable collection of ads currently underway.
    • K denotes the set of ads that are on a pay-per-click basis or any other similar measure of performance.
    • M denotes the set of ads that are on a pay-per-view basis or any other reasonable measure of activity that is not performance related.
    • dj denotes the estimated number of impressions for a first period, such as one 24-hour period or other reasonable period, at site j.
    • μj denotes the average clicking probability at site j calculated over a second, longer period, such as the past 30 days or other such reasonable period. Only incorporating the observed probabilities for ads that have at least, for example, 500 impressions at that site, then one possible embodiment would be to set μj=0.005 if site j is new. Else
  • μ j = max ( Average i ; n i , j > 500 ( p i , j ) , 0.001 )
  • In this example, the use of 30 days, 500 impressions, and the tolerances of 0.005 and 0.001 are merely exemplary and are not meant as a limitation on the average clicking probability μj. Other timelines and constants could also be used without departing from the scope of the invention.
  • Campaign Variables
    • Ti denotes the total duration in days of ad campaign i.
    • ti denotes the time in days since the ad campaign of ad i began.
    • Ci denotes the maximum total number of paid clicks for ad i over the duration of the ad campaign.
    • ci denotes the maximum number of remaining paid clicks for ad i.
    • Πi denotes the total minimum number of impressions required by ad i over the duration of its campaign.
    • Ii denotes the minimum number of remaining impressions required for ad i. Ii is updated frequently, such as every hour on the hour.
    • si denotes the payment per click, per view, per conversion, or per any other reasonable measure of activity or performance, depending on the arrangement for ad i.
    • ni,j is 2 plus the number of impressions for ad i at site j over the last 30 days or other such reasonable period. If the ad has never been shown at site j then ni,j=2. (The present invention adds 2 to avoid problems associated with ni,j=0)
    • ki,j is the number of clicks for ad i at site j over the duration of ad i's ad campaign.
    • pi,j is the observed clicking probability of ad i at site j. If ad i has never been shown (ni,j=2) on site j then pi,jj. Otherwise,
  • p i , j = k i , j n i , j + μ j 2 n i , j .
  • The second term here is to ensure that the present invention never has Pi,j=0.
    • δi controls the smoothness of the campaign. This can depend on the smoothness type, how the campaign is doing in terms of delivery, and other factors. A typical value is 0.2. This controls how smoothly clicks must occur throughout the lifetime of a campaign. A value of 0.2 means that no campaign can ever be more than 20% ahead of absolutely smooth (measured daily) delivery.
    Parameters
    • Set γ=1.5 or any other reasonable number. This is the learning parameter, it controls how heavily the present invention emphasizes learning about ad-site combinations for which the present invention has little information. This will be tuned via simulation.
    • αi,j denotes the fraction of times ad i should be shown on site j for the next period, such as per hour.
    Hourly or Frequent Events
  • The system sends the number of impressions and the number of clicks for each ad at each site to the ad manager.
    • The ad manager updates ni,j, ki,j, and ti.
    • The ad manager calculates pi,j.
      Updating of ci and Ii
  • These variables are used in the optimization/scheduling algorithm. First, consider ci. The contract for most ads specifies the beginning and end of the ad campaign and the maximum number of paid clicks. The scheduling algorithm requires a number that is to be used for one day.
  • In the formula below, the present invention computes the value of ci that corresponds to a perfectly smooth delivery of clicks from the current time on. Note that in the linear program (LP), the present invention will not require that this be hit exactly, but rather within a pre-set tolerance.
  • c i = max ( ( C i - j = 1 m k i , j ) , 0 ) max ( ( T i - t i ) , 1 / 24 )
  • Now, consider Ii. Sometimes, it is agreed that ad i must obtain a minimum number of impressions. This minimum number must be satisfied at the end of the campaign. As above, the formula above determines the number of impressions needed during the next day to achieve a smooth delivery of, in this case, impressions.
  • I i = max ( ( Π i - j = 1 m n i , j + 2 * m ) , 0 ) max ( ( T i - t i ) , 1 / 24 )
  • Note that the present invention needs the term 2*m to compensate for the fact the present invention has adjusted nij.
    Scheduling Problem (Solved Frequently, such as Once Every Hour on the Hour)
  • Step 1. Define:
  • p ^ i , j = p i , j + γ p i , j ( 1 - p i , j ) n i , j - 1
  • Step 2. Solve the Following Linear Programming Problem:
  • MAX { α i , j } Σ i K j = 1 m α i , j v i , j d j Subject to ( 1 ) j = 1 m α i , j p i , j d j ( 1 + δ i ) c i , i K ( 2 ) j = 1 m α i , j d j ( 1 + δ i ) I i , i M ( 3 ) i = 1 n α i , j 1 , j = 1 , 2 , , m ( 4 ) α i , j 0 , i = 1 , 2 , , n , j = 1 , 2 , , m ( 5 )
  • where vi,j={circumflex over (p)}i,jsi if ad i is click-based or conversion-based, and si if it is impression-based.
  • Comments
    • (1) The objective function is to maximize the overall value, including learning about sites where we have little information.
    • (2) The LHS is the total number of expected clicks for ad i during the interval. This constraint enforces the campaign smoothness condition.
    • (3) The LHS is the total number of expected impressions for ad i during the interval. This constraint enforces the campaign smoothness condition.
    • (4) This constraint ensures that the probabilities of what ads to show at each site add to 100%.
    • (5) This constraint ensures that all probabilities are non-negative.
    Remarks
    • (1) By setting si=1 for all i converts the objective function into one that seeks to maximize the overall Click-Thru-Rate (CTR).
    • (2) There is no explicit constraint ensuring that each ad does not fall “too far behind”. The reason for this is such a constraint would lead to the linear program (LP) having no feasible solution.
    • (3) To account for the remark above, campaigns should be monitored on a frequent basis (daily) with poor ads being removed or outsourced.
    • (4) Note that there is obviously always a solution to the LP.
    Creating an Ad Lookup Table
  • The present invention describes the process of converting the output of the linear program (LP) into a lookup table. For each site j and ad i multiply the αi,j by 100 and round off the product to the nearest integer. Let βi,j=Round(100*αi,j). βi,j represents how many times out of a hundred ad i should be shown at site j. Create a list for site j by letting the first β1,j elements be ad 1, let the next β2,j be ad 2, and so forth. This process will yield a list of approximately 100 ads for each site (many ads will appear several times for a given Web site). The next step is to ensure that the list has exactly 100 ads for each site. This is done by truncating the list for any site with more than 100, and repeating the first ad on the list as many times as necessary for any site with less than 100.
  • It is possible to employ a frequency-capping component at this stage of the algorithm.
  • Daily routine
  • Calculate dj and μj over the last 30 days or other such reasonable period, as shown in the schematic diagram of FIG. 4. When new sites or new ads 410 are added, constraints are prepared 420, and the new matrices are added to the ad server's optimization engine 430. Prior to having adequate data, initial estimates (alphas) 435 are used and the data is added to the ad look-up tables 440. The ads are then served at 450 (with testing 490 and frequency capping 492). Response data is collected at 460 and recorded together with the ad serving information in transaction log 470. The data is then used to update parameters at 480, and the iterative process continues.
  • Enhancements
  • This framework allows for a number of additional constraints to be added in a natural way.
  • Click Probability Estimation with Principal Components
  • Above, the probability that users visiting Web site j will click on ad i was estimated by dividing the number of clicks on ad i at Web site j with the number of impressions of ad i at Web site j, but can be estimated by any other reasonable method.
  • An alternative is a principal component approach to banner ad probability estimation. This approach contains two steps. In the first step we estimate the principal component vectors whereas in the second step we estimate the banner ads' click probabilities. Each step are updated as new information becomes available. The advantage to using the principal component approach is significant. For example, if there are 100 Web sites and 5 principal components then the conventional approach requires approximately 20 times as many impressions as the principal component approach to reach the same level of accuracy.
  • This approach is begun by presenting a series of definitions. It continues by describing the principal component estimation, and concludes by finally describing the probability estimation.
  • Definitions
    • Probabilities Estimate of the probability that users downloading ad i from Web site j will click on that ad is pi,j.
    • Error Uncertainty of the estimate pi,j is σi,j=pi,j*(1−pi,j)/n, (a slightly biased estimate),
    • Sites There are m sites.
    • Site Average Let μj denote the average click probability on site j.
    • Normalized Ad probability Vector—For each ad i we define the vector
  • y i = [ y i , 1 , y i , 2 , , y i , m ] where y i , j = ( p i , j - 1 ) σ i , j .
    • Principal Components—hypothesize that there exist 1 m-dimensional vectors x1, x2, . . . , xl, such that every ad probability vector is a linear combination of x1, x2, . . . , xl.
    • Other Let ni,j denote the number of impressions of ad i on Web site j and let ki,j denote the number of clicks of ad i on Web site j.
    Principal Components Estimation
  • When using principal components estimation, the present invention identifies ads that have been shown a large number of times at many Web sites. These are the ads that will be used to calculate the principal components.
    • Step 1. Calculate estimation of site averages.
  • μ j = Σ i p i , j Count ( i on j )
    • Step 2. Calculate the variance of the error of each probability estimate.

  • σi,j =p i,j*(1−p i,j)/n
    • Step 3. Calculate normalized ad probability vectors.
    • Step 4. Calculate the principal components by first creating the matrix Y. Row i of Y corresponds to ad i. Then calculate the matrix product YTY. Then find the eigenvectors and eigenvalues of YTY. Choose the k eigenvectors corresponding to the k eigenvalues which together accounts for at least x % of the total of the sum of all eigenvalues. The first principal component corresponds to the first eigenvector as follows: Element i of the eigenvector is the weight associated with ad i. Therefore, multiply the elements of the first eigenvector with their corresponding estimated probabilities for each site and sum over these newly found values to determine the first principal component vector. Repeat the procedure for the remaining k-1 eigenvectors.
    Banner Ad Click Probability Estimation
  • With the principal components available there are a variety of ways to estimate an ad's click probabilities. Two straightforward methods of such estimation are ordinary least squares regression and generalized least squares regression.
  • The objective of the principal component approach is to efficiently and quickly obtain ad probabilities for a majority of banners. In addition to finding the probabilities for the majority it is also necessary to identify banners where the principal components do not capture a significant portion of the observed probabilities. A maximum likelihood approach can be used to integrate this aspect into the probability estimation routine.
  • Binomial Updating of Click Probabilities Using Principal Components
  • Consider a row of n cells that have unknown click probabilities pi, where cells are i=1, 2, . . . , n
  • Assume there is a single (for notational simplicity) principal component that is likely to give these probabilities. This principal component is a vector v=(v1, v2, . . . , vn)≧0. Then model the vector P as

  • P=av+e
  • where a is an unknown constant and e=(e1, e2, . . . , en) is a vector of errors.
  • Then assume that the ei' s are independent, normal random variables with zero mean and variance σ2. The variance is determined by the process that determines the principal components.
  • Now, imagine the system has been run for a while and has observed ki from ni in cell i. It is then desirable to assign the best pi's.
  • The joint probability of those click rates and the probabilities given a is
  • P = i = 1 n exp [ - 1 2 σ 2 ( p i - av i ) 2 ] i = 1 n p i k i ( 1 - p i ) n i - k i C
  • where C is a constant independent of a and the pi's.
  • Now determine a and the pi' s by maximizing P with respect to a and the pi's . Ignoring C, to obtain:
  • ln P = - 1 2 σ 2 i = 1 n ( p i - av i ) 2 + i = 1 n [ k i ln p i + ( n i - k i ) ln ( 1 - p i ) ] (* )
  • Note that In P is concave with respect to a and pi's≧0, so maximization is well-defined. Note that (as one would expect) if σ>>0 and/or ni, ki large, one finds
  • p i = k i n i .
  • Also, for a small and/or ni, ki small, one finds pi=avi.
  • Now, the problem is separable with respect to pis, so one strategy is to maximize with respect to pi with a fixed. This gives the necessary condition:
  • F ( p i ) = - 1 σ 2 ( p i - av i ) + k i p i - ( n i - k i ) ( 1 - p i ) 2 = 0
  • Note that F(0)=+∞ and that F(1)=−∞. Hence, there is a pi with 0<pi<1 and F(pi)=0.
  • Furthermore,
  • F ( p i ) = - 1 σ 2 - k i p i 2 - ( n i - k i ) ( 1 - p i ) 2 < 0
  • so F is monotone. Thus, the solution is unique.
  • It can therefore be concluded that for a given a, there is for each i=1, 2, . . . , n a unique pi, 0<pi<1, that can be easily found by Newton's method or any other descent method. (The case of ki=0 is handled separately later.)
  • Now, consider pi to be a function of a. Then,
  • a ln P = ln P A + i = 1 n ln P p i P 0 = ln P a = 1 σ 2 i = 1 n ( p i ( a ) - av i ) v i
  • This discussion motivates the following algorithm:
  • 1. Select initial a
  • 2. Find the pi's by solving Fi(pi,a)=0 (Newton's method 1 variable at a time)
  • 3. Evaluate
  • a
  • ln P
  • 4. Adjust a by steepest descent
  • Note that the extension to multiple principal components is straightforward.
    • Case of ki=0
      The necessary condition is

  • (1−p i)(av i −p i)=n iσ2
  • It is easy to see that if avi>niσ2, then there is a solution with 0<pi<1. Otherwise pi=0. should be used. Putting this together, pi=max{root1,0} where root1 is the root of the quadratic less than 1. That is,
  • root 1 = 1 + av i - ( 1 + av i ) 2 - 4 ( av i - n i σ 2 ) 2
  • Note that it follows from this that if ni=0, we have pi=avi. If ki=0 repeatedly, one does not set pi=0 until they get at least
  • n i = av i σ 2
  • impressions.
  • Initial Value of a
  • If all the ni's are small, and/or σ2 is small, we set pi=avi for all i.
  • Then,
  • LnP = i = 1 n k i ln av i + i = 1 n ( n i - k i ) ln ( 1 - av i ) ln P a = i = 1 n k i a - i = 1 n ( n i - k i ) 1 - av i v i = 0
  • Solve for a.
  • This can be interpreted by multiplying by a.
  • i = 1 n k i = i = 1 n ( n i - k i ) av i 1 - av i
  • which shows that a is set to balance the overall probabilities consistent with observed clicks and impressions.
  • Prior Distribution on a
  • Adding a prior density on a as
  • 1 2 π ω exp { - 1 2 ω 2 ( a - a 0 ) 2 }
  • This adds the term
  • - 1 2 ω 2 ( a - a 0 ) 2
  • to lnP as defined in (*) above.
  • Category Restrictions
  • Certain advertisers would like to have their ads displayed only on a subset of the sites. This is handled in the following way. Let the subset of such sites be denoted by J. This might be, for example, the set of all sports related sites. Then, if the present invention is considering ad i, the restriction takes the form:

  • αi,j=0 for all j ∉ J.
  • The subset J can, of course, involve multiple levels of categories, generally chosen by the advertiser. A typical subset could be something like ‘all of the sports related—Spanish language—G-rated sites.’
  • Ad Blocking
  • Conversely, certain Web sites would like to prevent particular ads from appearing on their site. This may be the case, for instance, if the item being advertised is viewed as a competitor to the Web site's product. Let the site be denoted by j and the set of ads to be blocked to be denoted by the set I. Then the restriction has the form

  • αi,j=0 for all i ∈ I.
  • Typically, a Web site would be able to do this by both blocking entire categories, such as R-rated sites, and by selecting particular ads for exclusion, such as one of a direct competitor.
  • Click-Thru-Rate (CTR) of Impression Based Ads
  • Even with contracts that are strictly impression based, it may be advantageous to attempt to enhance the CTR of such ads. Providing a good CTR may lead to more future business. To do this, the present invention must determine how valuable each click on an impression based ad is in economic terms. Then, this can simply be added to the objective function.
  • Clustering Process
  • Automatic clustering of small Web sites can be employed in a manner that effectively improves overall Click-Thru-Rates. To form clusters, the process starts by matching each ad with a campaign type, which is assigned through a GUI. There are types for ‘Personal Finance’, ‘Sports’, ‘Computers and Technology’, and the like. The present invention denotes each campaign type ti, i=1, 2 , . . . , 20, and the set of all campaign types T. Each cluster will correspond to one of these types.
  • To determine which types will be used for clustering, a database is used with the history of the last 30 days or other reasonable period, and count all the impresions for each type. If the objective is to form n clusters, then the first n types ordered by descending number of impressions are selected to be the clustering types. Now call each clustering type {circumflex over (t)}j, j=1, 2, . . . , n, and the set of all the clustering types {circumflex over (T)}. Each clustering type is assigned a number (ID) starting from 2 and going up until n+1. A Webmaster with cluster ID=0 means that it was not clustered, and with ID=1 means it is in a cluster of special Webmasters.
  • The database contains information on all the campaign types that each Webmaster showed. Not all webmasters-type pairs in the database will be used to perform the computations; in one embodiment, only those that meet the following requirements:
  • It must have more than 2 impressions on a type
  • It must have more than 1 click on a type
  • The CTR for a type must be less than 100%
  • Although this is a preferred screening process, any other such reasonable screening process can be used without departing from the scope of the present invention.
  • In addition, the set of campaign types for a Webmaster must be a superset of the clustering types: {circumflex over (T)} Tm, where m represents a particular Webmaster.
  • Each Webmaster will be assigned to one and only one cluster, so it will have a corresponding cluster ID, IDm. Only one more piece of information is needed to determine the cluster ID of each Webmaster: p-hat.
  • p_hat m , t ^ i = CTR m , i + γ CTR m , i ( 1 - CTR m , i ) imps m , i ,
  • where γ is a learning parameter m is the Webmaster, i is the campaign type, and impsm,i refers to the number of impressions for the Webmaster-campaign type pair. Now,
  • ID m = 1 + arg max j ( p_hat m , t ^ j ) , j = 1 , 2 , , n .
  • Each j corresponds to a clustering type, as defined before.
  • Thus, the object is to look for the max p-hat for each Webmaster. The type associated with the max p-hat will be cluster assigned to the Webmaster. In order to write the output, the present invention translates the type to its cluster ID.
  • Splitting Large Clusters
  • It could be the case that once clusters are formed, the total number of impressions for one of them will be over 20% or any other reasonable set percentage of the total number of impressions for all the clusters. In this case, it is desirable to split the cluster by applying the clustering process to those Webmasters in the largest cluster, and by forming a new set of two clustering types for them that excluded the type associated with the cluster. For instance, if cluster 3 with associated type ‘Sports’ is the target, then a new clustering type set might be {‘Entertainment’, ‘Health’}, which will be chosen because they are the two types with the most and second-most impressions. Each Webmaster will be assigned a new cluster ID using the same “max p-hat” criteria.
  • The splitting process is repeated until no cluster has more than 20% of all the impressions.
  • Integrated Channel Management
  • It is also desirable to optimize ad placement across a diverse set of media, such as banners, e-mail, and wireless, in an integrated manner. An allocator 500, as shown in FIG. 5, can be used to serve full-sized 510, odd-sized 520, and other type 530 ads using the following algorithm:
  • Definitions
    • Vi=Expected impressions per period, such as per day, of media type i.
    • pij=probability of a click on media type i for campaign j.
    • Gj=Total target number of clicks for campaign j for the period.
    • ζij=The percent of all impressions from media i that will be allocated to campaign j.
  • Max Σ i , j p ij ζ ij V i s . t . Σ j ζ ij 1 for all i Σ i p ij ζ ij V i ( 1 + δ ) G j for all j
  • ζij≧0 for all i and j
  • Of course, constraints enforcing minimum and maximum representation on various channels are possible as well.
  • Then, pijζijVi is sent to the LP as the upper bound for campaign j for channel type i.
  • Multiple Ads from One Customer
  • From time to time, an advertiser will employ multiple banner designs. One approach to this, of course, is simply to treat each of these as a separate ad. However, if the advertiser is willing to let the optimizer select which ads to show, the present invention can expect on average an improvement in the CTR. Imagine that the two ads are labeled l and m, and that the initial click totals (on an average daily basis) were cl and cm. Then, normally the present invention would have included the two constraints:
  • j = 1 m α l , j p l , j d j ( 1 + δ ) c l j = 1 m α m , j p m , j d j ( 1 + δ ) c m
  • Instead, the present invention can replace this with the single constraint, which is less restrictive and therefore will result in a better or equal solution:
  • j = 1 m ( α l . j p l . j d j + α m , j p m , j d j ) ( 1 + δ ) ( c l + c m ) .
  • It is also possible to do something in between the above two solutions. For example, an advertiser with two different ad designs could ask for a total of 10,000 clicks with a minimum of 2,500 each. Therefore, there are many other reasonable solutions.
  • The method of the present invention can be practiced by conventional servers 620, 630, such as Pentium III based systems operating with Windows NT, interacting over the Internet 600 to collect attribute information about customers 640 and ads from database 610, and then serve the ads to the customers 640 operating Internet enabled devices with browsers, such as Apple Macintosh or Windows-based personal computers with browser clients like Internet Explorer or Netscape Navigator, as shown in FIG. 6. As such, there are no special requirements for the user interaction on the Internet using the present invention. Conventional PCs, which may be Pentium based or Apple Macintosh type processors, are all suitable processors for exercising the present invention. Likewise, the server of the present invention can be an Intel Pentium type server, Sun server or other server suitable for serving advertisements.
  • Numerous aspects of the present invention also have separate utility outside of any Internet enabled distribution channels. The basic modeling methodologies and algorithms of the present invention are therefore able to be incorporated with virtually any other marketing medium in which an “ad” is displayed to a “customer,” including, but not limited to, mail, telephone, facsimile, television, radio, and print media. Other embodiments, with modifications and changes to the preferred embodiment, will be apparent to those skilled in the art without departing from the scope of the present invention as disclosed. Therefore, the present invention is only limited by the claims appended hereto.

Claims (50)

1. (canceled)
2. A method comprising:
determining, using at least one processor, an estimated selection probability for one or more advertisements of a plurality of advertisements, the estimated selection probability indicating a likelihood a given advertisement will be selected;
identifying an expected value for the one or more advertisements of the plurality of advertisements;
determining, using the at least one processor, an expected ad placement value for the one or more advertisements, the expected ad placement value being a function of the estimated selection probability and the expected value; and
selecting an advertisement to present based on the expected ad placement value.
3. The method as recited in claim 2, further comprising serving the advertisement.
4. The method as recited in claim 3, further comprising serving the advertisement over a communications network.
5. The method as recited in claim 3, further comprising serving the advertisement to a mobile device.
6. The method as recited in claim 5, further comprising serving the advertisement to a marketing medium on the mobile device.
7. The method as recited in claim 6, wherein the marketing medium comprises a webpage.
8. The method as recited in claim 6, wherein the marketing medium comprises a software program.
9. The method as recited in claim 3, further comprising serving the advertisement to a webpage.
10. The method as recited in claim 2, wherein the estimated selection probability for a particular advertisement is a function of an observed click-through-rate for the particular advertisement.
11. The method as recited in claim 10, wherein the observed click-through-rate comprises a ratio of a number of times the particular advertisement has been clicked over a number of times the particular advertisement has been shown.
12. The method as recited in claim 2, further comprising maintaining a user profile, the user profile including user attributes reflecting interests of a user.
13. The method as recited in claim 12, further comprising updating the user attributes of the user profile based on one or more of Internet sites visited by the user, advertisements selected by the user, or internet searching by the user.
14. The method as recited in claim 12, further comprising maintaining an advertisement profile for the one or more advertisements of the plurality of advertisements, each advertisement profile including ad-attributes that reflect how much a particular advertisement correlates to a given user attribute.
15. The method as recited in claim 14, wherein the estimated selection probability for the particular advertisement is a function of the consumer attributes of the user and the ad-attributes for the particular advertisement.
16. The method as recited in claim 2, wherein the expected value for a particular advertisement is based on a value for placement or selection of the particular advertisement.
17. A non-transitory computer-readable storage medium including a set of instructions that, when executed, cause at least one processor to perform steps comprising:
determining an estimated selection probability for one or more advertisements of a plurality of advertisements, the estimated selection probability indicating a likelihood a given advertisement will be selected;
identifying an expected value for the one or more advertisements of the plurality of advertisements;
determining an expected ad placement value for the one or more advertisements, the expected ad placement value being a function of the estimated selection probability and the expected value; and
selecting an advertisement to present based on the expected ad placement value.
18. The computer-readable storage medium as recited in claim 17, further comprising instructions that, when executed, cause at least one processor to serve the advertisement.
19. The computer-readable storage medium as recited in claim 18, further comprising instructions that, when executed, cause at least one processor to serve the advertisement over a communications network.
20. The computer-readable storage medium as recited in claim 18, further comprising instructions that, when executed, cause at least one processor to serve the advertisement to a mobile device.
21. The computer-readable storage medium as recited in claim 20, further comprising instructions that, when executed, cause at least one processor to serve the advertisement to a marketing medium on the mobile device.
22. The computer-readable storage medium as recited in claim 21, wherein the marketing medium comprises a webpage.
23. The computer-readable storage medium as recited in claim 21, wherein the marketing medium comprises a software program.
24. The computer-readable storage medium as recited in claim 18, further comprising instructions that, when executed, cause at least one processor to serve the advertisement to a webpage.
25. The computer-readable storage medium as recited in claim 17, wherein the estimated selection probability for a particular advertisement is a function of an observed click-through-rate for the particular advertisement.
26. The computer-readable storage medium as recited in claim 25, wherein the observed click-through-rate comprises a ratio of a number of times the particular advertisement has been clicked over a number of times the particular advertisement has been shown.
27. The computer-readable storage medium as recited in claim 17, further comprising instructions that, when executed, cause at least one processor to maintain a user profile, the user profile including user attributes reflecting interests of a user.
28. The computer-readable storage medium as recited in claim 27, further comprising instructions that, when executed, cause at least one processor to update the user attributes of the user profile based on one or more of Internet sites visited by the user, advertisements selected by the user, or internet searching by the user.
29. The computer-readable storage medium as recited in claim 27, further comprising instructions that, when executed, cause at least one processor to maintain an advertisement profile for the one or more advertisements of the plurality of advertisements, each advertisement profile including ad-attributes that reflect how much a particular advertisement correlates to a given user attribute.
30. The computer-readable storage medium as recited in claim 29, wherein the estimated selection probability for the particular advertisement is a function of the consumer attributes of the user and the ad-attributes for the particular advertisement.
31. The computer-readable storage medium as recited in claim 17, wherein the expected value for a particular advertisement is based on placement of the particular advertisement.
32. The computer-readable storage medium as recited in claim 17, wherein the expected value for a particular advertisement is based on a value for placement or selection of the particular advertisement.
33. A method comprising:
calculating, using at least one processor, a probability that each advertisement of a plurality of advertisements will be selected;
calculating, using the at least one processor, an expected value for each advertisement of the plurality of advertisements, the expected value for a particular advertisement being a function of the probability for the particular advertisement and the expected value for the particular advertisement;
selecting an advertisement based on the expected value; and
serving the selected advertisement to a mobile device.
34. The method as recited in claim 33, further comprising serving the selected advertisement to a marketing medium on the mobile device.
35. The method as recited in claim 34, wherein the marketing medium comprises a software program on the mobile device.
36. The method as recited in claim 35, wherein the marketing medium comprises a webpage displayed in a web browser.
37. The method as recited in claim 33, wherein the probability for a given advertisement is based on a correlation of a user profile and one or more characteristics of the given advertisement.
38. The method as recited in claim 37, further comprising:
receiving a response to the selected advertisement; and
updating the user profile based on the response to the selected advertisement.
39. The method as recited in claim 38, wherein the response is a user selection of the selected advertisement.
40. The method as recited in claim 38, further comprising determining an updated probability that each advertisement of the plurality of advertisements will be selected by the user, the updated probability being determined using the updated user profile.
41. The method as recited in claim 40, further comprising:
determining an updated expected value for each advertisement by multiplying the updated probability for each advertisement by an expected value for each advertisement; and
serving the advertisement with the highest updated expected value to the user.
42. A non-transitory computer-readable storage medium including a set of instructions that, when executed, cause at least one processor to perform steps comprising:
calculating a probability that each advertisement of a plurality of advertisements will be selected;
calculating an expected value for each advertisement of the plurality of advertisements, the expected value for a particular advertisement being a function of the probability for the particular advertisement and the expected value for the particular advertisement;
selecting an advertisement based on the expected value; and
serving the selected advertisement.
43. The computer-readable storage medium as recited in claim 42, further comprising instructions that, when executed, cause at least one processor to serve the selected advertisement to a marketing medium.
44. The computer-readable storage medium as recited in claim 43, wherein the marketing medium comprises a software program.
45. The computer-readable storage medium as recited in claim 44, wherein the marketing medium comprises a webpage displayed in a web browser.
46. The computer-readable storage medium as recited in claim 42, wherein the probability for a given advertisement is based on a correlation of a user profile and one or more characteristics of the given advertisement.
47. The computer-readable storage medium as recited in claim 46, further comprising instructions that, when executed, cause at least one processor to update the user profile based on a response to the selected advertisement.
48. The computer-readable storage medium as recited in claim 47, wherein the response is a selection by a user of the selected advertisement.
49. The computer-readable storage medium as recited in claim 47, further comprising instructions that, when executed, cause at least one processor to determine an updated probability that each advertisement of the plurality of advertisements will be selected by the user, the updated probability being determined using the updated user profile.
50. The computer-readable storage medium as recited in claim 49, further comprising instructions that, when executed, cause at least one processor to:
determine an updated expected value for each advertisement by multiplying the updated probability for each advertisement by an expected value for each advertisement; and
serve the advertisement with the highest updated expected value to the user.
US13/620,907 1999-11-08 2012-09-15 Ad placement Abandoned US20130046618A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/620,907 US20130046618A1 (en) 1999-11-08 2012-09-15 Ad placement

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US16425399P 1999-11-08 1999-11-08
US09/610,197 US7822636B1 (en) 1999-11-08 2000-07-01 Optimal internet ad placement
US12/700,696 US9754282B2 (en) 1999-11-08 2010-02-04 Systems and methods for placing electronic advertisements
US13/620,907 US20130046618A1 (en) 1999-11-08 2012-09-15 Ad placement

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US12/700,696 Continuation US9754282B2 (en) 1999-11-08 2010-02-04 Systems and methods for placing electronic advertisements

Publications (1)

Publication Number Publication Date
US20130046618A1 true US20130046618A1 (en) 2013-02-21

Family

ID=42826982

Family Applications (14)

Application Number Title Priority Date Filing Date
US09/610,197 Expired - Lifetime US7822636B1 (en) 1999-11-08 2000-07-01 Optimal internet ad placement
US12/700,696 Active 2032-11-11 US9754282B2 (en) 1999-11-08 2010-02-04 Systems and methods for placing electronic advertisements
US13/612,621 Abandoned US20130046617A1 (en) 1999-11-08 2012-09-12 Ad placement
US13/612,631 Expired - Lifetime US10217128B2 (en) 1999-11-08 2012-09-12 Ad placement
US13/612,625 Expired - Lifetime US10204356B2 (en) 1999-11-08 2012-09-12 Ad placement
US13/620,899 Expired - Lifetime US10229428B2 (en) 1999-11-08 2012-09-15 Ad placement
US13/620,907 Abandoned US20130046618A1 (en) 1999-11-08 2012-09-15 Ad placement
US13/620,902 Abandoned US20130046627A1 (en) 1999-11-08 2012-09-15 Ad placement
US13/693,000 Abandoned US20130097026A1 (en) 1999-11-08 2012-12-03 Ad placement
US13/705,056 Expired - Lifetime US10217129B2 (en) 1999-11-08 2012-12-04 Ad placement
US13/705,059 Abandoned US20130097010A1 (en) 1999-11-08 2012-12-04 Ad placement
US13/705,028 Abandoned US20130097019A1 (en) 1999-11-08 2012-12-04 Filtering placement of advertisements
US13/705,066 Abandoned US20130097012A1 (en) 1999-11-08 2012-12-04 Ad placement
US16/241,366 Abandoned US20190139084A1 (en) 1999-11-08 2019-01-07 Ad placement

Family Applications Before (6)

Application Number Title Priority Date Filing Date
US09/610,197 Expired - Lifetime US7822636B1 (en) 1999-11-08 2000-07-01 Optimal internet ad placement
US12/700,696 Active 2032-11-11 US9754282B2 (en) 1999-11-08 2010-02-04 Systems and methods for placing electronic advertisements
US13/612,621 Abandoned US20130046617A1 (en) 1999-11-08 2012-09-12 Ad placement
US13/612,631 Expired - Lifetime US10217128B2 (en) 1999-11-08 2012-09-12 Ad placement
US13/612,625 Expired - Lifetime US10204356B2 (en) 1999-11-08 2012-09-12 Ad placement
US13/620,899 Expired - Lifetime US10229428B2 (en) 1999-11-08 2012-09-15 Ad placement

Family Applications After (7)

Application Number Title Priority Date Filing Date
US13/620,902 Abandoned US20130046627A1 (en) 1999-11-08 2012-09-15 Ad placement
US13/693,000 Abandoned US20130097026A1 (en) 1999-11-08 2012-12-03 Ad placement
US13/705,056 Expired - Lifetime US10217129B2 (en) 1999-11-08 2012-12-04 Ad placement
US13/705,059 Abandoned US20130097010A1 (en) 1999-11-08 2012-12-04 Ad placement
US13/705,028 Abandoned US20130097019A1 (en) 1999-11-08 2012-12-04 Filtering placement of advertisements
US13/705,066 Abandoned US20130097012A1 (en) 1999-11-08 2012-12-04 Ad placement
US16/241,366 Abandoned US20190139084A1 (en) 1999-11-08 2019-01-07 Ad placement

Country Status (1)

Country Link
US (14) US7822636B1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100257053A1 (en) * 1999-11-08 2010-10-07 Aol Advertising Inc. Systems and methods for placing electronic advertisements
US9380332B1 (en) * 2013-05-21 2016-06-28 Amazon Technologies, Inc. Video advertisement caching
US10360574B2 (en) * 2014-12-28 2019-07-23 Nice Ltd. Systems and methods for response rate determination and offer selection
US11062351B1 (en) 2007-11-15 2021-07-13 Verizon Media Inc. Systems and methods for allocating electronic advertising opportunities

Families Citing this family (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10839321B2 (en) 1997-01-06 2020-11-17 Jeffrey Eder Automated data storage system
US7478089B2 (en) * 2003-10-29 2009-01-13 Kontera Technologies, Inc. System and method for real-time web page context analysis for the real-time insertion of textual markup objects and dynamic content
US6965683B2 (en) * 2000-12-21 2005-11-15 Digimarc Corporation Routing networks for use with watermark systems
US20160162931A1 (en) * 2001-09-06 2016-06-09 Georges Harik Methods and apparatus for ordering advertisements based on performance information
US9967633B1 (en) 2001-12-14 2018-05-08 At&T Intellectual Property I, L.P. System and method for utilizing television viewing patterns
US20050021397A1 (en) * 2003-07-22 2005-01-27 Cui Yingwei Claire Content-targeted advertising using collected user behavior data
US20050038700A1 (en) * 2003-08-12 2005-02-17 Doemling Marcus Frank System and method for creating modular advertisements
US7904337B2 (en) 2004-10-19 2011-03-08 Steve Morsa Match engine marketing
EP1846884A4 (en) * 2005-01-14 2010-02-17 Tremor Media Llc Dynamic advertisement system and method
US9065727B1 (en) 2012-08-31 2015-06-23 Google Inc. Device identifier similarity models derived from online event signals
WO2007056451A2 (en) * 2005-11-07 2007-05-18 Scanscout, Inc. Techniques for rendering advertisments with rich media
CA2631859A1 (en) * 2005-12-08 2007-12-13 Mybuys, Inc. Apparatus and method for providing a marketing service
US8504575B2 (en) * 2006-03-29 2013-08-06 Yahoo! Inc. Behavioral targeting system
US20100138451A1 (en) * 2006-04-03 2010-06-03 Assaf Henkin Techniques for facilitating on-line contextual analysis and advertising
EP2054789A4 (en) 2006-04-03 2013-01-16 Kontera Technologies Inc Contextual advertising techniques implemented at mobile devices
WO2007147080A1 (en) 2006-06-16 2007-12-21 Almondnet, Inc. Media properties selection method and system based on expected profit from profile-based ad delivery
US20080109391A1 (en) * 2006-11-07 2008-05-08 Scanscout, Inc. Classifying content based on mood
US20080195475A1 (en) * 2007-02-08 2008-08-14 Matthew Cody Lambert Advertiser portal interface
US20080228581A1 (en) * 2007-03-13 2008-09-18 Tadashi Yonezaki Method and System for a Natural Transition Between Advertisements Associated with Rich Media Content
US20080228576A1 (en) * 2007-03-13 2008-09-18 Scanscout, Inc. Ad performance optimization for rich media content
US20090055200A1 (en) * 2007-08-20 2009-02-26 Yahoo! Inc. Identifying and validating factors that have particular effects on user behavior
US8549550B2 (en) 2008-09-17 2013-10-01 Tubemogul, Inc. Method and apparatus for passively monitoring online video viewing and viewer behavior
US8577996B2 (en) 2007-09-18 2013-11-05 Tremor Video, Inc. Method and apparatus for tracing users of online video web sites
US20090259552A1 (en) * 2008-04-11 2009-10-15 Tremor Media, Inc. System and method for providing advertisements from multiple ad servers using a failover mechanism
KR101493748B1 (en) * 2008-06-16 2015-03-02 삼성전자주식회사 Apparatus for providing product, display apparatus and method for providing GUI using the same
US9612995B2 (en) 2008-09-17 2017-04-04 Adobe Systems Incorporated Video viewer targeting based on preference similarity
US8533041B2 (en) * 2008-09-29 2013-09-10 Hewlett-Packard Development Company, L.P. Risk-and-return based advertisement selection and scheduling
US20100114696A1 (en) * 2008-10-31 2010-05-06 Yahoo! Inc. Method of programmed allocation of advertising opportunities for conformance with goals
US8175950B1 (en) 2008-12-08 2012-05-08 Aol Advertising Inc. Systems and methods for determining bids for placing advertisements
US8799080B2 (en) * 2009-06-22 2014-08-05 Digitalscirocco, Inc. Dynamic webpage generation including request-time auctioned web content
EP2275984A1 (en) * 2009-07-17 2011-01-19 Axel Springer Digital TV Guide GmbH Automatic information selection based on involvement classification
EP2502195A2 (en) 2009-11-20 2012-09-26 Tadashi Yonezaki Methods and apparatus for optimizing advertisement allocation
US8504419B2 (en) * 2010-05-28 2013-08-06 Apple Inc. Network-based targeted content delivery based on queue adjustment factors calculated using the weighted combination of overall rank, context, and covariance scores for an invitational content item
US20120078730A1 (en) * 2010-09-29 2012-03-29 Viswanathan Ramaiyer Automatic Internet Search Advertising Campaign Variable Optimization for Aiding Advertising Agency Efficiencies
WO2012075600A1 (en) * 2010-12-06 2012-06-14 Yahoo! Inc. System and method for list ranking and ads placement using interaction features
US20120158520A1 (en) * 2010-12-16 2012-06-21 Qualcomm Incorporated Context aware advertisement delivery
US8954536B2 (en) * 2010-12-20 2015-02-10 The Nielsen Company (Us), Llc Methods and apparatus to determine media impressions using distributed demographic information
US9679306B2 (en) * 2011-11-11 2017-06-13 Excalibur Ip, Llc Live advertisement preview display and distribution
US9146993B1 (en) * 2012-03-16 2015-09-29 Google, Inc. Content keyword identification
US9053185B1 (en) 2012-04-30 2015-06-09 Google Inc. Generating a representative model for a plurality of models identified by similar feature data
US8527526B1 (en) 2012-05-02 2013-09-03 Google Inc. Selecting a list of network user identifiers based on long-term and short-term history data
US8914500B1 (en) 2012-05-21 2014-12-16 Google Inc. Creating a classifier model to determine whether a network user should be added to a list
US20130325603A1 (en) * 2012-06-01 2013-12-05 Google Inc. Providing online content
US8886575B1 (en) 2012-06-27 2014-11-11 Google Inc. Selecting an algorithm for identifying similar user identifiers based on predicted click-through-rate
US8874589B1 (en) 2012-07-16 2014-10-28 Google Inc. Adjust similar users identification based on performance feedback
US8782197B1 (en) 2012-07-17 2014-07-15 Google, Inc. Determining a model refresh rate
US8886799B1 (en) 2012-08-29 2014-11-11 Google Inc. Identifying a similar user identifier
US9721263B2 (en) * 2012-10-26 2017-08-01 Nbcuniversal Media, Llc Continuously evolving symmetrical object profiles for online advertisement targeting
US20150066631A1 (en) * 2012-11-28 2015-03-05 Google Inc. Scalably calculating statistics associated with action performances
CN104143148A (en) * 2013-05-07 2014-11-12 苏州精易会信息技术有限公司 Advertisement setting method applied to management software system
CN104239369A (en) * 2013-06-24 2014-12-24 腾讯科技(深圳)有限公司 Method, device and system for filtering out webpage advertisements
US10325285B1 (en) 2013-06-28 2019-06-18 Groupon, Inc. Predictive recommendation system
US10902459B2 (en) * 2013-12-31 2021-01-26 Salesforce.Com, Inc. Facilitating smart advertising on curated content-based networking websites in an on-demand services environment
US10540680B2 (en) * 2014-06-27 2020-01-21 Rakuten, Inc. Information processing device, information processing method, and information processing program
US10650325B2 (en) * 2015-07-31 2020-05-12 Microsoft Technology Licensing, Llc Deterministic message distribution
MA42846A (en) 2015-09-18 2018-07-25 Mms Usa Holdings Inc UNIVERSAL IDENTIFICATION
US20190279236A1 (en) * 2015-09-18 2019-09-12 Mms Usa Holdings Inc. Micro-moment analysis
CN105243559A (en) * 2015-09-21 2016-01-13 上海银天下科技有限公司 Customer distribution method and device
US20170098169A1 (en) * 2015-10-02 2017-04-06 Linkedin Corporation Probabilistic message distribution
US20170236107A1 (en) * 2016-02-11 2017-08-17 Mastercard International Incorporated Automated Teller Machine and Related Method
US10692014B2 (en) * 2016-06-27 2020-06-23 Microsoft Technology Licensing, Llc Active user message diet
CN107977859A (en) * 2017-11-14 2018-05-01 广州优视网络科技有限公司 Advertisement placement method, device, computing device and storage medium
CN108261766A (en) * 2018-01-18 2018-07-10 珠海金山网络游戏科技有限公司 Game Method of Commodity Recommendation and device based on preference
CN108667010B (en) * 2018-05-04 2019-08-16 清华大学 A kind of power distribution network economic load dispatching method based on distribution robust optimization
CN111381909B (en) * 2018-12-27 2022-03-04 北京字节跳动网络技术有限公司 Page display method and device, terminal equipment and storage medium
US11562401B2 (en) 2019-06-27 2023-01-24 Walmart Apollo, Llc Methods and apparatus for automatically providing digital advertisements
US11763349B2 (en) 2019-06-27 2023-09-19 Walmart Apollo, Llc Methods and apparatus for automatically providing digital advertisements
JP7311345B2 (en) * 2019-07-26 2023-07-19 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Database generation method, database generation device, database generation program, data analysis method, data analysis device and data analysis program
US11455656B2 (en) 2019-11-18 2022-09-27 Walmart Apollo, Llc Methods and apparatus for electronically providing item advertisement recommendations
US11392984B2 (en) 2019-11-20 2022-07-19 Walmart Apollo, Llc Methods and apparatus for automatically providing item advertisement recommendations
US11250480B1 (en) * 2020-07-30 2022-02-15 Roku, Inc. Replacement advertisement selection after channel changes
US11620410B1 (en) 2020-09-09 2023-04-04 Meta Platforms, Inc. Digital content management using sentiment driven and privacy prioritization adjustability
JP7042982B1 (en) * 2020-12-16 2022-03-28 株式会社日立製作所 Target selection system, target selection method, and target selection program

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5918014A (en) * 1995-12-27 1999-06-29 Athenium, L.L.C. Automated collaborative filtering in world wide web advertising
US6327574B1 (en) * 1998-07-07 2001-12-04 Encirq Corporation Hierarchical models of consumer attributes for targeting content in a privacy-preserving manner

Family Cites Families (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3370578A (en) * 1966-01-04 1968-02-27 Calvin L. Spelts Fuel saving device for internal combustion engines
US6850252B1 (en) * 1999-10-05 2005-02-01 Steven M. Hoffberg Intelligent electronic appliance system and method
US5636346A (en) * 1994-05-09 1997-06-03 The Electronic Address, Inc. Method and system for selectively targeting advertisements and programming
US5724521A (en) * 1994-11-03 1998-03-03 Intel Corporation Method and apparatus for providing electronic advertisements to end users in a consumer best-fit pricing manner
US6026368A (en) 1995-07-17 2000-02-15 24/7 Media, Inc. On-line interactive system and method for providing content and advertising information to a targeted set of viewers
US5848396A (en) * 1996-04-26 1998-12-08 Freedom Of Information, Inc. Method and apparatus for determining behavioral profile of a computer user
US5930762A (en) 1996-09-24 1999-07-27 Rco Software Limited Computer aided risk management in multiple-parameter physical systems
US5948061A (en) * 1996-10-29 1999-09-07 Double Click, Inc. Method of delivery, targeting, and measuring advertising over networks
US6138142A (en) * 1996-12-20 2000-10-24 Intel Corporation Method for providing customized Web information based on attributes of the requester
US6285987B1 (en) * 1997-01-22 2001-09-04 Engage, Inc. Internet advertising system
US6012051A (en) * 1997-02-06 2000-01-04 America Online, Inc. Consumer profiling system with analytic decision processor
US6144944A (en) 1997-04-24 2000-11-07 Imgis, Inc. Computer system for efficiently selecting and providing information
AU8072798A (en) 1997-06-16 1999-01-04 Doubleclick Inc. Method and apparatus for automatic placement of advertising
US6085229A (en) * 1998-05-14 2000-07-04 Belarc, Inc. System and method for providing client side personalization of content of web pages and the like
US6119098A (en) * 1997-10-14 2000-09-12 Patrice D. Guyot System and method for targeting and distributing advertisements over a distributed network
US6009410A (en) * 1997-10-16 1999-12-28 At&T Corporation Method and system for presenting customized advertising to a user on the world wide web
US6925441B1 (en) * 1997-10-27 2005-08-02 Marketswitch Corp. System and method of targeted marketing
US20010014868A1 (en) 1997-12-05 2001-08-16 Frederick Herz System for the automatic determination of customized prices and promotions
US6647257B2 (en) * 1998-01-21 2003-11-11 Leap Wireless International, Inc. System and method for providing targeted messages based on wireless mobile location
US6285985B1 (en) * 1998-04-03 2001-09-04 Preview Systems, Inc. Advertising-subsidized and advertising-enabled software
US6006197A (en) * 1998-04-20 1999-12-21 Straightup Software, Inc. System and method for assessing effectiveness of internet marketing campaign
JP4064060B2 (en) * 1998-05-15 2008-03-19 ユニキャスト・コミュニケーションズ・コーポレイション Technology for implementing network-distributed interstitial web advertisements that are initiated by the browser and invisible to the user using ad tags embedded in reference web pages
US6317782B1 (en) * 1998-05-15 2001-11-13 International Business Machines Corporation Method and apparatus for detecting actual viewing of electronic advertisements and transmitting the detected information
US6236975B1 (en) * 1998-09-29 2001-05-22 Ignite Sales, Inc. System and method for profiling customers for targeted marketing
US20030083931A1 (en) 1998-10-21 2003-05-01 Crane Associates Inc Method of localized network marketing
US6487538B1 (en) 1998-11-16 2002-11-26 Sun Microsystems, Inc. Method and apparatus for local advertising
US6442529B1 (en) * 1998-11-17 2002-08-27 Novaweb Technologies, Inc. Methods and apparatus for delivering targeted information and advertising over the internet
JP3389948B2 (en) * 1998-11-27 2003-03-24 日本電気株式会社 Display ad selection system
US7150030B1 (en) 1998-12-03 2006-12-12 Prime Research Alliance, Inc. Subscriber characterization system
US6560578B2 (en) * 1999-03-12 2003-05-06 Expanse Networks, Inc. Advertisement selection system supporting discretionary target market characteristics
US6216129B1 (en) * 1998-12-03 2001-04-10 Expanse Networks, Inc. Advertisement selection system supporting discretionary target market characteristics
US6907566B1 (en) * 1999-04-02 2005-06-14 Overture Services, Inc. Method and system for optimum placement of advertisements on a webpage
US6963850B1 (en) 1999-04-09 2005-11-08 Amazon.Com, Inc. Computer services for assisting users in locating and evaluating items in an electronic catalog based on actions performed by members of specific user communities
US6161127A (en) * 1999-06-17 2000-12-12 Americomusa Internet advertising with controlled and timed display of ad content from browser
US7010497B1 (en) * 1999-07-08 2006-03-07 Dynamiclogic, Inc. System and method for evaluating and/or monitoring effectiveness of on-line advertising
US6470079B1 (en) * 1999-07-09 2002-10-22 Who's Calling, Inc. System and method for real-time reporting of advertising effectiveness
US6567786B1 (en) 1999-09-16 2003-05-20 International Business Machines Corporation System and method for increasing the effectiveness of customer contact strategies
US6453347B1 (en) * 1999-10-29 2002-09-17 Mcafee.Com, Inc. Active marketing based on client computer configurations
US6230199B1 (en) * 1999-10-29 2001-05-08 Mcafee.Com, Inc. Active marketing based on client computer configurations
US7822636B1 (en) 1999-11-08 2010-10-26 Aol Advertising, Inc. Optimal internet ad placement
US6477509B1 (en) * 2000-01-06 2002-11-05 Efunz.Com Internet marketing method and system
US6477575B1 (en) * 2000-09-12 2002-11-05 Capital One Financial Corporation System and method for performing dynamic Web marketing and advertising
KR20030001315A (en) * 2001-06-25 2003-01-06 후지 샤신 필름 가부시기가이샤 Master carrier for magnetic transfer
US20070027751A1 (en) 2005-07-29 2007-02-01 Chad Carson Positioning advertisements on the bases of expected revenue

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5918014A (en) * 1995-12-27 1999-06-29 Athenium, L.L.C. Automated collaborative filtering in world wide web advertising
US6327574B1 (en) * 1998-07-07 2001-12-04 Encirq Corporation Hierarchical models of consumer attributes for targeting content in a privacy-preserving manner

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Mayfield, Philip "Understandinh Binomial Confidence Intervals", 04/15/1999, SigmaZone.com p.1-5 http://www.sigmazone.com/binomial_confidence_interval.htm retrieved on 02/11/2016 *
Pollard, David, "Chapter 8: Poisson approximations", 10/19/1997, http://www.stat.yale.edu/~pollard/Courses/241.fall97/Poisson.pdf pages 1-2. *
The Binomial Distribution, 09/16/1997, Yale University, http://www.stat.yale.edu/Courses/1997-98/101/binom.htm Page 3 of 4 retrieved on 5/2/2017 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100257053A1 (en) * 1999-11-08 2010-10-07 Aol Advertising Inc. Systems and methods for placing electronic advertisements
US9754282B2 (en) 1999-11-08 2017-09-05 Facebook, Inc. Systems and methods for placing electronic advertisements
US11062351B1 (en) 2007-11-15 2021-07-13 Verizon Media Inc. Systems and methods for allocating electronic advertising opportunities
US9380332B1 (en) * 2013-05-21 2016-06-28 Amazon Technologies, Inc. Video advertisement caching
US10360574B2 (en) * 2014-12-28 2019-07-23 Nice Ltd. Systems and methods for response rate determination and offer selection

Also Published As

Publication number Publication date
US7822636B1 (en) 2010-10-26
US10229428B2 (en) 2019-03-12
US20130097030A1 (en) 2013-04-18
US10204356B2 (en) 2019-02-12
US20130097012A1 (en) 2013-04-18
US20130046630A1 (en) 2013-02-21
US20190139084A1 (en) 2019-05-09
US20130046627A1 (en) 2013-02-21
US20130046617A1 (en) 2013-02-21
US20130054352A1 (en) 2013-02-28
US9754282B2 (en) 2017-09-05
US10217129B2 (en) 2019-02-26
US20130097026A1 (en) 2013-04-18
US10217128B2 (en) 2019-02-26
US20130054347A1 (en) 2013-02-28
US20130097019A1 (en) 2013-04-18
US20100257053A1 (en) 2010-10-07
US20130097010A1 (en) 2013-04-18

Similar Documents

Publication Publication Date Title
US20190139084A1 (en) Ad placement
US8521588B2 (en) Method for optimum placement of advertisements on a web page
US20060026064A1 (en) Platform for advertising data integration and aggregation
US20060026062A1 (en) System and method for optimizing advertising marketplace operations
US20090327083A1 (en) Automating on-line advertisement placement optimization
US20090327028A1 (en) Systems and Methods for Utilizing Assist Data to Optimize Digital Ads
US20090327030A1 (en) Systems and Methods for Creating an Index to Measure a Performance of Digital Ads as Defined by an Advertiser
US20090327029A1 (en) Systems and Methods for Utilizing Normalized Impressions To Optimize Digital Ads
US20140229282A1 (en) Use of natural query events to improve online advertising campaigns

Legal Events

Date Code Title Description
AS Assignment

Owner name: AOL ADVERTISING INC., MARYLAND

Free format text: CHANGE OF NAME;ASSIGNOR:PLATFORM-A INC.;REEL/FRAME:029825/0754

Effective date: 20090924

Owner name: PLATFORM-A, INC., MARYLAND

Free format text: CHANGE OF NAME;ASSIGNOR:ADVERTISING.COM, INC.;REEL/FRAME:029825/0737

Effective date: 20080429

Owner name: ADVERTISING.COM, INC., MARYLAND

Free format text: CHANGE OF NAME;ASSIGNORS:FERBER, JOHN B.;FERBER, SCOTT;KRETSINGER, STEIN E.;AND OTHERS;SIGNING DATES FROM 20001116 TO 20001130;REEL/FRAME:029825/0427

Owner name: FACEBOOK, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AOL ADVERTISING INC.;REEL/FRAME:029825/0484

Effective date: 20120614

STCV Information on status: appeal procedure

Free format text: ON APPEAL -- AWAITING DECISION BY THE BOARD OF APPEALS

STCV Information on status: appeal procedure

Free format text: BOARD OF APPEALS DECISION RENDERED

STCV Information on status: appeal procedure

Free format text: BOARD OF APPEALS DECISION RENDERED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION

AS Assignment

Owner name: META PLATFORMS, INC., CALIFORNIA

Free format text: CHANGE OF NAME;ASSIGNOR:FACEBOOK, INC.;REEL/FRAME:058961/0436

Effective date: 20211028