2 Quotes by Hinrich Schütze

Here the query A320 returns algorithmic search results about the Airbus aircraft, together with advertisements for various non-aircraft goods numbered A320 that advertisers seek to market to those querying on this query. The lack of advertisements for the aircraft reflects the fact that few marketers attempt to sell A320 aircraft on the web.

A human is not a device that reliably reports a gold standard judgment of relevance of a document to a query.