Search
Web companies that organize the Web's data for their products: search engines above all, and the developer platforms whose formats and APIs others adopt.
- also
- Search engines, Search and platforms, Web companies, Search and industry
- scheme
- traditions
Where it answered
This tradition's column of the issues map: which questions its works mainly answer, and the earliest of each.
| issue | works | earliest |
|---|---|---|
| Technical 18 works · 67% | ||
| Identification | 1 | Google Social Graph API 2008 |
| Linking | ||
| Data model | 7 | Meta Content Framework 1995 |
| Serialization | 2 | RSS 1999 |
| Reasoning | 4 | The Semantic Web, Syllogism, and Worldview 2003 |
| Query & validation | 3 | GraphQL 2015 |
| Scale & performance | 1 | MapReduce: Simplified Data Processing on Large Clusters 2004 |
| Bridge 3 works · 11% | ||
| Vocabulary | 3 | Schema.org 2011 |
| Human 6 works · 22% | ||
| Topology | ||
| Trust | 1 | The Anatomy of a Large-Scale Hypertextual Web Search Engine 1998 |
| Governance | ||
| Adoption & incentives | 3 | Metacrap: Putting the torch to seven straw-men of the meta-utopia 2001 |
| Sustainability | 1 | From Freebase to Wikidata: The Great Migration 2016 |
| Usability | 1 | JSON web APIs |
Shares works with Machine learning (3) · Web standards (3) · Knowledge representation (2) · Social web (2) · Commerce and supply chain (1)
Counts use each work's main design issue, as on the full map; 27 works in all.
Timeline
Everything from this tradition, in lanes by type. Bars run from start to end where both are known; marks people, projects and organizations still active. 23 entries have no date and are not shown. Hover over or focus an entry to draw its links. Scroll sideways, or use the decades above.
Entries (63)
Concepts 3
-
Embedded structured data
concept
technique
Machine-readable data inside ordinary HTML pages, written as microformats, RDFa, microdata or JSON-LD and usually using the schema.org vocabulary.
-
JSON web APIs
concept
technique
Plain JSON over HTTP with each API defining its own fields, without shared vocabularies or global identifiers; the everyday alternative most developers chose over Linked Data.
-
Knowledge graph
concept
formalism
Graph of entities and the relations between them, used to integrate and query data; the term spread after Google's 2012 Knowledge Graph.
Writings 14
-
Meta Content Framework Using XML
1997
writing
★ seminal
1997 submission to the W3C by R.V. Guha and Tim Bray describing MCF in XML; a direct precursor to RDF.
-
The Anatomy of a Large-Scale Hypertextual Web Search Engine
1998
writing
★ seminal
technique
Brin and Page's 1998 paper describing Google and PageRank, which ranks pages by the links pointing to them; it showed that the Web's link structure could serve as a signal of authority, with no metadata needed from publishers.
-
Metacrap: Putting the torch to seven straw-men of the meta-utopia
2001
writing
★ seminal
debate
Cory Doctorow's essay arguing that reliable metadata is unattainable because people lie, are lazy and disagree.
-
The Semantic Web, Syllogism, and Worldview
2003
writing
★ seminal
debate
Clay Shirky's essay arguing that the Semantic Web's reliance on syllogistic logic fails on real-world, context-dependent data.
-
MapReduce: Simplified Data Processing on Large Clusters
2004
writing
★ seminal
2004 OSDI paper by Jeffrey Dean and Sanjay Ghemawat describing how Google split computations over huge datasets across thousands of ordinary machines; it set the pattern for big data processing.
-
Freebase: A Collaboratively Created Graph Database for Structuring Human Knowledge
2008
writing
2008 paper describing Freebase's data model and how its contributors built it.
-
The Unreasonable Effectiveness of Data
2009
writing
★ seminal
debate
Halevy, Norvig and Pereira's 2009 essay arguing that simple models trained on very large amounts of web data beat elaborate hand-built models, and that meaning is better learned from use at scale than specified in advance.
-
Introducing the Knowledge Graph: things, not strings
2012
writing
★ seminal
principle
Google blog post by Amit Singhal announcing the Knowledge Graph, which brought the term into wide use.
-
Knowledge Vault: A Web-Scale Approach to Probabilistic Knowledge Fusion
2014
writing
2014 KDD paper by Xin Luna Dong and eight Google colleagues describing a knowledge base built by machine: facts extracted from text, tables and page structure across the Web, combined with existing knowledge bases and given probabilities of being true.
-
Schema.org: Evolution of Structured Data on the Web
2016
writing
Communications of the ACM article by Guha, Brickley and Macbeth on the history and design of schema.org.
-
From Freebase to Wikidata: The Great Migration
2016
writing
★ seminal
WWW 2016 paper on moving Freebase's data into Wikidata after Google announced in December 2014 that it would close Freebase: what could be carried over, what could not, and why a company's knowledge base did not simply transfer to a community one.
-
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
2018
writing
technique
2018 paper by Jacob Devlin, Ming-Wei Chang, Kenton Lee and Kristina Toutanova: a transformer pre-trained on large amounts of text that set new results on many language tasks; Google applied it to Search in 2019.
-
Google Dataset Search: Building a search engine for datasets in an open Web ecosystem
2019
writing
2019 paper by Brickley, Burgess and Noy describing how Google Dataset Search finds datasets through their schema.org descriptions.
-
Industry-scale Knowledge Graphs: Lessons and Challenges
2019
writing
★ seminal
2019 Communications of the ACM article by engineers from Microsoft, Google, Facebook, eBay and IBM comparing how their companies build and run knowledge graphs, and what remains hard.
Standards 5
-
Meta Content Framework
1995
standard
Format for describing the structure and metadata of websites, developed by R.V. Guha at Apple and later submitted to the W3C with Tim Bray as an XML application.
-
RSS
1999
standard
★ seminal
Family of XML formats for syndicating site updates. Netscape's RSS 0.90 (1999) and RSS 1.0 were RDF-based; RSS 2.0 is plain XML.
-
Schema.org
2011
standard
★ seminal
Shared vocabulary for structured data in web pages, launched in 2011 by Bing, Google and Yahoo, with Yandex joining later that year.
-
GraphQL
2015
standard
Query language for web APIs developed at Facebook from 2012 and published in 2015; it lets a client ask for exactly the JSON it needs, and became the common choice where Linked Data APIs were not adopted.
-
GS1 Web Vocabulary
standard
GS1's terms for products, organisations and locations published as Linked Data and designed as an extension to schema.org.
Projects 5
-
Freebase
2007–2016
project
★ seminal
Collaboratively edited knowledge graph built by Metaweb and bought by Google in 2010. It fed Google's Knowledge Graph, and its data was offered to Wikidata when it closed in 2016.
-
Google Social Graph API
2008–2012
project
Google service launched in February 2008 that crawled XFN, FOAF and other public markup to report who links to whom across the Web; retired in April 2012 for lack of use.
-
Rich Snippets
2009
project
★ seminal
Google search feature announced in May 2009 that shows ratings, prices and other details in results, read from microformats and RDFa in pages.
-
Google Knowledge Graph
2012
project
Google's knowledge base of entities and their relations, launched in 2012 and built partly from Freebase.
-
Google Dataset Search
2018
project
Search engine for datasets that indexes schema.org Dataset descriptions published on the Web.
Organizations 6
-
Microsoft
1975
organization
American software company, where Jean Paoli co-edited XML 1.0, its research lab published GraphRAG in 2024, and R.V. Guha moved from Google that year.
-
Apple
1976
organization
American computer company where HyperCard and the Meta Content Framework were developed.
-
Thinking Machines Corporation
1983
organization
Supercomputer company co-founded by Danny Hillis that built the Connection Machine.
-
Netscape
1994–2003
organization
American web browser company, where RSS 0.90 was created in 1999.
-
Google
1998
organization
American search and technology company that bought Freebase and co-founded schema.org.
-
Metaweb
2005–2010
organization
Company co-founded by Danny Hillis that built Freebase. Google bought it in July 2010.
People 30
-
Tim Bray
b. 1955
person
Canadian software developer who co-edited XML 1.0 and, with R.V. Guha, the 1997 W3C note on expressing MCF in XML.
-
Peter Norvig
b. 1956
person
American computer scientist, director of research at Google and co-author of 'Artificial Intelligence: A Modern Approach'.
-
Danny Hillis
b. 1956
person
American inventor who designed the Connection Machine at Thinking Machines and co-founded Metaweb, which built the Freebase knowledge base.
-
Clay Shirky
b. 1964
person
American writer on the Internet whose 2003 essay argued that the Semantic Web rests on syllogistic logic that does not fit how people describe the world.
-
Veda Hlubinka-Cook
b. 1964
person
American programmer who co-founded Metaweb, the company behind Freebase, with Danny Hillis and John Giannandrea in 2005.
-
John Giannandrea
b. 1965
person
Scottish computer scientist who co-founded Metaweb in 2005; he had worked at Netscape and later worked at Google and Apple.
-
R.V. Guha
b. 1965
person
Indian computer scientist whose work runs from Cyc through Apple's Meta Content Framework and Netscape's RSS to schema.org, which he started at Google.
-
Amit Singhal
b. 1968
person
Head of Google Search who announced the Google Knowledge Graph in 2012 with the post 'things, not strings'.
-
Cory Doctorow
b. 1971
person
Canadian-British writer and activist whose essay 'Metacrap' (2001) argued that people will not supply honest, careful metadata.
-
Larry Page
b. 1973
person
American computer scientist who co-founded Google and devised PageRank.
-
Sergey Brin
b. 1973
person
American computer scientist who co-founded Google and co-wrote the 1998 paper describing it.
-
Alan Patterson
person
Co-author of 'Industry-scale Knowledge Graphs: Lessons and Challenges' (2019).
-
Alon Halevy
person
Israeli-American computer scientist working on data integration; co-author of 'The Unreasonable Effectiveness of Data' (2009).
-
Anant Narayanan
person
Co-author of 'Industry-scale Knowledge Graphs: Lessons and Challenges' (2019).
-
Anshu Jain
person
Co-author of 'Industry-scale Knowledge Graphs: Lessons and Challenges' (2019).
-
Colin Evans
person
Co-author of the 2008 paper describing Freebase.
-
Dan Brickley
person
Technologist who co-created FOAF, co-edited RDF Schema, worked on RDF at the W3C and later on schema.org at Google.
-
Dan Libby
person
Netscape engineer who co-created RSS 0.90 in 1999 and produced the simplified RSS 0.91 later that year.
-
Doug Cutting
person
American software designer who co-created Apache Hadoop, as well as the search libraries Lucene and Nutch.
-
Fernando Pereira
person
Computer scientist in natural-language processing, research director at Google; co-author of 'The Unreasonable Effectiveness of Data' (2009).
-
Jamie Taylor
person
Co-author of the 2008 paper describing Freebase.
-
Kurt Bollacker
person
American computer scientist and lead author of the 2008 paper describing Freebase.
-
Matthew Burgess
person
Co-author of the 2019 paper introducing Google Dataset Search.
-
Natasha Noy
person
Computer scientist who worked on the Protégé ontology editor at Stanford, co-wrote 'Ontology Development 101', and co-wrote the 2019 paper introducing Google Dataset Search.
-
Praveen Paritosh
person
Co-author of the 2008 paper describing Freebase.
-
Sebastian Schaffert
person
Computer scientist at Google, co-author of 'From Freebase to Wikidata: The Great Migration' (2016).
-
Steve Macbeth
person
Computer scientist and co-author, with R.V. Guha and Dan Brickley, of the 2016 history of schema.org.
-
Thomas Steiner
person
Computer scientist at Google, co-author of 'From Freebase to Wikidata: The Great Migration' (2016).
-
Tim Sturge
person
Co-author of the 2008 paper describing Freebase.
-
Yuqing Gao
person
Co-author of 'Industry-scale Knowledge Graphs: Lessons and Challenges' (2019).