Hand-built meaning or learned meaning
Do machines get meaning from knowledge people write down, or from patterns in large amounts of data?
- issue
- reasoning
also vocabulary - status
- open
- steps
- 11, 1959–2024
- threads
- all problem threads
Logic-based AI began with the idea that a program could act on facts and rules people state, and Cyc spent decades writing common sense down by hand. The Semantic Web set out to put such machine-readable meaning on the Web itself. Critics argued that logic fails on messy data and that statistics over web-scale data works better. Google's Knowledge Graph combined curated facts with statistical search, and language models now build knowledge graphs themselves.
Lineage
-
1959
Programs with Common Sense
The 'advice taker': a program that decides what to do by deducing it from facts and rules stated in formal logic. [src]
- 1984
- 1985
-
Sep 1998
Semantic Web Road Map
Leaving aside the AI problem of training machines to behave like people, the Semantic Web will develop languages for expressing information in machine-processable form, toward a Web in which machine reasoning is ubiquitous. [src]
-
7 Nov 2003
The Semantic Web, Syllogism, and Worldview↳ critiques Semantic Web (proposed by Semantic Web Road Map)
Calls the Semantic Web a machine for creating syllogisms, which do not work on slippery, partial or context-dependent data. Because metadata describes a worldview, any attempt at a global ontology is doomed. [src]
-
Mar 2009
The Unreasonable Effectiveness of Data↳ critiques Semantic Web (proposed by Semantic Web Road Map)
Simple models trained on very large amounts of web data beat elaborate hand-built ones. Hand annotation is slow, expensive and hard for experts to agree on, while useful semantic relationships can be learned from data such as search queries. [src1][src2]
-
16 May 2012
Introducing the Knowledge Graph: things, not strings
'Things, not strings': Google's Knowledge Graph launches with more than 500 million objects and 3.5 billion facts drawn from Freebase, Wikipedia and the CIA World Factbook, used inside a statistical search engine. [src]
-
16 Jan 2013
Efficient Estimation of Word Representations in Vector Space
Meaning learned from which words occur together: word vectors in which relations such as king to queen appear as directions, with no one writing the relations down. [src]
-
Aug 2014
Knowledge Vault: A Web-Scale Approach to Probabilistic Knowledge Fusion
A knowledge base built by machine: facts extracted across the Web and combined with existing knowledge bases, each with a probability of being true, rather than curated by people. [src]
-
12 Jun 2017
Attention Is All You Need
The transformer, built on attention, becomes the architecture of the large language models that learn language, and much of what it says about the world, from text alone. [src]
-
24 Apr 2024
From Local to Global: A Graph RAG Approach to Query-Focused Summarization
A language model derives an entity knowledge graph from source documents, then summarizes groups of related entities to answer questions about the whole collection. The graph is learned, not hand-built. [src]
Recent signals
Open now
Under each question, the answers people have put forward or built. The catalogue gives no odds on them.
- Can knowledge graphs built by language models be trusted without people checking them?
[src1][src2]
GraphRAG and similar methods have a model write the graph; the 2023 roadmap lists LLM-built graphs as one of three ways to combine the two.
- Graphs extracted by language models are used without people checking them. GraphRAG
GraphRAG builds a knowledge graph from source texts with a language model and answers questions from it directly.[src]
- Models draft knowledge and people or curated graphs check it. Unifying Large Language Models and Knowledge Graphs: A Roadmap
The 2023 roadmap proposes 'LLM-augmented knowledge graphs', in which models help build and complete graphs, alongside graphs that ground models.[src]
- Graphs extracted by language models are used without people checking them. GraphRAG
- Is hand-written knowledge still worth its cost when statistical methods keep improving?
[src1][src2]
Cyc's knowledge base took decades of hand axiom-writing; the 2009 essay argued that data at scale does better.
- Curated knowledge becomes the grounding that models are checked against. Wikidata
Wikidata's embedding project makes its hand-curated statements available to AI systems for fact-checking and source attribution.[src]
- General statistical methods keep overtaking hand-built knowledge.
Richard Sutton's 'bitter lesson' (2019): over 70 years of AI research, general methods that scale with computation have beaten methods that build in human knowledge.[src]
- Curated knowledge becomes the grounding that models are checked against. Wikidata
Forces
Pressures that push this problem one way or another, as their sources argue them. All forces
- General methods that scale keep winning
Favours statistical learning over hand-written knowledge as computation grows cheaper.[src]
- Language models need knowledge to check against
Brings knowledge graphs back as a partner to statistical models rather than a rival.[src1][src2]
How to contribute
-
Conference on Neurosymbolic Learning and Reasoning (NeSy)
conference
Annual meeting on combining neural learning with symbolic knowledge and reasoning; the 20th ran in Lisbon in September 2026. [src1][src2]
checked 21 Oct 2026 -
GraphRAG
repository
· GraphRAG
Open-source implementation of graph-based retrieval-augmented generation, in which a language model builds the knowledge graph it then retrieves from. [src1][src2]
checked 21 Oct 2026