Machine learning
Learning from data instead of encoding knowledge by hand; since the 2020s, chiefly large neural language models.
- also
- Neural AI, Statistical AI
- scheme
- traditions
Where it answered
This tradition's column of the issues map: which questions its works mainly answer, and the earliest of each.
| issue | works | earliest |
|---|---|---|
| Technical 15 works · 79% | ||
| Identification | ||
| Linking | ||
| Data model | ||
| Serialization | ||
| Reasoning | 10 | The Unreasonable Effectiveness of Data 2009 |
| Query & validation | 4 | GraphRAG 2024 |
| Scale & performance | 1 | Big data |
| Bridge 1 work · 5% | ||
| Vocabulary | 1 | WordNet 1985 |
| Human 3 works · 16% | ||
| Topology | ||
| Trust | ||
| Governance | 2 | Towards Making Systems Forget with Machine Unlearning 2015 |
| Adoption & incentives | ||
| Sustainability | ||
| Usability | 1 | SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questions 2024 |
Shares works with Knowledge representation (4) · Search (3) · Databases (1) · Open knowledge (1) · Web standards (1)
Counts use each work's main design issue, as on the full map; 19 works in all.
Timeline
Everything from this tradition, in lanes by type. Bars run from start to end where both are known; marks people, projects and organizations still active. 41 entries have no date and are not shown. Hover over or focus an entry to draw its links. Scroll sideways, or use the decades above.
Entries (59)
Concepts 6
-
GraphRAG
2024
concept
technique
Retrieval-augmented generation in which a language model answers from a knowledge graph built over the source texts, rather than from isolated text chunks.
-
CC signals
2025
concept
principle
Framework proposed by Creative Commons in June 2025 for dataset holders to state, in machine-readable form, how they want their content reused by AI systems; partly legal and partly a social expectation.
-
Big data
concept
Data too large, fast-moving or varied for ordinary databases, and the methods for drawing value from it by analysis at scale; the term spread around 2010 as companies mined logs, clicks and sensor data.
-
Large language model
concept
technique
Neural language model trained on very large text collections; since the early 2020s the main way software works with unstructured text.
-
Neuro-symbolic AI
concept
technique
AI that combines neural networks with symbolic knowledge such as rules and knowledge graphs; it drew new attention in the 2020s as a way to ground large language models.
-
Retrieval-augmented generation
concept
technique
Technique in which a language model first retrieves relevant documents or data and then generates its answer from them.
Writings 12
-
The Unreasonable Effectiveness of Data
2009
writing
★ seminal
debate
Halevy, Norvig and Pereira's 2009 essay arguing that simple models trained on very large amounts of web data beat elaborate hand-built models, and that meaning is better learned from use at scale than specified in advance.
-
ImageNet Classification with Deep Convolutional Neural Networks
2012
writing
★ seminal
technique
2012 NIPS paper by Alex Krizhevsky, Ilya Sutskever and Geoffrey Hinton whose deep network, trained on GPUs, won the ImageNet image-recognition contest by a wide margin and turned machine learning toward deep learning.
-
Translating Embeddings for Modeling Multi-relational Data
2013
writing
★ seminal
technique
2013 NIPS paper introducing TransE, which represents each entity in a knowledge graph as a vector and each relation as a translation between vectors, so that missing facts can be predicted; the starting point of knowledge-graph embeddings.
-
Efficient Estimation of Word Representations in Vector Space
2013
writing
★ seminal
technique
2013 paper by Tomas Mikolov, Kai Chen, Greg Corrado and Jeffrey Dean introducing word2vec: vectors learned from which words occur together, in which relations such as king to queen show up as directions.
-
Knowledge Vault: A Web-Scale Approach to Probabilistic Knowledge Fusion
2014
writing
2014 KDD paper by Xin Luna Dong and eight Google colleagues describing a knowledge base built by machine: facts extracted from text, tables and page structure across the Web, combined with existing knowledge bases and given probabilities of being true.
-
Towards Making Systems Forget with Machine Unlearning
2015
writing
2015 IEEE Symposium on Security and Privacy paper by Yinzhi Cao and Junfeng Yang that named machine unlearning: removing the effect of particular training data from a learned model without retraining it from scratch.
-
Attention Is All You Need
2017
writing
★ seminal
technique
2017 paper by Ashish Vaswani and seven Google colleagues introducing the transformer, a network built on attention that became the basis of large language models.
-
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
2018
writing
technique
2018 paper by Jacob Devlin, Ming-Wei Chang, Kenton Lee and Kristina Toutanova: a transformer pre-trained on large amounts of text that set new results on many language tasks; Google applied it to Search in 2019.
-
Unifying Large Language Models and Knowledge Graphs: A Roadmap
2023
writing
vision
Survey proposing three ways to combine language models and knowledge graphs: KG-enhanced LLMs, LLM-augmented KGs, and the two working together.
-
From Local to Global: A Graph RAG Approach to Query-Focused Summarization
2024
writing
technique
Microsoft Research paper by Darren Edge and nine co-authors introducing the GraphRAG method.
-
SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questions
2024
writing
technique
2024 paper by Liu, Semnani, Triedman, Xu, Zhao and Lam with a dataset of real questions from Wikidata's 'Request a Query' forum, where users ask others to write SPARQL for them, and a language-model agent that writes such queries the way an expert would.
-
W3C and the State of the Web in the AI Era
2026
writing
vision
October 2026 paper by the W3C Strategy Team, prepared by Philippe Le Hégaret, on how the Web's standards must change as AI agents act for users: agents prefer text and structured data to HTML, JSON-LD, RDF, DCAT and ODRL become more valuable as inputs and guardrails for agents, and Verifiable Credentials and DIDs can identify agents and whom they act for.
Standards 1
-
Model Context Protocol
2024
standard
Open protocol introduced by Anthropic in November 2024 for connecting AI models to external tools and data sources; donated to the Linux Foundation's Agentic AI Foundation in December 2025.
Projects 1
-
WordNet
1985
project
★ seminal
Lexical database of English begun in 1985 at Princeton's Cognitive Science Laboratory under George A. Miller: nouns, verbs and adjectives grouped into sets of synonyms linked by relations such as broader and part-of. It became a shared vocabulary for language processing and for knowledge bases such as YAGO.
Organizations 2
-
Anthropic
2021
organization
American AI company that introduced the Model Context Protocol in 2024.
-
Allen Institute for Artificial Intelligence
organization
Research institute founded by Paul Allen; its first grant helped fund Wikidata's initial development in 2012.
People 37
-
Peter Norvig
b. 1956
person
American computer scientist, director of research at Google and co-author of 'Artificial Intelligence: A Modern Approach'.
-
Alberto García-Durán
person
Machine-learning researcher, co-author of the TransE paper (2013).
-
Alex Krizhevsky
person
Machine learning researcher, first author of the 2012 AlexNet paper.
-
Antoine Bordes
person
Machine-learning researcher, lead author of the TransE paper (2013).
-
Ashish Vaswani
person
Machine learning researcher, first author of 'Attention Is All You Need'.
-
Chen Chen
person
Co-author of 'Unifying Large Language Models and Knowledge Graphs: A Roadmap' (2023).
-
Darren Edge
person
Microsoft Research scientist and lead author of the 2024 GraphRAG paper.
-
David Soria Parra
person
Anthropic engineer who co-created the Model Context Protocol.
-
Fernando Pereira
person
Computer scientist in natural-language processing, research director at Google; co-author of 'The Unreasonable Effectiveness of Data' (2009).
-
Geoffrey Hinton
person
British-Canadian computer scientist whose work on neural networks underlies deep learning; co-author of AlexNet.
-
Greg Corrado
person
Google machine learning scientist, co-author of the 2013 word2vec paper.
-
Harold Triedman
person
Co-author of the SPINACH paper (2024) on question answering over Wikidata.
-
Ilya Sutskever
person
AI researcher, co-author of AlexNet and later a co-founder of OpenAI.
-
Isaac Dan Zhao
person
Co-author of the SPINACH paper (2024) on question answering over Wikidata.
-
Jacob Devlin
person
Researcher at Google, first author of BERT.
-
Jason Weston
person
Machine-learning researcher, co-author of the TransE paper (2013).
-
Jeff Dean
person
American computer scientist at Google who co-designed MapReduce and co-wrote word2vec.
-
Jialiang Xu
person
Co-author of the SPINACH paper (2024) on question answering over Wikidata.
-
Jiapu Wang
person
Co-author of 'Unifying Large Language Models and Knowledge Graphs: A Roadmap' (2023).
-
Junfeng Yang
person
Columbia University computer scientist, co-author of the 2015 paper that named machine unlearning.
-
Justin Spahr-Summers
person
Anthropic engineer who co-created the Model Context Protocol.
-
Kai Chen
person
Google engineer, co-author of the 2013 word2vec paper.
-
Kenton Lee
person
Natural language processing researcher at Google, co-author of BERT.
-
Kristina Toutanova
person
Natural language processing researcher at Google, co-author of BERT.
-
Linhao Luo
person
Co-author of 'Unifying Large Language Models and Knowledge Graphs: A Roadmap' (2023).
-
Ming-Wei Chang
person
Researcher at Google, co-author of BERT.
-
Monica S. Lam
person
American computer scientist at Stanford, known for compilers and later for conversational agents grounded in knowledge bases; co-author of the SPINACH paper (2024).
-
Nicolas Usunier
person
Machine-learning researcher, co-author of the TransE paper (2013).
-
Oksana Yakhnenko
person
Machine-learning researcher at Google, co-author of the TransE paper (2013).
-
Shicheng Liu
person
Stanford researcher and lead author of the SPINACH paper (2024) on language models writing SPARQL for Wikidata.
-
Shirui Pan
person
Co-author of 'Unifying Large Language Models and Knowledge Graphs: A Roadmap' (2023).
-
Sina J. Semnani
person
Stanford researcher and co-author of the SPINACH paper (2024).
-
Tomáš Mikolov
person
Czech computer scientist who led the word2vec work at Google.
-
Xin Luna Dong
person
Chinese-American computer scientist who led Google's Knowledge Vault and later Amazon's product knowledge graph.
-
Xindong Wu
person
Co-author of 'Unifying Large Language Models and Knowledge Graphs: A Roadmap' (2023).
-
Yinzhi Cao
person
Computer security researcher, first author of the 2015 paper that named machine unlearning.
-
Yufei Wang
person
Co-author of 'Unifying Large Language Models and Knowledge Graphs: A Roadmap' (2023).