Query & validation
How do we ask and check?
- tension
- Open world against closed world: a missing fact is unknown, or it is false.
- also
- Access, Querying, Constraints
- scheme
- design issues
Threads (2)
Long-running problems under this issue, told step by step. All threads.
-
Unknown or false?
1978–2026
largely settled
8 steps
When a fact is missing, is it unknown or false, and how do you check data in a world that assumes it is merely unknown?
-
Querying a web, not a database
2008–2025
open
7 steps
Can you query data spread across thousands of independent servers as if it were one database?
Who answered it
This issue's row of the map: which traditions' works mainly answer it, and the earliest from each.
| tradition | works | earliest |
|---|---|---|
| Hypertext | ||
| Knowledge representation | 2 | On Closed World Data Bases 1978 |
| Databases | 3 | On Closed World Data Bases 1978 |
| Machine learning | 4 | GraphRAG 2024 |
| Web standards | 8 | SPARQL 2008 |
| Search | 3 | GraphQL 2015 |
| Social web | ||
| Open knowledge | ||
| Decentralized web | ||
| Libraries, archives and museums | ||
| Life sciences | ||
| Media | ||
| Geospatial | 1 | GeoSPARQL 2012 |
| Commerce and supply chain | ||
| Government and law | ||
| Finance | ||
| Industry and engineering |
6 of 17 traditions have taken up this question as a work's main issue; a work in several traditions counts in each. Same counts as the full map.
Timeline
Works on this question, its main or a secondary one, each shown once in date order; filter by tradition to follow one community. Bars run from start to end where both are known; marks people, projects and organizations still active. 6 entries have no date and are not shown. Hover over or focus an entry to draw its links. Scroll sideways, or use the decades above.
Lineage (18)
Works whose main question this is, by type, oldest first.
Concepts 3
-
GraphRAG
2024
concept
technique
Retrieval-augmented generation in which a language model answers from a knowledge graph built over the source texts, rather than from isolated text chunks.
-
Open-world assumption
concept
principle
The rule that a fact missing from the data is unknown, not false. RDF and OWL assume it, unlike most databases.
-
Retrieval-augmented generation
concept
technique
Technique in which a language model first retrieves relevant documents or data and then generates its answer from them.
Writings 6
-
On Closed World Data Bases
1978
writing
★ seminal
formalism
Raymond Reiter's 1978 paper formalizing the closed-world assumption: a database may treat any fact it cannot show to be true as false.
-
Semantics and Complexity of SPARQL
2009
writing
★ seminal
formalism
Paper by Pérez, Arenas and Gutiérrez giving SPARQL a compositional formal semantics and proving the complexity of evaluating it; general SPARQL patterns are PSPACE-complete.
-
Report of the W3C RDF Validation Workshop
2013
writing
debate
Report of a W3C workshop held in Cambridge, Massachusetts in September 2013. Participants found no standard for checking RDF data against constraints, and a majority backed a working group to define one.
-
Shape Expressions: An RDF Validation and Transformation Language
2014
writing
technique
SEMANTiCS 2014 paper introducing Shape Expressions (ShEx), a structural schema language that describes the shape RDF data should have and checks data against it.
-
Google Dataset Search: Building a search engine for datasets in an open Web ecosystem
2019
writing
2019 paper by Brickley, Burgess and Noy describing how Google Dataset Search finds datasets through their schema.org descriptions.
-
From Local to Global: A Graph RAG Approach to Query-Focused Summarization
2024
writing
technique
Microsoft Research paper by Darren Edge and nine co-authors introducing the GraphRAG method.
Standards 8
-
SPARQL
2008
standard
★ seminal
Query language for RDF data, a W3C Recommendation since January 2008; SPARQL 1.1 followed in 2013.
-
GeoSPARQL
2012
standard
★ seminal
OGC standard, version 1.0 from 2012 and 1.1 from January 2024, that adds a vocabulary for geometries to RDF and spatial functions and relations to SPARQL, so queries can ask what is within, near or touching what.
-
SPARQL 1.1
2013
standard
Second version of SPARQL, adding updates, aggregates, subqueries and federated queries; a W3C Recommendation since March 2013.
-
GraphQL
2015
standard
Query language for web APIs developed at Facebook from 2012 and published in 2015; it lets a client ask for exactly the JSON it needs, and became the common choice where Linked Data APIs were not adopted.
-
SHACL
2017
standard
★ seminal
W3C language for validating RDF data against shapes, closer to schema checking than to OWL's open-world reasoning; a Recommendation since July 2017.
-
GQL
2024
standard
ISO standard query language for property graphs, published in April 2024 and partly derived from Neo4j's Cypher; the property-graph counterpart to SPARQL.
-
Model Context Protocol
2024
standard
Open protocol introduced by Anthropic in November 2024 for connecting AI models to external tools and data sources; donated to the Linux Foundation's Agentic AI Foundation in December 2025.
-
SHACL 1.2
2025
standard
Revision of SHACL by the W3C Data Shapes Working Group, in drafts since March 2025, adding modules for node expressions, rules, user interfaces, profiling and, from September 2026, inference rules that derive new triples from existing ones.
Projects 1
-
Google Dataset Search
2018
project
Search engine for datasets that indexes schema.org Dataset descriptions published on the Web.
Also bears on this (13)
Concepts 4
-
Relational model
1969
concept
formalism
Model of data as relations, that is tables of rows with named columns, queried by declarative operations on whole sets; proposed by E.F. Codd and the basis of SQL databases.
-
Description logic
concept
formalism
Family of decidable logics for describing concepts and their relations; the formal basis of OWL.
-
Entailment and inference
concept
formalism
Deriving facts that follow from stated ones plus a schema or ontology, for example that a member of a subclass is also a member of its superclass.
-
Triplestore
concept
technique
Database built to store RDF triples and answer SPARQL queries; Virtuoso is one example.
Writings 6
-
Semantic MediaWiki
2006
writing
2006 conference paper by Krötzsch, Vrandečić and Völkel introducing Semantic MediaWiki.
-
Executing SPARQL Queries over the Web of Linked Data
2009
writing
technique
ISWC 2009 paper by Hartig, Bizer and Freytag proposing link-traversal querying: a SPARQL query is answered by following links and looking up URIs as it runs, so the data sources need not be known in advance.
-
SPARQL Web-Querying Infrastructure: Ready for Action?
2013
writing
★ seminal
ISWC 2013 paper that monitored hundreds of public SPARQL endpoints and found many of them often unavailable, slow, or limited in what they would answer: evidence that free public query services were hard to keep running.
-
Triple Pattern Fragments: A Low-cost Knowledge Graph Interface for the Web
2016
writing
★ seminal
technique
2016 Journal of Web Semantics paper proposing Triple Pattern Fragments: servers answer only simple triple patterns and clients do the rest of the query, trading some speed for servers that are cheap to run and stay up.
-
Knowledge Graphs
2021
writing
★ seminal
Survey by Aidan Hogan and 17 co-authors of the data models, query languages, reasoning and methods behind knowledge graphs.
-
SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questions
2024
writing
technique
2024 paper by Liu, Semnani, Triedman, Xu, Zhao and Lam with a dataset of real questions from Wikidata's 'Request a Query' forum, where users ask others to write SPARQL for them, and a language-model agent that writes such queries the way an expert would.
Standards 1
-
Lexicon
standard
AT Protocol's schema language for records, API endpoints and event streams. Each schema is a JSON file named by a reverse-DNS identifier (NSID); it resembles JSON Schema and OpenAPI rather than RDF vocabularies.
Projects 2
-
Virtuoso
1998
project
OpenLink Software's database server for SQL and RDF data, used to publish DBpedia and many other Linked Data sets.
-
Semantic MediaWiki
2005
project
Extension to MediaWiki that lets wiki pages carry typed, queryable data annotations.
People and organizations (28)
Linked to works on this question; the number counts those works.
World Wide Web Consortium (5) · Andy Seaborne (2) · Eric Prud'hommeaux (2) · Natasha Noy (2) · Anthropic · Claudio Gutiérrez · Dan Brickley · Darren Edge · David Soria Parra · Dimitris Kontokostas · Google · Harold Solbrig · Holger Knublauch · ISO · John Herring · Jorge Pérez · José Emilio Labra Gayo · Justin Spahr-Summers · Krzysztof Janowicz · Marcelo Arenas · Matthew Burgess · Matthew Perry · Meta Platforms · Open Geospatial Consortium · Raymond Reiter · Simon Cox · Steve Harris · Timo Homburg