Who pays for public data infrastructure?
Who pays to keep shared identifiers, query services and knowledge bases running after the launch money is spent?
- issue
- sustainability
also governance, scale & performance - status
- open
- steps
- 9, 1995–2025
- threads
- all problem threads
Shared identifiers, query services and knowledge bases are cheap to launch and expensive to keep running. PURL ran at OCLC for twenty years before moving to the Internet Archive; Freebase closed when Google withdrew; many public SPARQL endpoints were often down, which prompted cheaper interfaces. Wikidata, run by a donor-funded foundation, is the main survivor, and even its query service had to split its graph to stay up.
Lineage
- 1995
-
Dec 2006
Understanding Knowledge as a Commons: From Theory to Practice
Hess and Ostrom apply research on shared natural resources to knowledge: a commons lasts only if a community sets rules that keep it from being depleted or enclosed. [src]
- Mar 2007
- 29 Oct 2012
-
Oct 2013
SPARQL Web-Querying Infrastructure: Ready for Action?
Monitoring of hundreds of public SPARQL endpoints finds many of them often unavailable, slow, or limited in what they will answer. [src]
-
Mar 2016
Triple Pattern Fragments: A Low-cost Knowledge Graph Interface for the Web↳ responds to SPARQL Web-Querying Infrastructure: Ready for Action?
Since full query endpoints are expensive to host at high availability, servers should answer only simple triple patterns and let clients do the rest of the work. Queries are slower but servers stay up. [src1][src2]
-
11 Apr 2016
From Freebase to Wikidata: The Great Migration
Google announced in 2014 that it would shut Freebase down; it went read-only on 31 March 2015 holding more than 3 billion facts. The paper reports how much of it a community project could take over. [src1][src2]
-
2016
Roads and Bridges: The Unseen Labor Behind Our Digital Infrastructure
Names the general pattern for open-source software: infrastructure everyone depends on, kept running by a few unpaid or underpaid people, with no one responsible for funding it. [src]
-
9 May 2025
Wikidata Query Service
Wikidata's free public query service splits scholarly articles into a separate graph: its Blazegraph backend can no longer keep up with more than 16 billion triples growing by about a billion a year. A move to QLever follows. [src1][src2][src3]
Recent signals
Dated events that show the problem moving, newest last.
- 15 Jan 2026
Five more AI and technology companies pay Wikimedia Enterprise for access to Wikipedia's content.[src]
- 12 Jun 2026
NLnet pauses new NGI Zero calls while EU open-internet funding moves to a new Open Internet Stack programme.[src]
- 17 Oct 2026
The Wikidata Query Service is migrating from the unmaintained Blazegraph to the QLever engine. Wikidata Query Service[src]
Open now
Under each question, the answers people have put forward or built. The catalogue gives no odds on them.
- Who pays to keep a free public query service running as the data behind it keeps growing?
[src1][src2]
Wikidata's query service split its graph in 2025 and is moving to a new backend; the old Blazegraph endpoints may degrade from February 2027.
- Split the data and change the engine underneath. Wikidata Query Service
Wikidata split its graph in 2025 and is moving its query service to QLever.[src]
- Split the data and change the engine underneath. Wikidata Query Service
- How much of a company's knowledge base survives when the company withdraws?
[src]
When Freebase closed, its data had to be mapped into Wikidata's model and reviewed by volunteers: about 360 of Freebase's roughly 37,700 properties were mapped early on.
- The company hands the data to a commons project. From Freebase to Wikidata: The Great Migration
Google closed Freebase and helped move its data into Wikidata.[src]
- The company hands the data to a commons project. From Freebase to Wikidata: The Great Migration
- Who funds the upkeep of open data infrastructure, rather than its launch?
[src1][src2]
Grants usually pay for new work. A few public funds now pay for maintenance of open digital infrastructure.
- Public funds pay for maintenance.
- The largest users pay.
Wikimedia Enterprise charges companies that use Wikipedia's content at scale.[src]
Forces
Pressures that push this problem one way or another, as their sources argue them. All forces
- AI companies harvest what is published openly
Raises hosting costs while lowering the visits that bring donations.[src]
- Running infrastructure costs money and effort
Services that grow with their data, such as Wikidata's query service, need new engines and hardware long after launch money is spent.[src]
- Public money for open internet software
Grants are one of the few sources of money for upkeep rather than launch; when a programme pauses, so do its grants.[src]
Decision points
Dated moments when a decision or a deadline can change the outcome.
- 3 Nov 2026
NLnet funding deadline funding
Next deadline for grant proposals to NLnet's open funds for open internet software.[src]
- Feb 2027
Old Wikidata query endpoints may degrade service
From February 2027 the Blazegraph endpoints stay up but may degrade; users need to move to the new endpoints.[src]
How to contribute
-
Wikidata Query Service backend update
forum
· Wikidata Query Service
Hub for moving the query service from Blazegraph to QLever: early access to the new endpoints, office hours, use-case collection and a Phabricator board. [src]
checked 21 Oct 2026 -
Sovereign Tech Fund
funding
German public fund for open digital base technologies, including maintenance work. Projects apply through its portal; costs must exceed €50,000. [src]
checked 21 Oct 2026 -
NLnet Foundation
funding
Dutch foundation that grants money to open internet technology. Its open funds take proposals at regular deadlines; the next is 3 November 2026. [src]
checked 21 Oct 2026