AgentFAIR uses AI agents to audit geospatial data

On July 17, 2026, researchers Ming Chen and Pranav Pai introduced AgentFAIR, an AI-agent system meant to assess whether a geospatial dataset follows the FAIR principles: that it is findable, accessible, interoperable and reusable. The work is a preprint, so its findings are an early evaluation rather than a final certification of data quality.

FAIR is not algorithmic fairness

In this context, FAIR does not mean bias or fairness in an algorithm. It stands for Findable, Accessible, Interoperable and Reusable: qualities that help scientific data be discovered, understood by machines, combined with other sources and used again. Geospatial data make that task harder. A title and a licence are not enough; coordinate reference systems, spatial and temporal coverage, file formats and access services can all determine whether a dataset is actually usable.

The authors start from a practical problem. Existing automated checkers often disagree because they use different rules, evidence sources and scoring schemes. In a diagnostic study of 50 datasets from ten repositories, the standard deviation across normalized tool scores averaged 15 percentage points and reached 30.3 points for one dataset. That does not establish which tool is most accurate. It shows why a single score can conceal incompatible criteria.

Thirteen reviewers, plus a critic

AgentFAIR combines conventional metadata extraction with language models. It first loads a dataset landing page, including pages where some information is rendered with JavaScript, and gathers signals from HTML, JSON-LD, RDF/XML, DataCite and other formats. It then divides the assessment among 13 specialised agents, one for each FAIR sub-principle. Each agent gives a maturity score from 0 to 3, points to the evidence behind it and suggests an improvement.

Its distinguishing component is a critic agent. It does not judge a dataset on intuition: it checks whether evidence supports the score and whether separate conclusions conflict. When evidence is missing or confidence is low, it can request a targeted re-evaluation. The system produces a readable report, a JSON assessment, a SQLite evidence store and local traces, so a recommendation can be inspected rather than accepted as a black box.

What the study found — and what it does not prove

Across the sample, the paper reports average scores of 79.7% for findability, 70.4% for accessibility, 45.3% for interoperability and 72.0% for reusability. Interoperability was the weakest area: publishing a file is not enough if its metadata and conventions cannot communicate with other systems. In a repeatedly tested subset of ten datasets, sub-principle agreement was 89% with the critic and 71% when it was removed. The authors also report an API cost of about $0.054 per dataset.

Those are encouraging findings, but the paper states important limits. It covers only 50 datasets, comparisons with baseline tools are not a measure of accuracy, and validation used a single model family. Its expert review covered 15 datasets and reported 82% alignment, a useful signal but still a small basis for claims of broad generalisation.

The useful part is being able to discuss the score

The most interesting contribution is not another AI-generated overall grade. It is the prospect of turning a tedious audit into a checkable conversation: a licence is not expressed in a reusable form, a persistent identifier is missing, or a coordinate reference system is absent from a recognised standard. For people maintaining environmental, urban or climate datasets, that level of detail makes it possible to fix the specific issue.

The code is published under the AGPL-3.0 licence, and the repository notes that it does not include raw benchmark results or a comprehensive test suite. Its local service is also not designed to be exposed directly to the public internet. AgentFAIR does not replace expert review. Its more modest proposition is that agents can surface the evidence an expert needs to decide whether data are genuinely ready for reuse.