# Crawling grey literature for conservation evidence *2024-01-01 — idea* Status: Completed Level: Any Year: 2024 Project: Conservation Evidence Copilots Supervisors: Anil Madhavapeddy, Sadiq Jaffer Students: Shrey Biswas, Kacper Michalik At the [Conservation Evidence Copilots](https://anil.recoil.org/projects/ce) project, we are interested in finding and synthesising evidence for conservation interventions. Much of this evidence is published in academic journals, but there is a large body of [grey literature](https://en.wikipedia.org/wiki/Grey_literature) that is not indexed in academic databases. This includes reports from NGOs, government agencies, and other organisations that are not peer-reviewed, but can still contain valuable information. This project involved developing a web crawler to search for grey literature on conservation interventions, tracking the provenance and license information, and extracting relevant information from these documents. The goal is to make this information more accessible to researchers and practitioners in the field of conservation. **Status:** Paper in preparation, contact me for more details about followups. ## Related - [Publish, Review, Curate to upend scholarly publishing](https://anil.recoil.org/notes/coar-prc) (note, 2025-12-08) Report from a COAR conference on transforming scholarly publishing through the Publish, Review, Curate model, discussing diamond open access, early career challenges, and expanding open infrastructure to datasets and code. - [Royal Society's Future of Scientific Publishing meeting](https://anil.recoil.org/notes/rs-future-of-publishing) (note, 2025-07-14) Live notes from Royal Society conference on scientific publishing challenges including peer review crisis, AI poisoning threats and open access economics. - [What I learnt at the National Academy of Sciences US-UK Forum on Biodiversity](https://anil.recoil.org/notes/nas-rs-biodiversity) (note, 2025-06-06) Report from NAS/Royal Society forum on standardized biodiversity measurement technologies covering foundation models, eDNA and evidence synthesis. - [Thoughts on the National Data Library and private research data](https://anil.recoil.org/notes/uk-national-data-lib) (note, 2025-02-17) Exploring the National Data Library and its potential to improve access to private research data while balancing security and privacy concerns. - [Conservation Evidence Copilots](https://anil.recoil.org/projects/ce) (project, 2024-01-01) --- Canonical: https://anil.recoil.org/ideas/grey-lit-crawl Type: idea License: CC BY 4.0 Tags: web, distributed, conservation, llms, evidence, conservation