# Accurate summarisation of threats for conservation evidence literature

*2024-01-01 — idea*


At the [Conservation Evidence Copilots](https://anil.recoil.org/projects/ce) project, we are interested in constructing a taxonomy of threats
to wildlife from the literature. This involves scanning the body of
conservation literature and gathering/synthesising evidence for conservation
interventions from a threats perspective. Once the text has been retrieved, it
needs to be summarised in a way that is accurate, concise and relevant and
verified with human experts. This is particularly important for conservation
evidence, where the key findings need to be communicated clearly to inform
policy and practice.

This project therefore investigates how to generate threats, and to verify
their accuracy as generated by LLMs and RAG pipelines from the CE literature.
Our goal is to develop a pipeline that can reliably go from extracting relevant
information from text to a summary that is verifiably (by a human) correct.

As of June 2025, the project has been successfully completed and submitted
for Kittson's MPhil. A test version of the [avian threats dataset](https://climateinaction-production.up.railway.app/)
is online for browsing, and we're spending the summer working on widening the evaluation with the wider CE team.

## Related Reading

- The [Ragas framework](https://docs.ragas.io/en/stable/index.html) for RAG evaluation
- [CheckEmbed: Effective Verification of LLM Solutions to Open Ended Tasks](https://arxiv.org/abs/2406.02524v2), arxiv:2406.02524v2, June 2024
- [Calibrating Sequence Likelihood Improves Conditional Language Generation](https://arxiv.org/abs/2210.00045), arxiv:2210.00045, September 2000
Status: Ongoing
Level: MPhil
Year: 2024
Project: Conservation Evidence Copilots
Supervisors: Anil Madhavapeddy, Sadiq Jaffer
Students: Kittson Hamill

## Related

- [EEG internships for the summer of 2025](https://anil.recoil.org/notes/eeg-interns-2025) (note, 2025-06-28)
- [Conservation Evidence Copilots](https://anil.recoil.org/projects/ce) (project, 2024-01-01)

---
Canonical: https://anil.recoil.org/ideas/accurate-summarisation-for-ce
Type: idea
Tags: conservation, evidence, llms, threats, hunting, biodiversity, ai