# Improving local weather forecasts using Tessera embeddings *2026-08-13 — note* [Pedro Sousa](https://www.linkedin.com/in/pedro-marques-sousa) has put his [first preprint paper](https://arxiv.org/pdf/2608.12271v1) online, on the topic of improving weather prediction using satellite foundation models! **"[Earth observation embeddings are effective sub-grid descriptors for probabilistic weather downscaling](https://anil.recoil.org/papers/2026-weather-downscaling)"** (also [on arXiv](https://arxiv.org/abs/2608.12271)) was joint work with [Sadiq Jaffer](https://toao.com), [Robin Young](https://www.cst.cam.ac.uk/people/ray25), [Will Tebbutt](https://willtebbutt.github.io/) and [Rich Turner](https://rich-turner-group.github.io/) with much help from the wider Tessera team. Since the paper is quite machine learning heavy I wrote up a splainer here. I had to get rapidly up to speed on how weather forecasting works when we started working on this at the [start](https://anil.recoil.org/ideas/tessera-weather-downscaling) of the year\! ## How weather downscaling works today Weather forecasts and the "[reanalysis](https://climatedata.ca/resource/a-quick-guide-to-reanalysis-datasets)" datasets that reconstruct the past atmosphere (such as [ERA5](https://en.wikipedia.org/wiki/ERA5)), are usually plotted on grids of ~25km. Each grid cell tracks the temperature, wind, precipitation, etc within it, but on a patch bigger than (e.g.) Cambridge and its surrounding villages. This big area often sees wide variance within it. For example, an [urban heat island](https://en.wikipedia.org/wiki/Urban_heat_island) can be 1–3°C hotter than agricultural fields around it, and on calm clear nights a valley floor could be 4–8°C colder than a slope a little higher up. Wind also accelerates as it funnels through gaps in terrain, but [slows over forest canopy](https://doi.org/10.1016/B978-0-12-818813-2.00002-2) and buildings. It's important to be able to do finer-grained forecasting to account for these variations; we're all finding that the difference between [\+-4C is huge](https://www.theguardian.com/environment/2026/aug/13/uk-records-hottest-day-of-the-year-fifth-summer-heatwave-peak) thus summer. The standard way to "[downscale](https://en.wikipedia.org/wiki/Downscaling)" weather forecasts from large grids to smaller areas is to train a statistical model against real weather station observations, and use it predict the value at a finer point. This requires the 25km coarse grid and also some facts about the specific point in the grid. The SOTA for doing this probabilistically at any coordinate is the technique used in [Aardvark](https://www.nature.com/articles/s41586-025-08897-0). Each location is assigned a hand-crafted terrain descriptor containing the the elevation, how much that elevation differs from the model's smoothed-out terrain, and an index index saying whether it's a valley or a ridge (i.e. the shape of the ground).
## Replacing hand-crafted descriptors with TESSERA However, terrain is only one reason why a prediction in a particular spot might depart from its 25km cell average. Land cover, forest, water, soil, and (especially) an urban built environment all matter too\! So, we tried replacing the handcrafted features with a rich representation that has already learned to describe the planet's entire land surface. Our [TESSERA](https://anil.recoil.org/projects/tessera) [foundation model](https://anil.recoil.org/papers/2026-tessera-v2) has been pretrained on millions of optical and radar satellite images and supplies a 128-dimensional embedding for every 10m pixel on Earth. Since a single 10m Tessera pixel is too small to describe what a weather station observes, we compress a ~640m neighbourhood of them down into 16 dimensions using an [autoencoder](https://en.wikipedia.org/wiki/Variational_autoencoder), and use these to downscale instead of the handcrafted descriptors. At first glance, it's a little weird that this works at all. Tessera summarises a whole year of surface behaviour, while the weather model predicts instantaneous temperature and wind. However, the ways that a 25km cell might depart from its linear average temperature or wind is actually pretty consistently tied to its persistent properties (e.g. a valley floor pools cold air every calm night, or a forest canopy always drags on the wind). Therefore, an annualised summary of the planet's surface turns out to work very well\! ## Improving both temperature and wind predictions Across five climatically diverse regions spanning over 9,000 stations, adding Tessera improved every metric for temperature and wind at stations (and years) the model had never seen. The probabilistic skill improved by ~11.5% for 2m temperature and ~6.2% for 10m wind speed. Interestingly, temperature and wind predictions benefit differently, though...
### Temperature predictions improve where data is sparse For temperature, Tessera acts as a transferable prior where stations are scarce. Elevation already explains most of temperature's fine structure (e.g. air cools predictably as you go up). In the very densely observed Europe and USA, the baseline learnt its corrections from topography and the plentiful stations. However, in sparse regions the baseline actually did worse than simply interpolating ERA5. Adding Tessera reverses that trend in East Asia and Australia, and nearly closes the gap in southern Africa. The fewer stations a region has, the bigger the uplift in predictive capacity with Tessera added into the mix.
2m temperature over Norway, downscaled from a 25km grid to a dense 5km map. Both model variants recover similar fine detail.
2m temperature over Norway, downscaled from a 25km grid to a dense 5km map. Both model variants recover similar fine detail.
### Wind has far more terrain texture with Tessera For wind, Tessera supplies information that the handcrafted terrain descriptors just don't have. When rendered as dense maps, the embedding-equipped model resolves 3–4x more fine-scale structure for wind. That extra texture also matches the errors that the baseline makes at real stations. Locations at the same elevation can still differ enormously in exposure, roughness and land cover.
10m wind speed over the same region. The TESSERA variant (right) resolves substantially more fine-scale structure than the terrain-only model (middle), which also corresponds to real station-level error reductions.
10m wind speed over the same region. The TESSERA variant (right) resolves substantially more fine-scale structure than the terrain-only model (middle), which also corresponds to real station-level error reductions.
## Does this hold up for real weather forecasts? Now, downscaling reanalysis is a somewhat academic exercise as what we actually need to downscale is an actual weather forecast. We therefore swapped the ERA5 input for predictions from Microsoft's [Aurora](https://doi.org/10.1038/s41586-025-09005-y) AI weather model. The TESSERA advantage persists out to 72 hours ahead, as the below graphs show! It's pretty cool that one foundation model (Aurora) supplies the atmospheric model, while another (Tessera) supplies the surface that the weather lands on, and that the *combined pair of models* beats either alone.
TESSERA's improvement over the terrain-only baseline (blue) and over plain interpolation (black) holds steady across Aurora forecast lead times.
TESSERA's improvement over the terrain-only baseline (blue) and over plain interpolation (black) holds steady across Aurora forecast lead times.
### Doing cold starts with no weather stations We also simulate deploying a brand-new station network in Norway, starting from zero local observations. For wind, the TESSERA model is 16.7% better than ERA5 interpolation before a single Norwegian station ever comes online. Meanwhile, the terrain-only baseline needs about a year of local weather data to pull ahead of it. After six years and 1500 deployed stations later, the baseline *still* hasn't caught up with the accuracy the Tessera-equipped one achieved on day zero. Given that most of the world outside of Europe and the USA does not have a dense, decades-old station network, getting good local predictions with just Tessera has important implications for the majority world.
The simulated Norwegian network rollout shows mean absolute error as stations come online, for temperature (top) and wind (bottom). For wind, the Tessera model (blue) at zero deployed stations beats the baseline (grey) even after six years of accumulated local data.
The simulated Norwegian network rollout shows mean absolute error as stations come online, for temperature (top) and wind (bottom). For wind, the Tessera model (blue) at zero deployed stations beats the baseline (grey) even after six years of accumulated local data.
Several caveats apply, of course. Our preprint only covers instantaneous temperature and wind, and we're planning precipitation next. The embedding is also a static 2017 snapshot, so changing land cover or urban growth are not yet represented. Time-indexed embeddings are an obvious extension as well. Please do check out [the project page](https://anil.recoil.org/ideas/tessera-weather-downscaling) and get in touch with [Pedro Sousa](https://www.linkedin.com/in/pedro-marques-sousa) or me if you have a downscaling problem of your own\! Synopsis: New paper showing that a frozen TESSERA embedding improves probabilistic weather downscaling, improving local temperature and wind predictions at never-observed sites. Words: 1168 ## Related - [Earth observation embeddings are effective sub-grid descriptors for probabilistic weather downscaling](https://anil.recoil.org/papers/2026-weather-downscaling) (paper, 2026-08-01) - [TESSERA v2: Scaling Pixel-wise Earth Foundation Models](https://anil.recoil.org/papers/2026-tessera-v2) (paper, 2026-07-01) - [Earth embeddings for probabilistic weather downscaling](https://anil.recoil.org/ideas/tessera-weather-downscaling) (idea, 2026-01-01) - [TESSERA, a pixelwise geospatial foundation model](https://anil.recoil.org/projects/tessera) (project, 2025-01-01) --- Canonical: https://anil.recoil.org/notes/weather-downscaling-tessera Type: note Tags: tessera, climate, ai, spatial