Research and benchmarks

WeatherNext models are rigorously evaluated against the European Centre for Medium-Range Weather Forecasts (ECMWF) operational systems, including HRES (deterministic) and ENS (probabilistic). Performance is measured using RMSE, CRPS, Anomaly Correlation Coefficient, and Relative Economic Value across multiple variables, pressure levels, and lead times. For standardized comparison, we use WeatherBench 2, a benchmark developed by Google Research and ECMWF for assessing data-driven global weather models.

WeatherNext 3

WeatherNext 3 is evaluated against both ECMWF operational systems and WeatherNext 2. Key evaluation highlights include:

Performance and resolution comparisons

Evaluation against high-resolution observational datasets demonstrates significant gains in precision and localized feature representation.

Surface temperature resolution (0.25° versus 0.05°)

WeatherNext 3 delivers 5× higher core spatial resolution (0.05° / ~5 km) for surface temperature and dew point, resolving fine topographic features, valleys, and coastlines compared to WeatherNext 2's 0.25° grid.

Surface temperature resolution comparison between WeatherNext 2 (0.25°) and WeatherNext 3 (0.05°)

Precipitation accuracy versus observational radar (MRMS QPE)

By training directly against multiple observational targets including NASA IMERG and radar reanalysis, WeatherNext 3 accurately captures sharp, localized precipitation bands that numerical weather prediction baselines and earlier AI models miss or blur.

Precipitation prediction comparison between WeatherNext 2, WeatherNext 3, and MRMS radar observations

Independent live evaluation (Brightband)

According to independent live evaluations by Brightband on their Operational WeatherBench (OWB), WeatherNext 3 is the most advanced and accurate global weather model to date. Brightband provides continuous, independent tracking and verification of operational AI and numerical weather prediction systems under real-time conditions.

WeatherNext 2

WeatherNext 2 (FGN) demonstrates further advancement over WeatherNext Gen, with around 10-20% improvement across variables, forecast horizons, and levels. It generates a full 64-member ensemble in a single forward pass, 8× faster than GenCast's iterative diffusion. WeatherNext 2 was also extended for operational tropical cyclone forecasting, improving track and intensity predictions by a full day compared to existing methods.

WeatherNext Gen

WeatherNext Gen (GenCast) is a probabilistic diffusion model that outperformed ECMWF's ENS in over 96% of targets. The model excels at generating large ensembles to characterize predictive uncertainty, providing a 6-12 hour lead time advantage for tropical cyclone tracking over ENS.

WeatherNext Graph

WeatherNext Graph (GraphCast) is a deterministic GNN model that outperformed ECMWF's HRES in over 90% of tested cases and variables, showing particular skill in predicting tropical cyclones, atmospheric rivers, and extreme temperatures. Named a runner-up to Science's Breakthrough of the Year in 2023. Won the MacRobert Award in 2024.

Other research

While WeatherNext focuses on medium-range forecasting, Google also invests in complementary models:

  • MetNet: Short-range, high-resolution precipitation nowcasting (0-12 hours). The latest model expands nowcasting globally using geostationary satellite data, enabling support in data-sparse regions.
  • NeuralGCM: ML-powered General Circulation Model for long-range global weather simulations, enabling large forecast ensembles for long-range uncertainty at a fraction of conventional physics-based computational cost.