Experimental ESRL/GSD Model Verification for Global/Regional Model/Assimilation Development
Presentation
(Fall 2011) on GSD/EMB's verification.
ESRL/GSD MATS (Model Analysis Tool Suite) verification home page
WARNING: The following links are considered legacy applications and are no longer supported by GSD.
For the most accurate and up-to-date information, please utilize the Model Analysis Tool Suite (MATS) in the link above
Upper-air verification
Raob verification
(For research and operational global/regional models, global/N.Amer RAOB data)
- Interactive time-series plots ... (beta version)
- Interactive vertical profiles ... (beta version)
- Pre-generated time-series and vertical profiles for some models
- Find Model-RAOB Residuals ... (beta version)
- EXPERIMENTAL for beta use Raob verif (time series or profile) using MATS (Model Assessment Tool Suite: new web interface for EMB verification) . Known issues
- Sept. 2011 presentation describing EMB RAOB verification.
- RAP/HRRR verif from EMC (Ben Blake) for last 2 weeks for upper-air, precip, surface, C/V
Raob verification
(For operational models only - for N.America only)
NCEP statistics based on isobaric files, verified against
quality-controlled RAOBs (mandatory levels at and above 850 mb)
Aircraft verification
Statistics based on AMDAR data. Available
every hour but highly non-uniform in space
and time.
Global model - grid verification - Anomaly correlation statistics for FIM and GFS.
-
GFS vs. FIM - last 31 days -
5-day
6-day
7-day
GFS vs. FIM - last 90 days - 5-day 6-day 7-day Dynamic Jquery Version (not working) - Interactive time-series plots (New dieoff plot option included)... (beta version)
- NCEP GFS stats, including anomaly correlation for latest 31 days
- NCEP GFS stats for previous months
- NCEP GFS vs. FIM for grid verification and obs verification
Cloud verification
Ceiling
hourly statistics verified against METAR
data.
- Interactive time-series plots ... (beta version)
- Based on 5-min METAR data: 15 minute time-series plots
- Plan-view plots for specific times
Visibility statistics verified against METAR data.
- Hourly Interactive time-series plots ... (beta version)
- 15-min Time-series plots from 5-min METARS ... (beta version)
- Plan-view plots for specific times (not working just now)
Cloud and Solar Insolation verification against GSIP, SURFRAD/ISIS, and METARS.
- Cloud verification statistics against GSIP (time series) ... (beta version) (not working just now)
- Cloud verification statistics against GSIP (diurnal) ... (beta version) (not working just now)
- Plan-view plots of GSIP and HRRR insolation and clouds for specific times (beta) (not working just now)
- Plan-view plots of Solar Insolation data from surface stations (beta) (not working just now)
- SURFRAD/ISIS stations (OLD) ... (beta) (No HRRR model any more)
- SURFRAD/ISIS stations (v3) ... (beta) (With 15-min average DSWRF and direct from the sub-hourly HRRR)
Surface verification
Surface statistics. METAR stations verifying against
regional and global forecasts. Experimental
- Hourly Time Series statistics for various models ... (beta version)
- Statistics by land-use (experimental)
- EXPERIMENTAL for beta use Surface verif (time series) using MATS (Model Assessment Tool Suite: new web interface for EMB verification) . Known issues
- US/Alaska plots of model-station differences for individual times or over 1-week period
- MADIS surface stations (METARs and mesonets)
- (Restricted to GSD: Individual station and network statistics)
- METAR-Model Plan-view plots for specific times
Precipitation verification
Precipitation Statistics
- Mesonet-based Interactive time-series plots ... (beta version)
- 1min METAR-based Interactive time-series plots ... (beta version)
- Interactive time-series and diurnal plots ... (beta version)
- Joint precipitation frequency statistics (beta)
- Sub-24Hr Time Series statistics for various models, BETA version
- Sub-24Hr Threshold Statistics for various models, BETA version
24HR Precipitation Statistics. (CPC,StageIV) vs. HRRR, RAP, RUC, NAM Experimental
- 24Hr Time Series statistics for various models, BETA version
- 24Hr Threshold Statistics for various models, BETA version
Radar reflectivity verification
Composite Reflectivity Statistics. NSSL vs. HRRR, RAP, RUC, NAM
Experimental
- Hourly Time Series for various models, BETA version
- Valid Time Statistics for various models, BETA version
- Lead Time Statistics for various models, BETA version
- Performance Diagrams for various models, BETA version
Vertically Integrated Liquid (VIL) Statistics. NSSL vs. HRRR, NAM_NEST Experimental
- Hourly Time Series for various models, BETA version
- Valid Time Statistics for various models, BETA version
- Lead Time Statistics for various models, BETA version
- Performance Diagrams for various models, BETA version
Echo Top Height Statistics. NSSL vs. HRRR, NAM_NEST Experimental
- Hourly Time Series for various models, BETA version
- Valid Time Statistics for various models, BETA version
- Lead Time Statistics for various models, BETA version
- Performance Diagrams for various models, BETA version
Convective Probability Statistics. NCWD vs. HCPF, RCPF, CCFP, LLProb Experimental
- Hourly Time Series statistics for various models, BETA version
- CSI vs Bias Figures for various models, BETA version
- Relative Operating Characteristic (ROC) Curves for various models, BETA version
- Reliability Diagrams for various models, BETA version