Methods for Validating HRRR Simulated Cloud Properties for Different Weather Phenomena Using Satellite and Radar Observations

Traditional pixel-versus-pixel forecast evaluation scores such as the critical success index (CSI) provide a simple way to compare the performances of different forecasts; however, they offer little information on how to improve a particular forecast. This paper strives to demonstrate what additional information an object-based forecast evaluation tool such as the Method for Object-Based Diagnostic Evaluation (MODE) can provide in terms of assessing numerical weather prediction models’ convective storm forecasts. Forecast storm attributes evaluated by MODE in this paper include storm size, intensity, orientation, aspect ratio, complexity, and number of storms. Three weeks of the High Resolution Rapid Refresh (HRRR) model’s precipitation forecasts during the summer of 2010 over the eastern two-thirds of the contiguous United States were evaluated as an example to demonstrate the methodology. It is found that the HRRR model was able to forecast convective storm characteristics rather well either as a function of time of day or as a function of storm size, although significant bias does exist, especially in terms of storm number and storm size. Another interesting finding is that the model’s ability of forecasting new storm initiation varies substantially by regions, probably as a result of its different skills in forecasting convection driven by different forcing mechanisms (i.e., diurnal heating vs synoptic-scale frontal systems).

A technique for model initialization using three-dimensional radar reflectivity data has been developed and applied within the NOAA 13-km Rapid Refresh (RAP) and 3-km High-Resolution Rapid Refresh (HRRR) regional forecast systems. This technique enabled the first assimilation of radar reflectivity data for operational NOAA forecast models, critical especially for more accurate short-range prediction of convective storms. For the RAP, the technique uses a diabatic digital filter initialization (DFI) procedure originally deployed to control initial inertial gravity wave noise. Within the forward-model integration portion of diabatic DFI, temperature tendencies obtained from the model cloud/precipitation processes are replaced by specified latent heating–based temperature tendencies derived from the three-dimensional radar reflectivity data, where available. To further refine initial conditions for the convection-allowing HRRR model, a similar procedure is used in the HRRR, but without DFI. Both of these procedures, together called the “Radar-LHI” (latent heating initialization) technique, have been essential for initialization of ongoing precipitation systems, especially convective systems, within all NOAA operational versions of the 13-km RAP and 3-km HRRR models extending through the latest implementation upgrade at NCEP in 2020. Application of the latent heat–derived temperature tendency induces a vertical circulation with low-level convergence and upper-level divergence in precipitation systems. Retrospective tests of the Radar-LHI technique show significant improvement in short-range (0–6 h) precipitation system forecasts, as revealed by reflectivity verification scores. Results presented document the impact on HRRR reflectivity forecasts of the radar reflectivity initialization technique applied to the RAP alone, HRRR alone, and both the RAP and HRRR. Significance Statement The large forecast uncertainty of convective situations, even at short lead times, coupled with the hazardous weather they produce, makes convective storm prediction one of the most significant short-range forecast challenges confronting the operational numerical weather prediction community. Prediction of heavy precipitation events also requires accurate initialization of precipitation systems. An innovative assimilation technique using radar reflectivity data to initialize NOAA operational weather prediction models is described. This technique, which uses latent heating specified from radar reflectivity (and can accommodate lightning data and other convection/precipitation indicators), was first implemented in 2009 at NOAA/NCEP and continues to be used in 2022 in the NCEP-operational RAP and HRRR models, making it a backbone of the NOAA rapidly updated numerical weather prediction capability.

Strong wind events can cause severe economic loss and societal impacts. Peak winds over Wyoming and Colorado occur during the wintertime months, and in the first part of this two-part series, it was shown that the High-Resolution Rapid Refresh (HRRR) model displays large negative biases with respect to strong wind events. In this part of the study, we address two questions: 1) does increasing the horizontal resolution improve the representation of strong wind events over this region, and 2) are the biases in HRRR-forecasted winds related to the selected planetary boundary layer (PBL), surface layer (SL), and/or land surface model (LSM) parameterizations? We conduct Weather Research and Forecasting (WRF) Model simulations to address these two main questions. Increasing the horizontal resolution leads to a small improvement in the simulation of strong wind speeds over the complex terrain of Wyoming and Colorado. In general, changes in the PBL, SL, and LSM parameterizations show much larger changes in simulated wind speeds compared to increasing the model resolution alone. Specifically, changing from the Mellor–Yamada–Nakanishi–Niino scheme to the Mellor–Yamada–Janjić PBL and SL schemes results in nearly no change in the r2 values, but there is a decrease in the magnitude of the strong wind speed bias (from −12.52 to −10.16 m s−1). We attribute these differences to differences in the diagnosis of surface wind speeds and mixing in the boundary layer. Further analysis is conducted to determine the value of 1-km forecasts of strong winds compared with wind speed diagnostics commonly used by the National Weather Service. Significance Statement Motivated by prior studies showing low skill in the prediction of strong winds using state-of-the-art weather forecast models, in this study, we aim to investigate two questions: 1) does increasing the horizontal resolution improve the prediction of strong wind events over the complex terrain of Wyoming and Colorado, and 2) are the biases in High-Resolution Rapid Refresh (HRRR) forecasted winds related to the selected planetary boundary layer, surface layer, and/or land surface model parameterizations? We find that increasing the horizontal resolution provides a slight improvement in the prediction of strong winds. Further, considerable improvement in the prediction of strong winds is found for varying boundary layer, surface layer, and land surface parameterizations.

The High-Resolution Rapid Refresh (HRRR) is a convection-allowing implementation of the Advanced Research version of the Weather Research and Forecasting (WRF-ARW) Model with hourly data assimilation that covers the conterminous United States and Alaska and runs in real time at the NOAA/National Centers for Environmental Prediction (NCEP). Implemented operationally at NOAA/NCEP in 2014, the HRRR features 3-km horizontal grid spacing and frequent forecasts (hourly for CONUS and 3-hourly for Alaska). HRRR initialization is designed for optimal short-range forecast skill with a particular focus on the evolution of precipitating systems. Key components of the initialization are radar-reflectivity data assimilation, hybrid ensemble-variational assimilation of conventional weather observations, and a cloud analysis to initialize stratiform cloud layers. From this initial state, HRRR forecasts are produced out to 18 h every hour, and out to 48 h every 6 h, with boundary conditions provided by the Rapid Refresh system. Between 2014 and 2020, HRRR development was focused on reducing model bias errors and improving forecast realism and accuracy. Improved representation of the planetary boundary layer, subgrid-scale clouds, and land surface contributed extensively to overall HRRR improvements. The final version of the HRRR (HRRRv4), implemented in late 2020, also features hybrid data assimilation using flow-dependent covariances from a 3-km, 36-member ensemble (“HRRRDAS”) with explicit convective storms. HRRRv4 also includes prediction of wildfire smoke plumes. The HRRR provides a baseline capability for evaluating NOAA’s next-generation Rapid Refresh Forecast System, now under development. Significance Statement NOAA’s operational hourly updating, convection-allowing model, the High-Resolution Rapid Refresh (HRRR), is a key tool for short-range weather forecasting and situational awareness. Improvements in assimilation of weather observations, as well as in physics parameterizations, have led to improvements in simulated radar reflectivity and quantitative precipitation forecasts since the initial implementation of HRRR in September 2014. Other targeted development has focused on improved representation of the diurnal cycle of the planetary boundary layer, resulting in improved near-surface temperature and humidity forecasts. Additional physics and data assimilation changes have led to improved treatment of the development and erosion of low-level clouds, including subgrid-scale clouds. The final version of HRRR features storm-scale ensemble data assimilation and explicit prediction of wildfire smoke plumes.

The hourly updating High-Resolution Rapid Refresh (HRRR) model is evaluated with regard to its ability to predict the areal extent of cold-season precipitation and accurately depict the timing and location of regions of snow, rain, and mixed-phase precipitation on the ground. Validation of the HRRR forecasts is performed using observations collected by the Automated Surface Observing System (ASOS) stations across the eastern two-thirds of the United States during the 2010–11 cold season. The results show that the HRRR is able to reliably forecast precipitation extent during the cold season. In particular, the location and areal extent of both snow and rain are very well predicted. Depiction of rain-to-snow transitions and freezing rain is reasonably good; however, the associated evaluation scores are significantly lower than for either snow or rain. The analyses suggest the skill in accurately depicting precipitation extent and phase (i.e., rain, snow, and mixed phase) depends on the size and organization of a weather system. Typically, larger synoptically forced weather systems are better predicted than smaller weather systems, including the associated rain-to-snow transition or freezing-rain areas. Offsets in space or time (i.e., causing misses and false alarms) have a larger effect on the model performance for smaller weather systems.

Forecasts from numerical weather prediction (NWP) models play a critical role in many sectors of the U.S. economy. Improvements to operational NWP model forecasts are generally assumed to provide significant economic savings through better decision-making. But is this true? Since 2014, several new versions of the High-Resolution Rapid Refresh (HRRR) model were released into operation within the National Weather Service. Practically, forecasts have an economic impact only if they lead to a different action than what would be taken under an alternative information set. And in many sectors, these decisions only need to be considered during certain weather conditions. We estimate the economic impacts of improvements made to the HRRR, using 12-h wind, precipitation, and temperature forecasts in several cases where they can have “economically meaningful” behavioral consequences. We examine three different components of the U.S. economy where such information matters: 1) better integration of wind energy resources into the electric grid, 2) increased worker output due to better precipitation forecasts that allow workers to arrive to their jobs on time, and 3) better decisions by agricultural producers in preparing for freezing conditions. These applications demonstrate some of the challenges in ascertaining the economic impacts of improved weather forecasts, including highlighting key assumptions that must be made to make the problem tractable. For these sectors, we demonstrate that there was a marked economic gain for the United States between HRRR versions 1 and 2 and a smaller, but still appreciable economic gain between versions 2 and 3.

Abstract. The ability to detect convective regions and to add latent heating to drive convection is one of the most important additions to short-term forecast models such as National Oceanic and Atmospheric Administration's (NOAA's) High-Resolution Rapid Refresh (HRRR) model. Since radars are most directly related to precipitation and are available in high temporal resolution, their data are often used for both detecting convection and estimating latent heating. However, radar data are limited to land areas, largely in developed nations, and early convection is not detectable from radars until drops become large enough to produce significant echoes. Visible and infrared sensors on a geostationary satellite can provide data that are more sensitive to small droplets, but they also have shortcomings: their information is almost exclusively from the cloud top. Relatively new geostationary satellites, Geostationary Operational Environmental Satellite-16 and Satellite-17 (GOES-16 and GOES-17), along with Himawari-8, can make up for this lack of vertical information through the use of very high spatial and temporal resolutions, allowing better observation of bubbling features on convective cloud tops. This study develops two algorithms to detect convection at vertically growing clouds and mature convective clouds using 1 min GOES-16 Advanced Baseline Imager (ABI) data. Two case studies are used to explain the two methods, followed by results applied to 1 month of data over the contiguous United States. Vertically growing clouds in early stages are detected using decreases in brightness temperatures over 10 min. For mature convective clouds which no longer show much of a decrease in brightness temperature, the lumpy texture from rapid development can be observed using 1 min high spatial resolution reflectance data. The detection skills of the two methods are validated against Multi-Radar/Multi-Sensor System (MRMS), a ground-based radar product. With the contingency table, results applying both methods to 1-month data show a relatively low false alarm rate of 14.4 % but missed 54.7 % of convective clouds detected by the radar product. These convective clouds were missed largely due to less lumpy texture, which is mostly caused by optically thick cloud shields above.

The primary goal of the Second Wind Forecast Improvement Project (WFIP2) is to advance the state-of-the-art of wind energy forecasting in complex terrain. To achieve this goal, a comprehensive 18-month field measurement campaign was conducted in the region of the Columbia River basin. The observations were used to diagnose and quantify systematic forecast errors in the operational High-Resolution Rapid Refresh (HRRR) model during weather events of particular concern to wind energy forecasting. Examples of such events are cold pools, gap flows, thermal troughs/marine pushes, mountain waves, and topographic wakes. WFIP2 model development has focused on the boundary layer and surface-layer schemes, cloud–radiation interaction, the representation of drag associated with subgrid-scale topography, and the representation of wind farms in the HRRR. Additionally, refinements to numerical methods have helped to improve some of the common forecast error modes, especially the high wind speed biases associated with early erosion of mountain–valley cold pools. This study describes the model development and testing undertaken during WFIP2 and demonstrates forecast improvements. Specifically, WFIP2 found that mean absolute errors in rotor-layer wind speed forecasts could be reduced by 5%–20% in winter by improving the turbulent mixing lengths, horizontal diffusion, and gravity wave drag. The model improvements made in WFIP2 are also shown to be applicable to regions outside of complex terrain. Ongoing and future challenges in model development will also be discussed.

Tropical cyclone tornadoes (TCTORs) are a hazard to life and property during landfalling tropical cyclones (TCs). The threat is often spread over a wide area within the TC envelope and must be continually evaluated as the TC moves inland and dissipates. To anticipate the risk of TCTORs, forecasters may use high-resolution, rapidly updating model analyses and short-range forecasts such as the Rapid Refresh (RAP) and High-Resolution Rapid Refresh (HRRR), and an ingredients-based approach similar to that used for forecasting continental midlatitude tornadoes. Though RAP and HRRR errors have been identified in typical midlatitude convective environments, this study evaluates the performance of the RAP and the HRRR within the TC envelope, with particular attention given to sounding-derived parameters previously identified as useful for TCTOR forecasting. A sample of 1730 observed upper-air soundings is sourced from 13 TCs that made landfall along the U.S. coastline between 2017 and 2019. The observed soundings are paired with their corresponding model gridpoint soundings from the RAP analysis, RAP 12-h forecast, and HRRR 12-h forecast. Model errors are calculated for both the raw sounding variables of temperature, dewpoint, and wind speed, as well as for the selected sounding-derived parameters. Results show a moist bias that worsens with height across all model runs. There are also statistically significant underpredictions in stability-related parameters such as convective available potential energy (CAPE) and kinematic parameters such as vertical wind shear.

Localized Aviation MOS Program (LAMP) convection and lightning probability and “potential” guidance forecasts for the conterminous United States, developed by the Meteorological Development Laboratory (MDL), have been produced operationally and made available to aviation and other users through the National Digital Guidance Database (NDGD) since April 2014. In response to user requests for improved skill and resolution of these forecasts, MDL has recently made extensive upgrades, and a switch to the new LAMP guidance was made in January 2018. Upgrades include improved spatial and temporal resolution of the predictands, which were enabled by first time LAMP use of finescale radar reflectivity products from the Multi-Radar Multi-Sensor (MRMS) system, total lightning observations from a ground-based lightning sensing system, and finescale model output from the High Resolution Rapid Refresh (HRRR) model. This article describes how these new data inputs are applied in the LAMP model to obtain improved skill and sharpness of the convection and total lightning probability forecasts. Strengths and limitations in LAMP performance are shown through verification statistics and example verification maps for a selected intense convective storm case.

Data collected in the Columbia River Gorge and Basin Area during the second Wind Forecasting Improvement Project (WFIP2) was used to study gap flow events in the region. In particular, the relationship between 200 m zonal wind speed and the zonal mesoscale pressure gradient at Troutdale (West of the gorge), Wasco (east of the gorge), and Boardman (farther east of the gorge) sites was examined. An objective criterion was used to identify 169 (Troutdale), 161 (Wasco), and 113 (Boardman) gap flow days that had weak synoptic forcing. The 200 m zonal wind speed exhibited a linear relationship with the zonal pressure gradient at Wasco during both easterly and westerly gap flow days at daily timescales. Such a relationship was only observed during easterly gap flow days at Troutdale and was not observed at Boardman. The zonal wind speed exhibited a diurnal cycle at Wasco and Boardman, with greater changes in the nighttime winds than the daytime winds due to changes in pressure gradient. The root mean square differences (RMSDs) between the observed pressure gradient at Wasco and that simulated by the High Resolution Rapid Refresh (HRRR) model in 3 km (HRRR-3km) and 750 m (HRRR-750m) horizontal resolution were 3.14 hPa and 0.57 hPa, respectively. However, the RMSDs for the 200 m zonal wind speed were 1.40 m s-1 for HRRR-3km and 1.20 m s-1 for HRRR- 750m. Improvement in simulating the zonal pressure gradient accompanied by negligible changes in simulating zonal wind speed due to higher horizontal resolution points to a complex interplay between different components of the model physics when simulating the meteorology. The HRRR-750m resolution model accurately mimicked the observed covariability (phase diagram) between the zonal pressure gradient and the 200 m zonal wind speed during the nighttime, but not during the daytime, suggesting model errors might be related to the representation of boundary layer processes.

In 2015 the U.S. Department of Energy (DOE) initiated a 4-yr study, the Second Wind Forecast Improvement Project (WFIP2), to improve the representation of boundary layer physics and related processes in mesoscale models for better treatment of scales applicable to wind and wind power forecasts. This goal challenges numerical weather prediction (NWP) models in complex terrain in large part because of inherent assumptions underlying their boundary layer parameterizations. The WFIP2 effort involved the wind industry, universities, the National Oceanographic and Atmospheric Administration (NOAA), and the DOE’s national laboratories in an integrated observational and modeling study. Observations spanned 18 months to assure a full annual cycle of continuously recorded observations from remote sensing and in situ measurement systems. The study area comprised the Columbia basin of eastern Washington and Oregon, containing more than 6 GW of installed wind capacity. Nests of observational systems captured important atmospheric scales from mesoscale to NWP subgrid scale. Model improvements targeted NOAA’s High-Resolution Rapid Refresh (HRRR) model to facilitate transfer of improvements to National Weather Service (NWS) operational forecast models, and these modifications have already yielded quantitative improvements for the short-term operational forecasts. This paper describes the general WFIP2 scope and objectives, the particular scientific challenges of improving wind forecasts in complex terrain, early successes of the project, and an integrated approach to archiving observations and model output. It provides an introduction for a set of more detailedBAMSpapers addressing WFIP2 observational science, modeling challenges and solutions, incorporation of forecasting uncertainty into decision support tools for the wind industry, and advances in coupling improved mesoscale models to microscale models that can represent interactions between wind plants and the atmosphere.

NYSolarCast: A solar power forecasting system for New York State

High-shear, low-CAPE (HSLC) quasi-linear convective systems (QLCSs) in the Southeastern United States pose a challenge to operational forecasters. Prior studies have investigated bulk environmental ingredients associated with the severe weather produced by these systems; however, there is spatial and temporal variability in HSLC severe weather from QLCSs that has yet to be explained. This study sought to improve the conceptual model for HSLC QLCSs by characterizing heterogeneities in their environments. In pursuit of this goal, QLCS-relative analyses that incorporate hourly data spanning the full duration of 79 HSLC QLCS events occurring across the Southeastern U.S. were created using archived operational High-Resolution Rapid Refresh (HRRR) model data. ‘All case’ composites reveal that HSLC environments are not uniformly “low-CAPE”, and HSLC QLCSs may be partially fed by elevated “most unstable” parcels. Additionally, comparisons of different QLCS regimes show greater bulk shear magnitudes along the poleward portions of the QLCS convective lines during tornadic hours, which may explain the poleward bias of QLCS tornado reports noted by prior studies. A strong correlation was also identified between low-level nocturnal stabilization and the enhancement of both the low-level jet and low-level vertical wind shear. These enhancements could account for the prevalence of nocturnal tornadoes produced by these systems. Finally, the potential response to diabatic heating (i.e., low-level flow enhancements) may contribute to increased bulk shear magnitudes during the mature phase of these systems, which could help address the noted time lag between system formation and the occurrence of the first tornado reports.

Latent heating (LH) is an important quantity in both weather forecasting and climate analysis, being the essential factor driving convective systems. Yet, inferring LH rates from our current observing systems is challenging at best. For climate studies, LH has been retrieved from the Precipitation Radar on the Tropical Rainfall Measuring Mission (TRMM) using model simulations in the look-up table (LUT) that relates instantaneous radar profiles to corresponding heating profiles. These radars, first on TRMM and then Global Precipitation Measurement Mission (GPM), provide a continuous record of LH. However, temporal resolution is too coarse to have a significant impacts on forecast models. In operational forecast models such as High-Resolution Rapid Refresh, convection is initiated from LH derived from ground based radar. Despite the high spatial and temporal resolution of ground-based radars, one disadvantage of using these sources is that its data are only available over well observed land areas. This study develops a method to derive LH from the Geostationary Operational Environmental Satellite-16 (GOES-16) in near-real time. Even though the visible and infrared channels on the Advanced Baseline Imager (ABI) provide mostly cloud top information, rapid changes in cloud top visible and infrared properties, when formulated as a LUT similar to those used by the TRMM and GPM radars, can equally be used to derive LH profiles for convective regions based on model simulations with a convective classification scheme and channel 14 (11.2 μm) brightness temperatures. Convective regions detected by GOES-16 are assigned LH from the LUT, and they are compared with LH from the Next Generation Weather Radar (NEXRAD) and one of the Dual-frequency Precipitation Radar (DPR) products, the Goddard Convective-Stratiform Heating (CSH). LH obtained from GOES-16 show similar magnitude with NEXRAD and CSH, and vertical distribution of LH is also very similar with CSH. One month analysis of total LH from convective clouds from GOES-16 and NEXRAD shows good correlation between the two products. Finally LH profiles from GOES-16 and NEXRAD are applied to WRF simulations for convective initiation and their results are compared to investigate their impacts in precipitation forecasts. Results show that LH from GOES-16 have similar impacts as NEXRAD, and improves the forecast significantly.