Reflections on a Quarter Century of Storm Forecasting

As of last week, I have been forecasting and researching severe storms (in SELS-Kansas City and its Norman successor) for 25 years, not counting prior time at NHC and NSSL. That’s 1/4 century of living the dream of a tornado-obsessed kid. Much has transpired professionally and personally in that time span, most of it decidedly for the better. The only negative is that I’m a quarter-century older. Give how little I knew then compared to now, and how little I knew about how little I knew, maybe the geezers of my youth were right, in that youth is wasted on the young.

The science of severe-weather prediction has advanced markedly. More is understood about the development and maintenance of severe storms than ever before. Numerical models also are better than ever, yet still riddled with flaws known to forecasters that belie their hype as panaceas. Most weather media, social media weather pundits outside front-line forecasters, and far too many Twitter-active pure researchers and grad students exhibit naivete and ignorance about both the flaws of models in applied use, and the still-urgent need for humans in forecasting (yes, forecasting, not just so-called “decision support services” a.k.a. DSS).

Fortunately, most of those who actually do the job — the experienced severe-storms-prediction specialists who are my colleagues — know better, and incorporate both the science and art (yes, art!) of meteorology into forecasting, to varying extents. Yet pitfalls lie in our path in forms of several interrelated ideas:

    * Automation: Even if the human forecast is better at a certain time scale, at what point does the bureaucracy (beholden to budget, not excellence) decide the cost-benefit ratio is worth losing some forecast quality to replace humans with bots that don’t take sick leave, join unions, nor collect night differential? I wrote in much more detail about this two years ago, and that discussion touches upon some of what I am re-emphasizing below. Please go back and read that if you haven’t already.

    * Duty creep with loss of diagnostic-understanding time: Cram more nickel-and-dime, non-meteorological side duties into the same time frames with the same staffing levels, a social-media nickel this year, a video-briefing dime the next, and something must give. In my experience, that is analysis and understanding, which in an ironically self-fulfilling way, stagnates human forecast skill (and more importantly, sacrificing concentration and situational understanding) whilst allowing models to catch up. Knowing how bureaucracy works, I suspect this is by design.

    * Mission sidetracking – “DSS” including customized media and social-media services: I don’t deny the importance of DSS; in fact I support it! Outreach is good! Yet DSS should not be done by the full-time, front-line forecasters who ideally need to be laser-focused on meteorological understanding when on duty, and making forecasts the most excellent possible. DSS should be a separate and parallel staffing with social-science-trained specialists in outreach everywhere DSS is required. Otherwise, quality above what the models can provide (which still is possible, especially on Day-1 and day-2, and in complex phenomena like severe and winter storms) will be lost prematurely and unnecessarily.

    * Loss of focus — see the last two bullets: A growing body of psychological literature resoundingly debunks the notion of “multitasking”. We lose focus and delay or dilute accomplishment when concentration is broken and interruptions occur. Management should be focusing on reducing, not increasing, distractions and interruptions on the forecast desk. Forecast quality and human lives are at stake.

    * De-emphasis of science in service: Physical and conceptual understanding matter in the preparation of consistently high-quality forecasts — especially on the complicated, multi-variate area of severe local storms. These are not day-5 dewpoint grids, and this is why my workplace has published more scientific research than any other publicly funded forecasting office, by far. Tornadoes, severe hail and thunderstorm winds are highly dependent on time and space overlaps of multiple kinds of forcings that models still do not often handle well, partly because of the “garbage in, garbage out” phenomenon (input observations are not dense enough), partly due to imperfect model physics and assimilation methods. Severe-storms specialists must have both self-motivation and continued support from above to understand the science — not only by getting training and reading papers, but by writing papers and performing research!

    * Model-driven temptation to complacency: This is a form of Snellman’s meteorological cancer. I wrote about some of these topics here 13 years ago in far more detail, under the umbrella of ensemble forecasting. Please read that discussion! I see no need so far to amend any of it, except to add thoughts about focus and concentration (above). If forecasters don’t think they can improve on a model, even if they really can, or just don’t feel like making effort to do so amidst other demands for time, they’ll just regurgitate the output, at which point their jobs can (and probably should!) be automated.

    * Meddling in the mission by distant, detached bureaucratic ignoramuses. Schism between upper-management assumptions and real front-line knowledge is a common theme across all governmental and corporate bureaucracies, and is nothing new across generations. In my arena, it manifests as lack of understanding and appreciation for the difficulty and complexity of the work, and in the difference in respecting the absolutely urgent need for direct, devoted, focused human involvement. The very first people with whom policy-makers should discuss severe-storms-prediction issues are the front-line severe-storms forecasters — that is, if knowledge and understanding matter at all in making policy.

At this stage of my career, I’m neither an embittered old cynic nor a tail-wagging puppy panting with naive glee. I never was the latter and I intend not to turn into the former. Instead I observe and study developments in a level-headed way, as both an idealist and a realist, assess them with reason and logic, and report about them with brutal honesty. I doing so, I’ll say that there is cause for both optimism and pessimism at this critical juncture. I’ve covered the pitfalls (pessimism) already.

How can optimism be realized? It’s straightforward, though not easy. We must continue to grow the science, emphasize the human element of physical and conceptual understanding (including the still-important role of human understanding and the art of meteorology) in such complex and multivariate phenomena, use ever-improving (but still highly imperfect!) models as tools and not crutches, study and learn every single day, minimize distractions/disruptions, and most of all, focus on and fight for excellence!

I’m now decidedly closer to retirement than to the start of my career. Yet you can count on this: you won’t see me coast, nor go FIGMO, nor be merely “good enough for government work”! Such behavior is absolutely unacceptable, pathologically lazy, morally wrong, and completely counter to my nature. The passion for atmospheric violence still burns hot as ever.

Excellence is not synonymous with perfection, and the latter is impossible anyway. I will issue occasional bad forecasts, and I hope, far more great ones. Regardless of the fickle vagaries of individual events, I must start each new day for what it is — a different challenge ready to be tackled, compartmentalized unto itself, not the same as the great or crappy forecast of the previous shift. I must settle for nothing less than consistency of excellence in performance, lead the next generation by example in effort, and advance the science further. I’ll be pouring the best reasoning I know into each forecast, even if that is necessarily imperfect and incomplete. I’ll be doing research and writing more papers. I’ll be educating and speaking and writing and raising awareness on severe-storms topics, trying to pass understanding on to both users of the forecasts and forecasters of the future.

I’m paid well enough, and the taxpayer deserves no less than excellence in return for his/her investment in me. That is my driven purpose in the years remaining in full-time severe-weather forecasting.



Comments

Leave a Reply

You must be logged in to post a comment.