Home Forecasts, Warnings, Flood Warnings, Charts, Observations, Marine Services, Satellite Images Maps, Rainfall Outlook, Climate Averages, Climate and Our Environment Flood Warning Service, Water Resources Assessment, Hydrometeorological Advisory Service Our Products, Services and Access Methods Registered User information and LOGIN Phone Number, E-mail, Addresses and Postal Addresses Bureau Contacts, Charter, Organisation, Programs, WMO Media Releases, Conferences, Events Publications Educational Brochures, Library, School Projects, Career Information Feedback Search the site for words or phrases Help - FAQs, Glossary

Navigation Bar Graphic

A KNOWLEDGE-BASED INTERNET WEATHER FORECASTING SYSTEM (VERSION 2).

(INCLUDING TAF YMML)

(Link to 20th IIPS Conference Program)
(Link to 20th IIPS Conference Paper)
(Link to 20th IIPS Conference Presentation)
(Link to Background Information about the Author)


Enter Date (for which forecast applies):
1) Date (1,2 ... 31): 2) Month (1,2, ... 12): 3) Year (2002, 2003 ...): 4) Days Ahead (1,2, ... ,7):
Enter Forecast 9am MSL Pressure Data (from NWP model):
5) Melbourne: 6) Hay: 7) Smithton: 8) Gabo Is:
9) Mt Gambier: 10) Forrest:
Enter Melbourne and 9am NWP Model Data:
11) Melbourne Min on day before forecast day: 12) Melbourne Max on day before forecast day: 13) Melbourne 700 hPa % RH on forecast day: 14) Mt Gambier 700 hPa % RH on forecast day:
15) Melbourne 700 hPa % RH on day after: 16) Gabo Is 700 hPa % RH on day after: 17) 850 hPa Temp on forecast day: 18) 850 hPa Temp on day after:
19) Melbourne 9am Temp on day before day 1: 20) Melbourne 3pm Dewpoint on day before day 1: 21) Cape Otway 9am Swell on day before:

TAF YMML:
Derived from NWP model MSL pressure;
statistical aids to predict min temp,
max temp, and QPF, and probability of
precip, fog, low cloud, and thunder;
and also, from synoptically stratified
wind and weather climatologies

T
Q

Bass Strait:
Derived by adjusting Shoni Dawkin's
statistical aid to predict wind and
swell at Cape Otway to Bass Strait.

.
.
Synoptic Information:
21) Direction: 22) Curvature: 23) Speed:
Synoptic Type (click below to view):
24) Type:
Forecast Rain (24h from 9am):
25) PoP (%): 26) QPF (mm):
Forecast Temperature:
27) Min (deg C) 24h to 9am (usually preceding night): 28) Max (deg C) 24h from 9am (usually current day):
Additional Localities:
29) Max (deg C) at Mildura: 30) Max (deg C) at Mt Hotham: 31) Max (deg C) at Watsonia:
Aviation Elements:
32) Probability of Fog (%): 33) Probability of Low Cloud (%): 34) Probability of Thunderstorms (%):
.
.
WEATHER:
PRECIS:
ICON:
WIND:
BAY WINDS:
BAY SEAS:
Pitjantjatjara: (capitals - retroflex sounds)
Woiwurrung:
Chinese (Mandarin): (click below)
Raw Data Prior to Pseudo-Ensemble Adjustment for NWP Uncertainty:
35) Raw PoP (%): 36) Raw QPF (mm):
37) Raw Min (deg C): 38) Raw Max (deg C):
39) Cape Otway Swell Height(m): 40) Cape Otway Wind Speed (kts): 41) Cape Otway Wind Dir (deg):

LINK TO FORECAST IN CHINESE: Note: After clicking on the number corresponding to the appropriate forecast in Chinese, a new window, with a forecast in Chinese, will appear. Exiting from the new window will return you to the original window. 1 2 3 4 5 6 7 8 9 10 11 12 13 14

VIEW SYNOPTIC TYPE: Note: After clicking on the number corresponding to the appropriate synoptic type, a new window, with an analysis, will appear. Exiting from the new window will return you to the original window. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50


The Commonwealth Bureau of Meteorology (CBoM) ICONS

__ICON 1 = __ICON 2 = __ICON 3 = __ICON 4 = __ICON 5 = __ICON 6 =
__ICON 7 = __ICON 8 = __ICON 9 = __ICON 10 = __ICON 11 = __ICON 12 =

World Meteorological Organisation (WMO) ICONS

01 Sandstorm Sandstorm, Duststorm, Sand, Dust
02 Thunderstorms Thunderstorms, Thundershowers, Storm, Lightning
03 Hail Hail
04 Blowing Snow Blowing Snow, Blizzard, Snowdrift, Snowstorm
05 Snow Showers Snow Showers, Flurries
06 Snow Snow, Heavy Snow, Snowfall
07 Light Snow Light Snow
08 Sleet Sleet
09 Showers Showers, Heavy Showers, Occasional Showers, Rainshower
10 Scattered Showers Scattered Showers
11 Isolated Showers Isolated Showers
12 LIght Showers Light Showers
13 Freezing rain Freezing Rain
14 Rain Rain
15 Drizzle Drizzle, Light Rain
16 Fog Fog
17 Mist Mist
18 Smoke Smoke
19 Haze Haze
20 Overcast Overcast
21 Sunny Interval Sunny Interval, No Rain, Clearing
22 Sunny period Sunny Period, Partly Cloudy, Partly Bright, Mild
23 Cloudy Cloudy, Mostly Cloudy
24 Bright Bright, Sunny, Fair
25 Fine Fine, Clear
26 Windy Windy, Squall, Stormy, Chill, Gale
27 Wet Wet, Humid
28 Dry
Dry
29 Freezing Freezing
30 Frost Frost
31 Hot Hot
32 Cold Cold
33 Warm Warm
34 Cool Cool

INCORPORATING AN ENSEMBLE FORECASTING PROXY INTO A KNOWLEDGE BASED SYSTEM

by Harvey Stern, Bureau of Meteorology, Australia

1. INTRODUCTION

1.1 The Pilot Version

An early version of the knowledge-based system (the PILOT VERSION) was presented to the 18th Interactive Information Processing Systems (IIPS) Conference (Stern, 2002) (http://www.weather-climate.com/fc.html).

The system was developed for the small (227,000 sq km) southeast Australian State of Victoria. It was described as being capable of generating forecasts for public, aviation, marine and media interests, in languages other than English, and for more than 200 localities in Victoria - a breadth of output far greater than one could ever hope to produce utilising the current labour intensive systems.

1.2 Benefits of Knowledge-Based Systems

A major benefit of a knowledge-based system is that it incorporates an extensive "bank" of forecaster experience. Ramage (1993) has proposed an "iterative" approach to "locking in" improvements in forecasting methodology. The system's skill increases as new knowledge is incorporated into its operation. Hence, progress is gradually made towards the realisation of Ramage's dream. The system is (therefore) not seen as "yet another" instrument of forecast guidance. Rather, its development is seen as a logical step along the path of having the computer replicate (and ultimately replace) various aspects of the manual side of the forecast process, by systematically "locking in" new knowledge.

2. PRELIMINARY EVALUATION

2.1 Evaluation of the Pilot Version

The PILOT VERSION of the system was evaluated during November 2001 for the city of Melbourne using a skill score that combines all features of a forecast. The evaluation showed that, although superiority over climatology was achieved, the forecasts (on most measures) proved to be inferior to the official forecasts.

2.2 Evaluation of Version 1

The system was then "scaled back", new knowledge added, and what has been termed VERSION 1 of the system was then evaluated over a 100-day trial, the results of which were presented to the 19th IIPS Conference (Stern, 2003)

http://www.weather-climate.com/internetforecasts.html

The deficiency evident with the PILOT VERSION appears to have been largely eliminated (especially for precipitation at day 1 and for temperature at days 1, 2, 3, 4 and 5).

2.3 Further Knowledge Added

On the basis of the results of the 100-day trial, further knowledge was added to the system to yield VERSION 2 of the system, which extends the outlook from 6 days to 7 days:

http://www.weather-climate.com/internetforecasts2.html

VERSION 2:

3. THE TERMINAL AERODROME FORECAST (TAF)

3.1 How the TAF is generated

I will now take the opportunity to briefly refer to how the system generates the TAF for Melbourne Airport (YMML). In so doing, a number of issues will be addressed.

The TAF is valid for the 1200 UTC to 1200 UTC period (1212), the TAF validity period most closely corresponding to 0001 to 2400 Australian Eastern Standard Time (AEST).

The 1212 period is that covered by most of the objective forecast guidance upon which the derivation of the TAF depends.

The guidance is generated via aid of:

The sets of prediction equations include those for:

In application, the equations are "solved" using observational data and NWP output to yield a forecast. Verification statistics, where they are available (Stern and Parkyn, 1999), are used to establish appropriate "cut-offs" to warrant including mention of particular weather elements in a TAF.

For example, to illustrate the methodology, when PoFog>=10%, a PROB30 1922 0400 FG for fog is applied, but should PoFog>=35%, a PROB40 1922 0400 FG is applied.

Similarly, when PoLCld>=40%, a TEMPO for low cloud is applied, but should 30%<=PoLCld<40%, only an INTER for low cloud is applied.

3.2 The beauty of the system

The beauty of what has been developed here lies in how the system defines, and provides a "home" for, the various components of objective guidance and knowledge of associated processes, which are used in deriving the TAF.

It also represents a "vehicle" to automatically generate the TAF using all available knowledge. Indeed, if a new piece of guidance is developed - for example, one of my colleagues (Newham, 2003) is presently carrying out work on the timing of the onset of fog - then this new piece of guidance becomes a part of the process of deriving the TAF, and a new area of knowledge is added to the system.

The success (or otherwise) of the TAF is entirely dependent upon how well the associated processes have been defined, and upon how effective are the various components of objective guidance.

A comprehensive verification trial is planned in order to answer the questions such as:

It is also intended to eventually extend the TAF to other validity periods and other localities.

4. THE EXTENT OF UNCERTAINTY

4.1 Conventional Ensemble Techniques

Conventional ensemble techniques seek to establish the extent of uncertainty in the forecast for a particular locality of interest in a particular situation. They achieve this by statistically analysing an array of a Numerical weather Prediction (NWP) model output. The array is derived from output generated by imposing a random set of perturbations on the initial analysis.

To illustrate this concept, suppose we take the case of 20 runs of the NWP model, with 20 slightly different initial states.

Suppose further that 17 of the 20 outcomes suggest precipitation at the locality of interest. In this situation, the ensemble of NWP output is suggesting a PoP of 85%.

4.2 Establishing the Extent of Uncertainty in VERSION 2

The extent of uncertainty in VERSION 2 is achieved in a different manner to conventional ensemble techniques.

Firstly, a database of observed weather, and forecast weather using the PERFECT PROG approach (that is, under the assumption that the NWP model output is perfect), is established.

Secondly, the forecast weather component of the database is expressed in terms of "departure from normal". To illustrate, a PoP of 85% at a time of year when the climatological normal is 35% is expressed as +50%.

Thirdly, these data are statistically analysed utilising regression techniques in order to determine the optimal proportion of "departure from normal" to be applied.

This yields a more accurate measure of uncertainty than what would be achieved utilising conventional ensemble forecasting techniques, as the measure is derived directly from an array of actual forecasts.

For example, regression analysis determines that, for Day 1 PoPs, the departure from the seasonal normal PoP is reduced to 68.8% of that departure. To illustrate, suppose that the seasonal normal PoP is 50%, and the PoP derived using the PERFECT PROG approach is 80%. In this situation, VERSION 2 yields a PoP of 50% + (80%-50%)x0.688 = 71% for Day 1.

Similarly, regression analysis determines that, for Day 7 PoPs, the departure from the seasonal normal PoP is reduced to 28.1% of that departure. In the above situation, VERSION 2 yields a PoP of 50% + (80%-50%)x0.281 = 58% for Day 7.

Conventional ensemble forecasting suffers from the disadvantage of the level of uncertainty in the initial analysis being unknown, whereas the uncertainty associated with a database of actual forecasts is known precisely.

5. PHILOSOPHY

It may be appropriate to ask, from a philosophical point of view, whether or not it may be premature, at this stage, to move towards computer replication of the manual forecast process. After all, the new National Digital Forecast Data Base (NDFD) of the U.S.A. National Weather Service (NWS) (Ruth & Glahn, 2003) allows for considerable manual involvement in its operation. A move to computer replication would result in a paradigm shift in the nature of the forecasting meteorologist's role.

The role increasingly would become one of utilising sophisticated methodologies to analyse the output of the automated system, and implementing changes to it (consequent upon the analyses).

However, having the computer replicate various aspects of the manual forecast process, in order to make possible the production of a greatly increased number and variety of forecast products, is already happening. For example, the highly competitive environment that the New Zealand weather service finds itself has resulted in it moving down this pathway (Linton and Peters, 2003).

Furthermore, there is pressure in the U.S.A. to allow commercial operators to take over government's traditional role in the provision of weather services (excepting the delivery of urgent warnings to protect life and property). To illustrate, AccuWeather's 31 January 2003 Media Release "expressed regret that the (National Research Council) report did not recommend that the National Weather Service end its practice of issuing routine weather forecasts."

6. CONCLUDING REMARK

Regardless of philosophy and outside of the legislative framework, competitive pressures may determine the future as private operators (and, also the general public) realise that the new technologies allow for the development and implementation of forecasting systems capable of providing a breadth of output far greater than one could ever hope to produce utilising the current approaches.

As Brooks (1995), wrote: "technology, which initially allowed humans to make routine weather forecasts, will soon close that avenue of human endeavour ... (and thereby permit) concentration on severe events."

Acknowledgments: The author gratefully acknowledges the advice of many of his colleagues in the Bureau of Meteorology, in particular, those in the Regional Forecasting Centre of the Bureau's Victorian office.

7. REFERENCES

Brooks, H., 1995: Human forecasters and technology. Obtained (September 1997) from http://www.nssl.uoknor.edu/~brooks/ and as quoted by Stern (1998).

Halfpenny, M. J., 2003: Personal Communication.

Linton, P. and Peters, B., 2003: Meteorological analysis - New Zealand data. Weather Risk Management Association Asia-Pacific Meeting, Sydney, Australia.

Newham, P., 2003: Personal Communication.

Ramage, C. S., 1993: Forecasting in meteorology. Bull. Amer. Meteor. Soc., 74, 1863-1871

Ruth, D. P., and Glahn, H. R., 2003: Creating a national digital database of official National Weather Service forecasts. 19th Conference on Interactive Information and Processing Systems, Long Beach, California.

Stern, H. and Parkyn, K., 1999: Predicting the likelihood of fog at Melbourne Airport. 8th Conference on Aviation, Range and Aerospace Meteorology, Amer. Meteor. Soc., Dallas, Texas.

Stern, 2002: A knowledge-based system to generate internet weather forecasts. 18th Conference on Interactive Information and Processing Systems, Orlando, Florida.

Stern, 2003: Progress on a knowledge-based internet weather forecasting system. 19th Conference on Interactive Information and Processing Systems, Long Beach, California.


© Copyright Commonwealth of Australia 2002, Bureau of Meteorology (ABN 92 637 533 532)
Please note the Copyright Notice and Disclaimer relating to the use of the information on this site and our site Privacy Policy.
Users of these web pages are deemed to have read and accepted the conditions described in the Copyright Notice and Disclaimer.