Fourth International Verification Methods Workshop
-
Monday 8 June 2009
Session 1: User-oriented Verification
-
Chair: Pertti Nurmi
- 1.1a Juhani Damski: Customer-oriented services at FMI.
- 1.1b Laurence Wilson: What Is A Good Forecast: The importance of user-orientation in verification..
- 1.2 Clive Wilson: Do key performance targets work?.
- 1.3 Tressa Fowler: Wind forecast verification.
- 1.4 Robert Maisha: UM model and Kalman Filter forecast verification at SAWS.
Session 2: Verification Tools and Systems
-
Chair: Matt Pocernich
- 2.1 Tressa Fowler: The Model Evaluation (MET 2.0), Overview and Recent Enhancements
- 2.2 Barbara Brown: MODE-3D: Incorporation of the time dimension
- 2.3 James Brown: The Ensemble Verification System (EVS): A software tool for verifying ensemble forecasts of hydrometeorological and hydrologic variables at point locations.
- 2.4 Yin Kong Leung: Objective verification of weather forecast in Hong Kong
- 2.5 Marcus Paulat: COSMO-DE-EPS - construction and verification of a limited-area ensemble prediction system on the convective scale
Session 3: Coping with Uncertainty in Verification Data
- Chair: Chiara Marsigli
- 3.1 Carlos Santos: Introducing observational uncertainty in the scoring of a multi-model limited area model over the European area
- 3.2 Otto Hyvärinen: Visualising verification results when no true reference is available
- 3.3 Theresa Gorgas: The Challenge of Finding "Good" Reference Data for Verification
- 3.4 Benedikt Bica: High resolution precipitation analysis and forecast validation over complex terrain using an inverse VERA approach
- 3.5 Laurence Wilson: Verification of multi-model ensemble forecasts using the TIGGE data
- 3.6 Matthew Pocernich: Feature-oriented verification of wind speed forecasts
Session 4: Properties of Verification Methods
- Chair: David Stephenson
- 4.1 Ian Jolliffe: Probability forecasts with observation error: Is the Brier score proper?
- 4.2 Lovro Kalin: Is ETSS Really Equitable?
Session P: Posters
Chair: Laurie Wilson- P01. Julie Demargne and James Brown: Communicating hydrologic verification information for operational forecasting and real-time decision making in the U.S. National Weather Service
- P02. James McGregor: The value of GFS data for precipitation forecasting for the Waikato River catchment, New Zealand
- P03. Guenther Mahringer: TAF Verification in the MET Alliance
- P04. . Sultan Al-Yahyai: Development of a portable verification Package
- P05. Adriano Raspanti: VERSUS: Unified Verification Package in COSMO
- P06. Yasutaka Ikuta: Evaluation of hydrometeors of a high-resolution model using a radar simulator
- P07. Kristian Pagh Nielsen: Verification of cloud physical properties
- P08. Robert Fawcett and Elizabeth Ebert: Base rates and skill scores
- P09. Marek Jerczynski: Some robust scale separation methods at work
- P10. Marion Mittermaier: Time-series analysis of scale-selective verification: Can we use it for operational forecast monitoring?
- P11. Pertti Nurmi: SAL Verification in Hydrological Catchments
- P12. Juan Bazo: Verification of Seasonal Rainfall Prediction in the Rimac River Basin
- P13. Jonathan Eden: Assessing the skill of GCM-simulated precipitation
- P17. Marcel Vallee: A block bootstrapping method for the Canadian NWP model
- P18. Ewan J. O'Connor: Cloud verification using radar: What is the half-life of a cloud-fraction forecast?
- P19. Pascal Mailier: Assessing the operational skill of predictions of forecast error
- P20. Petra Roiha: Analysis of Marine Seasonal Ensemble Forecasts for the Baltic Sea
- P21. Petr Zacharov: An estimation of QPF uncertainty by forecasting the radar-based ensemble skill
- P22. Matias Armanini : Extreme temperatures verifications on Argentina forecast by NWP GFS NCEP
- P23. Monika Bailey: Verification of nowcasting methods in the context of high-impact weather events for the Canadian Airport Nowcasting (CAN-Now) project
- P24. Kadarsah Binsukandar Riadi: Reliability Evaluation of HyBMG by Using the ROC Curve
- P25. Girmaw Bogale: Rainfall prediction performance of WRF model over complex terrain of Ethiopia
- P26. Kalle Eerola: Verification of the Hirlam NWP forecasts and the connection between the scores and improvements in the model.
- P30. Jordi More: The Impact of Applying Different Verification Techniques and Precipitation Analyses in QPF Verification
- P31. Maria Stefania Tesini: Verification and Statistical properties of COSMO-17 QPF
- P32. Marco Turco: The forecaster's added value in QPF
- P33. Daan Vogelezang: Verification of statistical forecasts of low visibility at the Amsterdam Airport
- P34. Ji-Won Yoon and Sei-Young Park: Verification of ensemble forecast using the physical parameterization schemes of WRF model during the Changma period over Korea
- P35. Xiaoli Li: Comparisons of global and regional ensemble prediction systems at NMC
- P36. Joel Stein and Marielle Amodei: Another look at the contingency tables: Scores based on Manhattan distances in the error space
- P37. Claude Gibert: MetPy and Verify 2008
Tuesday 9 June 2009
Session 5: Verification of Weather Warnings
- Chair: Tressa Fowler
- 5.1 David Stephenson: The Verification of Weather Warnings: Did the Boy Cry Wolf or Was It Just a Sheep? (invited)
- 5.2 Martin Göber: Approaches to process and event oriented verification of warnings
- 5.3 Michael Sharpe: The challenge of verifying severe weather warnings
- 5.4 Clive Wilson: A critical look at the verification of Met Office "Flash" Warnings
- 5.5 Marion Mittermaier: Verifying extreme rainfall alerts for surface water flooding
Session 6: Spatial and Scale-sensitive Methods
- Chair: Francis Schubiger & Johannes Jenkner
- 6.1 Barbara Brown: Spatial Verification Methods
- 6.2 Eric Gilleland: Spatial Forecast Verification: The Image Warp
- 6.3 Chermelle Engel: A scale-based distortion metric for mesoscale weather verification
- 6.4 Stefano Mariani: On evaluating the applicability of CRA over small verification domains
- 6.5 Marion Mittermaier: Identifying skillful spatial scales using the Fraction skill Score
- 6.6 Barbara Casati: New Developments of the Intensity Scale Verification Technique within the Special Verification Methods Intercomparison
- 6.7 Elizabeth Ebert: Feature-specific verification of ensemble forecasts
Session 7: Spatial and Scale-sensitive Methods: High-resolution Models
- Chair: Marcus Paulat & Stefano Mariani
- 7.1 Ulrich Damrath: Some experiences during verification of precipitation forecasts using fuzzy techniques
- 7.2 Marielle Amodei: Deterministic and fuzzy verification of the cloudiness of High Resolution operational models
- 7.3 Kees Kok: Valuing information from high resolution forecasts
- 7.4 Chiara Marsigli: QPF Verification of Limited Area Ensemble Systems during the MAP D-PHASE OP
- 7.5 Francis Schubiger: Verification of precipitation forecasts of the MAP D-PHASE data set with fuzzy methods
- 7.6 Sami Niemelä: Verification of High resolution Precipitation forecasts by Using the SAL Method
- 7.7 Mathias Zimmer: Towards Evaluating Timing Errors of Quantitative Precipitation Forecasts with the Feature-Based Technique SAL
Wednesday 10 June 2009
Session 8: Seasonal and Climate Forecast Verification
- Chair: Marcel Vallee
- 8.1 Simon Mason: Towards Standardized verification of seasonal climate forecasts (invited)
- 8.2 Barbara Casati: Extreme Value theory to Analyze, Validate and Improve Extreme Climate Projections
- 8.3 Pascal Mailier: Can you really trust long-range weather predictions? Confessions of a rogue forecaster.
Session 9: Tutorial Presentations
- Chair: Anna Ghelli
- Intro Photos.
- Turbulence project.
- EPS project.
- Hong Kong Temp project.
- Wind Speed project.
- EPS PoP project.
- Ukraine Temp project.
- Portugal Precip project.
- Barcelona Precip project.
Session 10: New Ideas in Verification
- Chair: Theresa Gorgas
- 10.2 Deborah Glueck: Bias in trials comparing paired continuous tests can cause researchers to choose the wrong screening modality
- 10.3 Zoran Pasaric: Polychoric correlation coefficient in forecast verification
- 10.4 Johannes Jenkner: Verification of Probabilistic Calibrations for Deterministic GFS Precipitation Forecasts
-
General Discussion