Sunday, November 10, 2019

Rainfall accuracy

In my previous analysis of forecast accuracy, I didn't look at the prediction for rain. Part of the reason for this is the fact that some of the services don't provide their rainfall reports and/or predictions in an easy to analyse format e.g. it might say 'light drizzle', 'cloudy' or heavy rain.

The one exception to this rule is the yr.no forecast service which provides rainfall predictions and reports in mm/hour. I thought it would be too strict to expect the forecasted mm/hour to match so I instead translated into rain or dry values.

This means that we can have 4 situations:
  1. pred_rain => we predicted rain and we got it
  2. unpred_rain => we didn't predict rain but we got it anyway
  3. pred_dry => we predicted dry weather and we got it
  4. unpred_dry => we didn't predict dry conditions but we got it anyway
I analysed 1 day and 7 day predictions for a selection of cities and I noticed a few key facts:

  • Rain forecasts in Luxor are 100% accurate, but this is because it never rained at all in Luxor during our time to track. This is in stark contrast to the results from other cities I looked at.
  • In Dublin, forecasts are about 82% accurate for the next day and 66% accurate for one week in advance.
  • In Galway, forecasts are about 75% accurate for the next day and 60% accurate for one week in advance. This is only slightly better than random coin tossing which we would expect to  provide 50% accuracy


Here is the raw output if you want to look closer:

1 Days in advance for Dublin
Total 2316
pred_rain 240 10.36%
pred_dry 1662 71.76%
unpred_dry 216 9.33%
unpred_rain 198 8.55%

Correct 1902 82.12%
Incorrect 456 19.69%
 
7 Days in advance for Dublin
Total 2232
pred_rain 84 3.76%
pred_dry 1398 62.63%
unpred_dry 408 18.28%
unpred_rain 342 15.32%

Correct 1482 66.40%
Incorrect 492 22.04%
 
1 Days in advance for Galway
Total 2346
pred_rain 330 14.07%
pred_dry 1422 60.61%
unpred_dry 276 11.76%
unpred_rain 318 13.55%

Correct 1752 74.68%
Incorrect 606 25.83%
 
7 Days in advance for Galway
Total 2256
pred_rain 180 7.98%
pred_dry 1164 51.60%
unpred_dry 474 21.01%
unpred_rain 438 19.41%

Correct 1344 59.57%
Incorrect 654 28.99%
 
1 Days in advance for Luxor
Total 2346
pred_rain 0 0.00%
pred_dry 2346 100.00%
unpred_dry 0 0.00%
unpred_rain 0 0.00%

Correct 2346 100.00%
Incorrect 0 0.00%
 
7 Days in advance for Luxor
Total 2238
pred_rain 0 0.00%
pred_dry 2238 100.00%
unpred_dry 0 0.00%
unpred_rain 0 0.00%

Correct 2238 100.00%
Incorrect 0 0.00%
 
1 Days in advance for Coral Springs
Total 2364
pred_rain 708 29.95%
pred_dry 996 42.13%
unpred_dry 402 17.01%
unpred_rain 258 10.91%

Correct 1704 72.08%
Incorrect 1110 46.95%
 
7 Days in advance for Coral Springs
Total 2268
pred_rain 594 26.19%
pred_dry 846 37.30%
unpred_dry 498 21.96%
unpred_rain 330 14.55%

Correct 1440 63.49%
Incorrect 1092 48.15%
 
1 Days in advance for Perth
Total 2382
pred_rain 168 7.05%
pred_dry 1974 82.87%
unpred_dry 108 4.53%
unpred_rain 132 5.54%

Correct 2142 89.92%
Incorrect 276 11.59%
 
7 Days in advance for Perth
Total 2262
pred_rain 132 5.84%
pred_dry 1740 76.92%
unpred_dry 228 10.08%
unpred_rain 162 7.16%

Correct 1872 82.76%
Incorrect 360 15.92%

Friday, October 25, 2019

Post Tricycles

While I was out running this morning, I happened to spot a man delivering the mail. This is not really worth mentioning except for the vehicle he was using to transport the letters and parcels. I have often seen mail delivery people use a bicycle, but the large sack of mail tends to make it hard to cycle safely. This guy was using a tricycle which had a huge box of mail being carried very efficiently.

Friday, October 4, 2019

Accuracy of temperature predictions

Using the weather data I collected previously, I wanted to figure out which of the forecasts services was making the most accurate forecasts.

The way I calculated this was by comparing the temperature predicted in x days time with the actual temperature reported by the service. e.g. if the provider predicted on 1st/Aug that the temperature would be x degrees in 5 days time, then I compare this with their actual reported temperature on 6th/Aug, This absolute error is then averaged across all readings from  all cities

Here is the summary data

Here is a chart of the data for people who prefer visual:

Points to note
  • I eliminated one reading from weather underground 6 day forecasts because it would have re-scaled the chart (probably indicates a programming error on my behalf).
  • In general the forecast accuracy decreases as the number of days increases.
  • Yr.no is best for next day, but bluemix and darksky are equally good further out.
  • OpenWeatherMap and Weather underground are significantly worse.

This analysis lumps all cities together for an average result. I might do some analysis later on performance per city.

Weather forecast data


I have published several posts about weather. I also did articles with analysis of temperature and wind forecast, but there is a lot more analysis which could be done. Therefore I decided to publish the raw data in case anyone wants to analyse it. I will also do some more charting/plotting myself.

Click here to download the captured forecasts in CSV format. The file contains over 2 million records in total and the format is fairly self explanatory. It covers a period from June 2017 to December 2018, but some forecasts are missing due to a variety of factors. Most notably the Bluemix data only covers August 2017 to February 2018.

I will later post additional analysis files in this folder with some derived data from this original data in the CSV.

I recently found out about a professional analysis report comparing the accuracy of several forecast providers. I think you should value their results above mine.


Sunday, September 29, 2019

Polite new icon

I was calling someone recently and I watched the screen while waiting to see if they would pick up.  After a few seconds passed I noticed this nice icon appearing on the screen asking for understanding if the person didn't pick up.

I thought it was very cute and encouraged a polite response to someone not answering my call. Maybe it is not new, but it was my first time to notice it.

Thursday, June 13, 2019

More challenges to navigating around dublin

Visitors (and even locals) often find it hard to navigate around Dublin. One of the problems the strange custom in Dublin of assigning totally different names to different sections of the same road.  I blogged before about some of the more confusing examples of this. Another problem is the fact that the council regularly decide to change the name of a street.

Here are a few examples:
  1. Amiens Street was The Strand 
  2. Ardee Street was Crooked Staff 
  3. Aughrim Street was part of Blackhorse Lane 
  4. Back Lane was Rochel Street 
  5. Balfe Lane was Pitt Street 
  6. Belmont Avenue was Coldblow Lane 
  7. Benburb Street was Barrack Street 
  8. Bishop Street was Great Boater Lane 
  9. Blackhall Place was The Gravel Walk 
  10. Bow Lane was Elbow Lane 
  11. Bow Street was Lough Buoy 
  12. Brabazon Street was Cuckold's Row 
  13. Bridgefoot Street was Dirty Lane 
  14. Brookefield Avenue was Watery Lane 
  15. Brookefield Road was Cutthroat Lane 
  16. Camden Street was St. Kevin's Port 
  17. Cathel Brugha Street was Gregg Lane 
  18. Cathedral Lane was Cabbage Garden Lane 
  19. Chancery Place was Mass Lane 
  20. Christchurch Place was Skinners' Row 
  21. Clonliffe Road was Fortick Road 
  22. Collage Green was Hoggen Green 
  23. Constitution Hill was Glasmunogue 
  24. Dame Street was Tengmoutli Street 
  25. Dean Street was Cross Poddle 
  26. Digges Lane was Goat Alley 
  27. Dorset Street was Drumcondra Lane 
  28. Engine Alley was Indian Alley 
  29. Essex Street was Orange Street and earlier it was Smock Alley 
  30. Exchange Street Lower was The Blind Quay 
  31. Exchequer Street was Chequer Street 
  32. Foley Street was Montgomery Street and earlier it was World's End Lane 
  33. Glover's Alley was Rapparee Alley 
  34. Green Street was Abbey Green 
  35. Haddington Road was Cottage Terrace 
  36. Hammond Lane was Hangman's Lane 
  37. Harrington Street was Whitworth Street 
  38. High Street was Main Street 
  39. Hill Street was Lower Temple Street 
  40. Infirmary Road was Aberdeen Street 
  41. Island Street was Dunghill Lane 
  42. Lansdowne Road was Watery Lane 
  43. Lincoln Lane was Pudding Lane 
  44. Lincoln Place was Park Street and earlier it was St. Patrick's Well Lane 
  45. Little Green Street was Bradogue Lane 
  46. Little Ship Street was Pole Mill Street 
  47. Lower Baggot Street was Gallows Road 
  48. Lower Gardiner Street was The Old Rope Walk 
  49. Mary's Lane was Broad Street 
  50. Mercer Street was French Street 
  51. Mespil Road was Gibbet Meadow 
  52. North Brunswick Street was Channel Row 
  53. North Lotts was Newfoundland 
  54. O'Connell Street was Sackville Street 
  55. Upper O'Connell Street was Drogheda Street 
  56. Old Kilmainham was Murdering Lane 
  57. Oliver Bond Street was Mullinahack 
  58. Parnell Square was Rutland Square 
  59. Parnell Street was Great Britain Street 
  60. Pearse Street was Great Brunswick Street 
  61. Pimlico was Donour Street 
  62. Prussia Street was Cabragh Lane 
  63. Railway Street was Upper Tyrone Street and earlier it was a Part of Mecklenburgh Street (see Waterford St.) 
  64. Sackville Place was Tucker's Row 
  65. Sean McDermott Street was Gloucster Street and earlier it was Great Martin's Lane 
  66. Shelbourne Road was Artichoke Road 
  67. St. Andrew's Street was Hog Hill & earlier it was Hoggen Hill 
  68. St. Michael's Lane was Macgillamocholmog's Street 
  69. St. Stephens's Green North was Beaux Walk
  70. St. Stephen's Green South was Leeson's Walk 
  71. St. Stephen's Green East was Monk's Walk 
  72. St. Stephen's Green West was French Walk
  73. Talbot Street was Cope Street North 
  74. Townsend Street was Lazy Hill and earlier it was Lazar's Hill 
  75. Usher's Lane was Dog And Duck Yard 
  76. Waterford Street was Lower Tyrone Street and earlier it was Part of Mecklenburg Street (see Railway Street) 
  77. Wellington Street was Paradise Row 
  78. Wolfe Tone Street was Stafford Street
This is not a complete list of street name changes, but just be careful if you have an older map.