Difference between revisions of "CHIRPS Reality Checks"
Line 81: | Line 81: | ||
'''Costa Rica''' | '''Costa Rica''' | ||
− | Costa Rica similarly experienced significant flooding in much of the country [ftp://ftp.cpc.ncep.noaa.gov/fews/cent_amer_threats/camerhaz20150625.pdf ], also missed by NOAA/FEWS. | + | Costa Rica similarly experienced significant flooding in much of the country [ftp://ftp.cpc.ncep.noaa.gov/fews/cent_amer_threats/camerhaz20150625.pdf ], also missed by NOAA/FEWS. However, it was picked up by TRMM. |
'''Ethiopia''' | '''Ethiopia''' |
Revision as of 14:26, 30 September 2015
CHIRPS v2.0 monthly Reality Checks
Contents
Background
A team of data analysts routinely quality check each month’s CHIRPS data before its release. This page documents major points of these Reality Checks. Rchecks country highlights has information that CHIRPS users may find helpful, for example, notes about major rainfall anomalies in the data. Notes on Rchecks resources is information for CHG to continually improve the Reality Checks process. Rcheck is a hands-on approach that helps enable a quality product for hazards monitoring and other scientific activities. In Reality Checks we examine the data visually via the Early Warning Explorer and separately using calculated statistics. Ancillary information, such as FEWS NET datasets, news reports, and government meteorological reports, are frequently used in the process. Rchecks has been successful in: 1) Validating anomalous wet and dry events around that world as shown by CHIRPS, 2) catching inaccurate station reports that would have otherwise negatively influenced the dataset, such as creating false droughts, 3) checking that the semi-automated flow CHIRPS data creation is working correctly, 4) identifying weaknesses and strengths of the algorithm and data inputs, which helps in planning improvements in future versions.
August 2015
Rchecks country highlights
North Korea Removal of a GSOD station. DPRK experienced flooding associated with seasonal rains in early August, and from Tropical Cyclone Goni on 22-23 August, affecting South Hwanghae and North Hamgyong Provinces ([1],[2]) . The two GTS stations in the country are in these areas and reported heavy rains, which the CHIRPS reflects near these areas. GSOD stations (~12) in rest of the country report below average rain, making August an overall poor month for rain in DPRK. This has likely exacerbated the problems associated with late start to seasonal rainfall-- in June DPRK declared they were experiencing the 'worst drought in a century.' There have been major population impacts in the region, perhaps due to a combination of weather and political forces. Suggest removal of GSOD station #274228: Report is 9.19 mm in area with flooding. [3]
South Korea CHIRPS dry anomaly confirmed. Stations show low August rainfall (verified by news reports), which has created an overall poor season there [4]. Makes North Korea dryness believable also.
China Some cases of good stations not influencing CHIRPS local values. Saw several instances when neighboring stations swamped what looks like reasonable above average rainfall reports from some stations. Led to below average CHIRPS values in these areas. Examining monthly decorrelation distance maps may help identify scope of problem.
Ghana Concern about station reports and conditions. Several stations reported 0-10 mm in August. These had some influence on CHIRPS. Were deemed ok stations as they had reasonable values in earlier months and seasonal rains have been below average due to active ITCZ enhanced rains in an abnormally northern position. Note: In July 2015 Ghana had only 1 reporting station in CHIRPS, as compared to 5-13 in other months.
Ethiopia Exceptional dryness identified by ranked z scores. Z score=-2.6, station value=160 mm, Ethiopia highlands (10.33N, 37.740E). Determined CHIRPS value in area was representative of conditions. Also that this is an area of potential concern that needs highlighting on Hazards report-- GeoWRSI shows crops were in reproductive phase in August; Prelim CHIRPS shows September 1-10 was below average; ARC2 shows below average thru September there also.
India Incorrect wet anomaly in northern India. India's Met Department shows below average ([5]), but CHIRPS shows strongly above average. Due to combination of: 0 India stations in area + very wet observation in NE Pakistan (verified by reports) + wet station in China + CHIRP shows wet anomaly. Otherwise, CHIRPS correctly identified August rainfall deficits across most of India and surplus in Bhutan.
Chile Atacama desert, possible problem. Reports say significant rain in Atacama desert ([6] ,[7]) , which rounds to 15 mm instead of 5; CHIRPS isn’t really picking it up as it’s a very fine difference, but as that area is a desert area, that small increase in rainfall resulted in massive flooding and evacuation. CHIRPS showed significant precipitation inland of Concepcion, which agrees with rain and snow reports ([8]). Santiago: CHIRPS wet anomaly confirmed. Report ([9]) details increased rain, which is showing up in CHIRPS.
Uruguay CHIRPS wet anomaly confirmed. CHIRPS recorded above average rainfall for Uruguay for August 2015. The rainfall throughout the country, according to CHPClim, tends to be between 60 and 90 mm; however, CHIRPS reported it ranging from 190 to 240 mm, with the south-eastern coast receiving between 300 and 340mm for the month. This increase in rainfall is backed up by reports, including one from “floodlist” ([10]).
Burkina Faso (added 9/23/15) Station near capital (Ouagadougou) flooded in August, but CHIRPS didn’t pick it up. However, CHIRPS did pick up the rest of the flooding in the country.
Notes on Rchecks resources
Regarding the rchecks-2.files: Reminder. The zscores in rchecks-2.files are not station zscores. They are zscores of CHIRPS data that has been placed at that station's pixel. Using the zscores in these files is helpful for identifying extreme CHIRPS that are caused by extreme station values. Using the zscores is not helpful for identifying stations that do not have influence much on CHIRPS BUT give bad reports (had concerns about this for some stations in Ghana, see above). We discussed routinely isolating a value that indicates this, so that we know which stations have issues. Basically we would do a sorting of the country information based on this value, like we do with the zscores (check.txt). Something to look into more. Also, we corrected a bug that limited the number of recheck text files. Now should have all countries.
Contributors: Laura Harrison, Marty Landsfeld, Emily Williams; 9/17/15
July 2015
Rchecks country highlights
Ethiopia July’s r-check had quite a few high z-scores. Upon analysis, these discrepancies were coming from the highlands, near Addis Ababa, and south of Addis Ababa. Station (10.33, 37.74; in town of Debre Markos) reported much lower than CHIRP and CHPClim, in the same way it reported low for August 2015. Station (8.86, 39.92; in town of Metehara Merti, near Addis Ababa) also reported much lower than CHIRP and CHPClim. ARC2 tells a similar story; ARC2 dictates the area having received 200-300mm[11]. ARC2’s anomaly map for July also roughly matched CHIRPS’ anomaly map, at a decrease of around -200m of normal[12]. One report stated “July’s seasonal rains did not come this year…” [13], while anther confirmed that “the rain condition was ok for the first ten days during the month of June. It gradually declined and we started experiencing shortage in rain in July. But conditions are good in August…it has occurred several times in the past, including in 2005.”[14]. The July rains (that didn’t come this year) tend to climb north-east across the highlands throughout June, July and August, the area showing a shortage in rain. It seems the stations are correct and Ethiopia experienced a drought this summer. However, due to the decreased number of stations since August 2014, it is possible that these stations are overestimating the level of drought.
Sudan CHIRPS and CHIRP both indicate that in southwest Sudan, June was had normal rainfall, July was dry, and August returned to normal rainfall (aka summer rains came late). The proximity of the area to the Ethiopian highlands means it followed similar trends as seen in Ethiopia, as backed up by previous reports. HOWEVER, CHIRPS completely missed mass flooding in Darfur in July[15]; for that same time of mass flooding, CHIRPS reported a decrease in rainfall.
Burkina Faso We may have a faulty station (or stations) in northeast Burkina Faso. The two stations are located at (14.03, -0.033; stn 277004); one reported 482 mm of rain, CHIRP reported 129, and CHPClim 117; the other station seems to bring the number ranges from 0-10. These stations combined, though, are driving up the CHIRPS rainfall estimates. One report does state that regular rain started mid-July [16]. However, most reports indicate that the northeastern area had decreased, not increased, rainfall in July [17]; NOAA/FEWS NET reports for July show dryness as well in the west and southwest [18] [19] [20] [21] [22].
Guatemala CHIRPS is fairly accurately picking up a drought in Guatemala, but may be overestimating it in some areas. Station (-88.59, 15.74) has a high value (154) compared to CHIRP (104), and yet CHIRPS is drug down for that pixel (84). There is a neighboring station in Honduras that has an extremely low station value that is most likely over-influencing CHIRPS, creating exaggerated estimates of low rainfall for Guatemala. Reports confirm the drought's severity: TRMM (anomaly and time series) shows drought in the north and west of the nation (-100- -200), in concurrence with CHIRPS (-200- - 300), and written articles confirm the precip data ; ftp://ftp.cpc.ncep.noaa.gov/fews/cent_amer_threats/camerhaz20150723.pdf. CHIRPS is picking up the drought around El Salvedor and in southern Honduras, but again might be overestimating the drought in Guatemala.
Flooding occurred in July in Chinaulta (southeast) [23] ; CHIRP and TRMM both reported higher than average rainfall in that area, but CHIRPS reported higher rainfall only along the coast and drought in Chinaulta. The underestimation of precipitation by CHIRPS might again be the influence of the station in the north of Honduras. It seems that stations are having too high an influence, especially when they are all reporting the same phenomenon and are then influencing another with the opposite (ex//drought all around, but flooding in Chinaulta).
Honduras see above CHIRPS shows a more extreme drought in the West than CHIRP shows, but TRMM reports similarly, suggesting CHIRPS is accurately reporting the drought and CHIRP underestimated it[24].
Contributors: Emily Williams; 9/23/15 - 9/24/15
June 2015
Rchecks country highlights
Honduras CHIRPS reported Honduras having experienced flooding around the capital and the northern Caribbean coast. The flooding in the center was backed up by reports [25]. However CHIRP reporting higher rainfall than the stations. Mid-June, Hurricane Bill formed along Honduras's northern coast, which could account for the flooding. However, NOAA/FEWS does not report any flooding, and in fact reports dryness along the Southwest of the country [26].
Nicaragua CHIRPS picked up some significant rainfall (anomaly of +30-50mm) along Western Nicaragua. It was confirmed that the flooding seen in CHIRPS is roughly the pattern of flooding experienced on the ground [27]. NOAA/FEWS did not pick up this flooding in their reports [28].
Costa Rica Costa Rica similarly experienced significant flooding in much of the country [29], also missed by NOAA/FEWS. However, it was picked up by TRMM.
Ethiopia CHIRPS reporting lower-than-average rainfall for Ethiopia's highlands, which seems to be in line with the summer's drought. Compared to ARC1 estimates [30], CHIRPS might be overestimating the drought at this point, but it is nonetheless present. NOAA/FEWS have not captured the severity and distribution, and even declared "no drought" in Ethiopia at the end of June [31].
Kenya Flooding in Nairobi that CHIRPS didn't catch [32]. Other general trends in climate are echoed by ARC1 [33]. There is a station in the southeast of Kenya (in the town of Mombasa) which reported a higher-than-average value for CHIRPS, but a low station value; this same area was subject to flooding [34].
In May, flooding in Mombasa, picked up by CHIRPS [35].
Madagascar CHIRPS reporting higher-than-average rainfall along Madagascar's eastern coastline.
Senegal One station is reporting an abnormally low value (7mm) for June, when CHIRP puts it around 100mm. However, Arc2 shows a decline in rainfall for that area in June [36]. The station looks ok for other months; may be good to keep an eye on though.
MaliStation reporting a low value (99) in an area that tends to get 127; CHIRPS is reporting 139 for this area. The area is on the slope of a mountain, though, and on a rain gradient, so it's likely that the station is correct.
GhanaCHIRPS failed to pick up flooding in coastal town of Accra during "biggest storm in the past 20 years" [37]. The station failed to pick it up, which is probably why CHIRPS didn't get it (station said 154mm, while the report said 250 mm in only the first 3 days.
Contributors: Emily Williams; 9/28/15