Difference between revisions of "Chirps v1.8 tasks"

From CHG-Wiki
Jump to navigationJump to search
 
(One intermediate revision by the same user not shown)
Line 2: Line 2:
 
(see also [[CHIRPS FAQ]])
 
(see also [[CHIRPS FAQ]])
  
 +
== Notes<!-- Can this be  moved to the ToDo page? -->==
 
When prelim moves to v1.8, back process to the beginning of 2013.
 
When prelim moves to v1.8, back process to the beginning of 2013.
  
Docs docs docs
+
Docs docs docs <!-- ??? -->
  
 
reorganized ftp hierarchy to be more shallow and explicit
 
reorganized ftp hierarchy to be more shallow and explicit
 
     global_monthly_tifs
 
     global_monthly_tifs
 
     africa_dekad_bils
 
     africa_dekad_bils
etc
+
etc.
  
 +
=== Data Location ===
 
       http://tinyurl.com/chg-chirps
 
       http://tinyurl.com/chg-chirps
points to,
+
points to
 
       ftp://chg-ftpout.geog.ucsb.edu/pub/org/chg/products/CHIRPS-latest/
 
       ftp://chg-ftpout.geog.ucsb.edu/pub/org/chg/products/CHIRPS-latest/
  
 
+
==CHIRPS v1.8==
 
 
 
 
  
 
As of 2014.01.27 decided to do a complete rerun of CHIRPS to be called CHIRPS v1.8
 
As of 2014.01.27 decided to do a complete rerun of CHIRPS to be called CHIRPS v1.8
  
Currently Monthly 1.7 CHIRPS were last run in mid November. These have the problem with flipping the order of the neighbors used to fill in master locations.  
+
Monthly 1.7 CHIRPS were last run in mid November 2013. These have the problem with flipping the order of the neighbors used to fill in master locations.  
  
Ingest new station data,
+
*Ingest new station data,
 
   Brazil (junior)
 
   Brazil (junior)
 
   World Bank coffee countries: Guatemala, Honduras, Nicaragua
 
   World Bank coffee countries: Guatemala, Honduras, Nicaragua
 
   Panama
 
   Panama
   New GTS? GSOD?
+
   New GTS? GSOD?  
+
*Exclude '''bad Zambia data'''
Exclude '''bad Zambia data'''
+
*Address problem Brent found with daily September data in the Horn.  
 
+
*Run some [[chirps_rchecks | reality checks]] on the station data in the db.
Address problem Brent found with daily September data in the Horn.  
+
*Verify the code fix that was flipping the neighbor list is included in this run
 
 
Run some [[chirps_rchecks | reality checks]] on the station data in the db.
 
 
 
Verify the code fix that was flipping the neighbor list is included in this run
 
 
 
  
 
Found something wrong with CHIRP data for June-August 2013. # of pixels with positive rainfall plummets. As much as 60% in S. Africa. Does not seem physically possible.
 
Found something wrong with CHIRP data for June-August 2013. # of pixels with positive rainfall plummets. As much as 60% in S. Africa. Does not seem physically possible.
  
Once all stations finalized,
+
=== Finalizing ===
 
+
Once all stations finalized:
recalc neighbor station statistics
 
recalc master locations     
 
 
 
pre-compute spi for all master locations (month/pentads)
 
  
go thru [[chirps_mqb | CHIRPS MQB]]
+
*recalculate neighbor station statistics
 +
*recalcu;ate master locations     
 +
*pre-compute [[SPI]] for all master locations (month/pentads)
 +
*go through [[chirps_mqb | CHIRPS MQB]]
 
   Merge
 
   Merge
 
   QC
 
   QC
 
   Blend
 
   Blend
 +
*Do some [[Chirps_rchecks| reality checks]] on results.
 +
*create all the related CHIRPS files.
  
Do some reality checks on results.
+
== Fixes, etc. ==
 
 
create all the related CHIRPS files.
 
 
 
 
 
----
 
'''Fixes etc.'''
 
  
 
Zambia-Met pptx here,
 
Zambia-Met pptx here,
 
     ftp://chg-ftpout.geog.ucsb.edu/pub/org/chg/products/CHIRPS-1.7/docs/Zambia-CHIRPS_problem.pptx
 
     ftp://chg-ftpout.geog.ucsb.edu/pub/org/chg/products/CHIRPS-1.7/docs/Zambia-CHIRPS_problem.pptx
  
Fixed bunch of station locations in the stations table
+
Fixed a bunch of station locations in the stations table
 
     ftp://chg-ftpout.geog.ucsb.edu/pub/org/chg/products/CHIRPS-1.7/docs/CSCD.station.cleanup.pptx
 
     ftp://chg-ftpout.geog.ucsb.edu/pub/org/chg/products/CHIRPS-1.7/docs/CSCD.station.cleanup.pptx
  
Line 69: Line 59:
 
     /home/world/masks/Global_landmask.2014.50N50S.p05Deg.tif
 
     /home/world/masks/Global_landmask.2014.50N50S.p05Deg.tif
  
CHIRP may-September 2013 glitch
+
CHIRP May-September 2013 glitch
 
     changed CHIRP calc script for a while, will redo entire CHIRP timeseries with current script
 
     changed CHIRP calc script for a while, will redo entire CHIRP timeseries with current script

Latest revision as of 14:52, 2 September 2014

(see also CHIRPS FAQ)

Notes

When prelim moves to v1.8, back process to the beginning of 2013.

Docs docs docs

reorganized ftp hierarchy to be more shallow and explicit

    global_monthly_tifs
    africa_dekad_bils

etc.

Data Location

     http://tinyurl.com/chg-chirps

points to

     ftp://chg-ftpout.geog.ucsb.edu/pub/org/chg/products/CHIRPS-latest/

CHIRPS v1.8

As of 2014.01.27 decided to do a complete rerun of CHIRPS to be called CHIRPS v1.8

Monthly 1.7 CHIRPS were last run in mid November 2013. These have the problem with flipping the order of the neighbors used to fill in master locations.

  • Ingest new station data,
  Brazil (junior)
  World Bank coffee countries: Guatemala, Honduras, Nicaragua
  Panama
  New GTS? GSOD? 
  • Exclude bad Zambia data
  • Address problem Brent found with daily September data in the Horn.
  • Run some reality checks on the station data in the db.
  • Verify the code fix that was flipping the neighbor list is included in this run

Found something wrong with CHIRP data for June-August 2013. # of pixels with positive rainfall plummets. As much as 60% in S. Africa. Does not seem physically possible.

Finalizing

Once all stations finalized:

  • recalculate neighbor station statistics
  • recalcu;ate master locations
  • pre-compute SPI for all master locations (month/pentads)
  • go through CHIRPS MQB
  Merge
  QC
  Blend

Fixes, etc.

Zambia-Met pptx here,

    ftp://chg-ftpout.geog.ucsb.edu/pub/org/chg/products/CHIRPS-1.7/docs/Zambia-CHIRPS_problem.pptx

Fixed a bunch of station locations in the stations table

    ftp://chg-ftpout.geog.ucsb.edu/pub/org/chg/products/CHIRPS-1.7/docs/CSCD.station.cleanup.pptx

Use the same landmask everywhere, avoid variations in the ocean/land boundary

   /home/world/masks/Global_landmask.2014.50N50S.p05Deg.tif

CHIRP May-September 2013 glitch

   changed CHIRP calc script for a while, will redo entire CHIRP timeseries with current script