-----------------------------------------------------
DADS (Warren King) -
The DADS system continues to run well.
The 2 pipe system was released as part of DADS 7.92. This allows the operational dads to deliver data to two different OTFC pipelines: a test and an operational pipeline. The flag to set the use of the second pipeline is not available in the current version of Starview, but will be in Starview II. The flag can be set within an email message used for a retrieval request in the meanwhile.
-----------------------------------------------------
OPUS (Mike Swam) - The calibration pipeline is operating.
Mike fixed the OTFC pipeline for WFPC2 to allow group headers to be updated. The change involves moving the conversion from FITS to GEIS to an earlier stage, before getref/upref. This fix was installed in OPUS for OTFC release 1.2.
Mike developed the common switch rules system for OTFC. Lisa set up a test database system on the ROBBIE server and ran the new rules system. Steve Lubow checked the WFPC2 results with those obtained by his independent rules system. No differences were found. We are now investigating results for STIS. There appear to be some problems with recommended PHT and PCT reference files being N/A, while photcorr is now set to PERFORM with the new rules. The problem is related to the way the rules system handles switches that are not actually used to build headers. Mike has introduced a fix that sets such inapplicable keywords to perform. This change will tested out on the OTFC system on ROBBIE by Lisa. Lisa will build an isql script to perform the switch updates daily.
-----------------------------------------------------
getref/upref and CDBS (Bernie Simon) - Synphot will be using FITS files. This change will occur in Sept. FITS versions of the files will need to be listed in cdbs. This may require rearchiving these files.
-----------------------------------------------------
Change System (Lisa Gardner, Steve Lubow, & Bernie Shiao) - the globrate and cfstatus keyword corrections have been installed in the dadsotfc database on ZEPPO. So they will take effect on OTFC requests.
Lisa is developing support for the pending datasets table.
-----------------------------------------------------
STIS (Bernie Shiao, Ed Hopkins, Grace Mitchell, Melissa McGrath)
Nothing new.
Action Item: Bernie Shiao will investigate the level of effort required to retrieve the 2700 or so WAVECAL datasets. Lisa will determine the effort required to make the database changes and the ingest process changes for WAVCALs. Since there is no short-term need to change these values, this effort is of low priority.
-----------------------------------------------------
Testing (Grace Mitchell, Melissa McGrath, Steve Lubow, Steve Slowinski)
Regression testing - nothing new
Random testing - some mixed STIS and OTFC requests completed.
STIS Testing (Melissa McGrath and Grace Mitchell) - testing continues. A problem was found when a calibration switch was incorrectly set, resulting in a failure in calstis. OPUS set a flag in the response file to DADS, indicating the problem. However, the flag was not translated into a message in the user response file. So there was no indication of a problem in the email response file. This needs further work.
-----------------------------------------------------
Associations for ACS and NICMOS (Hopkins)
We should begin planning for associations. Changes will be required to the OTFC pipeline, DADS, and getref. These changes need to be coordinated with plans for the new DADS and possibly having OTFC operate as a reprocessing system.
-----------------------------------------------------
OTFC Reprocessing System
There have been some engineering discussions about having otfc rebuild the headers before calibration. In this way, many fewer keyword repairs would need to be tracked. The OTFC and the initial calibration pipelines would be in closer synch. Daryl presented two options. It appears the best is to start with the pod files. This would require DADS to translate dataset requests into pod file requests. Also OPUS would need to extract the relevant data from the pod files. The DADS catalog would only be updated when data was requested. So users would not be as well informed about dataset status through the catalog. Overall, this approach looks like the right way to go. We expect to make a decision on whether to do reprocessing in 2 weeks. The first external release of OTFC will be in its current form of not reprocessing. This new system could be made available in about 6 months.