Minutes of OTFC Mtg 4/1/99

-----------------------------------------------------

DADS (Warren King) -

The operational DADS system is now available for OTFC and appears to be working OK.

The pointer bug found in testing has been fixed. DADS 7.8.3 is in testing. The target delivery date is 4/19. OPUS 10.0 will be delivered ahead of DADS 7.8.3.

DADS support for the two destination pipes: otfc and nonotfc needs to be supported by the time OTFC is released externally. The reason is that we need to maintain two separate otfc pipelines: a test and an operational system. Code is in place to do this, but is untested. Some enhancements are needed to the front-end of DADS. This capability will first be tested on the DADS test system.

Action Item: Allen and Joel will work this out for a future DADS release.

There was a problem with files not getting decompressed when requested from the archive. The files were sent to OTFC and failed calibration. Joel was unable to reproduce the problem.

-----------------------------------------------------

OPUS (Mike Swam) - The calibration pipeline is working on artichoke.

Mike is to develop the common rules system for OTFC. Bernie Shiao will develop the database layer for the OTFC interface.

Mike and Steve S. developed a draft of procedures for operators. Mike will distribute this to Tony and others.

Steve S. will give a demo of the procedures and the OMG.

Action Item: Based on the above, Tony will further develop procedures. -----------------------------------------------------

getref/upref (Bernie Simon) - Some fixes have been made to change SKIPPED to PERFORM for WFPC2 and a change for WAVECALS. These fixes are not yet installed. Some additional software changes are needed to handle database changes in DADS 7.8.3. A new getref/upref will be installed for that release.

ACTION ITEM: Bernie will investigate getref/upref for time-tagged data.

ACTION ITEM: Bernie and Ed will investigate keyword placement for switches.

-----------------------------------------------------

Change System (Lisa Gardner, Steve Lubow, & Bernie Shiao) -

Scripts are handling the updating of the internal test system on ZEPPO to emulate the automated change system.

The automatic change system needs further development.

Action Item: Lisa is to develop support for the pending datasets table.

-----------------------------------------------------

STIS (Bernie Shiao, Ed Hopkins, Melissa McGrath) -

Action Item: Lisa will install OKR entries in the dadsotfc database, after DADS 7.8.3.

Action Item: Bernie Shiao will investigate the level of effort required to retrieve the 2700 or so WAVECAL datasets. Lisa will determine the effort required to make the database changes and the ingest process changes for WAVCALs. Since there is no short-term need to change these values, this effort is of low priority.

-----------------------------------------------------

Testing (Melissa McGrath, Steve Lubow, Steve Slowinski)

Random testing - Steve Lubow did some testing with mixed/proprietary data. The system performed correctly.

Regression and stress testing - Steve Slowinski reports continued problems with FTP in transferring data from DADS in a few precent of the cases. This is an unacceptable failure rate. The network configuration change did not help this problem. Tests by Mike Swam indicated various clues, but could not isolate the problem. The bug has been reported to VMS system support. Meanwhile, we are testing the use of rcp, in place of FTP. Thus far, the tests show rcp to work more reliably. Further testing is ongoing. There are some security issues that need to be investigated. Another possibility is to use NFS, but the transfer rates may be too slow.

Action Item: Steve Slowinski will carry out stress tests, including the case of requesting corrupted data.

Sylvia and Faith are testing the consistency of newly calibrated data between the initial pipeline and OTFC.

Melissa finsihed identifying a set of STIS data for a regression test. This will be tested just after the installation of DADS 7.8.3.

Ed is working on a tool to handle differences between the initial pipeline and OTFC data. There may be a complication when the keyword placement goes into effect. Differences will appear.

-----------------------------------------------------

CDBS (Steve L.)

There is a CDBS problem that has some impact on OTFC. The problem is that bestref sometimes assigns a value of N/A to recommended CRR files in STIS. The problem has been isolated and requires removal of CRSPLIT as a selection criterion.

--------------------------------------------------------------

Starview (Megan) - The problems with the recent Starview release are fixed.

The DADS web interface can be easily changed for OTFC. Only a few days of work are required.

Starview II is planned for release in October. There will be an internal review this summer.


OTFC Meeting: (lubow@stsci.edu)