Wednesday, July 22, 2009

UHURA 37m

Summary

* Wrong guid problem. The previous pilot version generated a new guid for an output file if it failed to read the guid from the PoolFileCatalog file during job recovery. The pilot will now generate an error instead, 1123/EXEPANDA_MISSINGGUID/"Missing guid in output file list". It is not known why the pilot could not read the guid from the PFC in the found cases since the batch logs are only available for a short time.

* The storage paths for output files in LocalSiteMover are now generated in the same way as in lcgcp site movers.

* It is now possible to setup analysis trfs on Nordugrid. Andrej is testing.

* Corrected the Nordugrid trf setup for Athena post 14.5 (same as Graeme's fix from v 37l).

* For analysis jobs killed by users, the pilot will now kill the running processes in reverse order so that the athena process is killed first. Also, the time delay between the SIGTERM and SIGKILL signals has been increased from 10 to 60s (after killing the first process) to allow the athena stdout buffer to be properly flushed.

Version info
General cleanup for LocalSiteMover by Charles
Corrected destination path in put_data() (LocalSiteMover)
Created getAnalysisTrf() (RunJobUtilities)
Added analysis trf download for Nordugrid, replaced code with getAnalysisTrf() (RunJobUtilities)
Created setupNordugridTrf() (RunJobUtilities)
Corrected the Nordugrid trf setup for Athena post 14.5 (RunJobUtilities, Graeme's fix from v 37l)
Reversed order of processes to be killed so that athena is killed first (pilot)
Increased time delay between pilot SIGTERM and SIGKILL from 10 to 60s to allow athena stdout buffer to be flushed (pilot)
Added new error code (ERR_MISSINGGUID) (PilotErrors, runJob, pilot)
PFCxml now return an error code when it encounters a missing guid (pUtil, pilot, runJob)
Added 1122 (ERR_NOLFCSFN) to recoverable list (PilotErrors)
Hardcoded schedconfig settings for ANALY_BNL_test (pUtil)

No comments: