SULU 47c

Summary

* The time of the setup phase if now measured (code from Jose Caballero) and reported to the server. The new format of pilotTiming is: | | | | . Valvery Fine has updated the Panda monitor job page to reflect this change (pilotTiming interpretation). Requested by Eric Lancon et el. Note: until Nordugrid has adopted the new pilot, there will still be pilotTiming's being reported with the old format (four time fields).

* The setup procedure in the pilot has undergone a major overhaul in order to reduce the number of setup source calls.

* The special code for CERNVM has been updated (the CERNVM pilot has not been updated since last summer). The next pilot version will have additional changes, to make the CERNVM pilot [optionally] independent of the Co-Pilot framework. Requested by Predrag Buncic.

* Updated to new version of myproxyUtils (code from Jose Caballero).

* Added new service classes (SCRATCHDISK, PRODDISK) to castorSvcClassSiteMover. Requested by Alastair Dewhurst.

* The pilot is now sending _CONDOR_SLOT@nodename to the dispatcher when the _CONDOR_SLOT environmental variable is available.

Version info

Added exception handling in updateHandler::handle() (pilot)
Added timeSetup to Job class (Job)
Added timeSetup to pilotTiming in getNodeStructure() (PandaServerClient)
Added timeSetup to msgdic in updateJobInfo() (RunJobUtilities)
Added timeSetup to jobdic in updateHandler::handle() (pilot)
Now setting timeSetup in setup() (runJob)
Updated default PanDA server from voatlas48 to voatlas04 for CERNVM in updatePandaServer() (PandaServerClient)
Updated to new version of myproxyUtils (code from Jose)
Preventing job state from being set to holding at the beginning of a CERNVM job in updatePandaServer() (PandaServerClient)
Added file info to log in getLocalFileInfo() (SiteMover)
Added output directory verification in put_data() (mvSiteMover)
Now writing traceback from exceptions in get/put_data() to stderr (Mover)
Added siteroot to isForceConfigCompatible() call in findPythonInRelease() to avoid repeated SITEROOT investigation (pUtil)
Moved verifyCmtsiteCmd() from RunJobUtilities to pUtil
Added siteroot, cacheDir and cacheVer to checkCMTCONFIG() (RunJobUtilities)
Sending siteroot, cacheDir and cacheVer to verifyCMTCONFIG() in checkCMTCONFIG() (RunJobUtilities)
Returning siteroot, atlasVersion, atlasProject in checkCMTCONFIG() (RunJobUtilities)
Now extracting CMTCONFIG, SITEROOT, ATLASVERSION, ATLASPROJECT in verifyCMTCONFIG() (pUtil)
Now calling verifyCmtsiteCmd() from verifyCMTCONFIG() (pUtil)
Modified verifyCmtsiteCmd() to only process cmtsite command output and not execute the setup again (pUtil)
Changed the arguments of verifyCmtsiteCmd() from cmd1 to ec, _pilotErrorDiag (pUtil)
Default pilotErrorDiag is now "unknown" in verifyCmtsiteCmd(), reset when successful (pUtil)
Cleaned up verifyCMTCONFIG() (pUtil)
Created getProperNodeName() (pilot)
Pilot is now sending _CONDOR_SLOT@nodename with "node" in getNewJob() (pilot)
Out-commented usage of isCommandOk() to reduce the number of setup script executions (RunJobUtilities)
Changed getProxyKey from TRUE/FALSE to True/False in getNewJob() (pilot)
Added error handling of CMT output in getSiteroot() and verifyCmtsiteCmd() (pUtil)
getSiteroot() now returns tuple ec, pilotErrorDiag, status, siteroot (pUtil)
getHighestVersionDir() now returns tuple ec, pilotErrorDiag, highestVersion, siteroot (pUtil)
isForceConfigCompatible() now returns tuple ec, pilotErrorDiag, status (pUtil)
findPythonInRelease() now returns tuple ec, pilotErrorDiag, py (pUtil)
getCmtsiteCmd() now returns tuple ec, pilotErrorDiag, cmd (RunJobUtilities)
setPython() now returns tuple ec, pilotErrorDiag, pybin (RunJobUtilities)
Updated getHighestVersionDir() for getSiteroot() changes (pUtil)
Updated isForceConfigCompatible() for getHighestVersionDir() changes (pUtil)
Updated findPythonInRelease() for isForceConfigCompatible() changes (pUtil)
Updated getCmtsiteCmd() for isForceConfigCompatible() changes (RunJobUtilities)
Updated setupTrf() for getCmtsiteCmd() changes (two places) (RunJobUtilities)
Updated setupTrf() for setPython() changes (three places) (RunJobUtilities)
Updated setPython() for findPythonInRelease() changes (RunJobUtilities)
Added new service classes (SCRATCHDISK, PRODDISK) (castorSvcClassSiteMover)
Renamed OutputFiles.xml to OutputFiles-.xml (Job)