Tuesday, September 30, 2008

UHURA 26a

Summary
Massive update. If the schedconfig lfchost field is set for a US site, the pilot will assume that

LFC is to be used for file registration.
The grid/voms proxies are now checked before the pilot is asking for a job. The proxy must be valid for 24h as opposed to only 2h before.
Mario's dq2SiteMover has been added and is ready for testing.
If the pilot option '-u self' is set, then the pilot will ask the dispatcher for a job belong to the user that submitted the pilot (requested by Dan for use with the GangaRobot). WARNING: how does this affect brokering?

Version info
Added new error code 1120 (PilotErrors)
Ready to fail (not activated) when the space token does not match the destination path
(pilot, runJob, lcgcpSiteMover)
Only sending release info to dispatcher for non-LCG sites (pilot)
Specified csumtype in getLocalFileInfo calls (pilot, pUtil)
Rearranged some code in put_data to alleviate adler32 update (SiteMover)
Using CMD_CHECKSUM from config to getFileInfo (runJob)
Using CMD_CHECKSUM instead of md5sum in PFCxml() (pUtil)
Final pilot server updates increased from 5 to 10 (RunJobUtilities)
Proxy validity changed from 2h to 24h (SiteMover)
Now checking voms proxy before grid proxy, returns after voms proxy check if valid (SiteMover)
Created verifyProxyValidity() (pUtil)
Pilot is now checking proxy before asking for a job (pilot)
Now sending lfn and guid to put_data (Mover)
Added lfc error strings in addChecksum() (SiteMover)
Added fsize to addChecksum() (SiteMover)
Added $SITEROOT to setPython(), findPythonInRelease() (pUtil, RunJobUtilities)
Created getPoolFileCatalog() in Mover
Renamed all outxml to xml_from_PFC in Mover
Renamed _getPoolFileCatalog() to getPoolFileCatalogDQ2() in Mover
Created registerFileLFC() in SiteMover
LFC file registration done per file in Mover after succesful transfer (Mover)
All initial tolog message will now be written to initial pilotlog file (pilot)
Renamed argument tmpdir to extradir in runJobRecovery() (pilot)
Created getLFCPath() in SiteMover (SiteMover, lcgcpSiteMover, lcgcp2SiteMover, rfcpLFCSitMover, CastorSiteMover)
verifyProxyValidity() now returns error code and diag (pUtil, pilot)
Updated setPython(), default interpreter is now python (RunJobUtilities)
Activated soft link to athena stdout as requested by NG (pilot)
Created createSoftLink() (pilot)
Added code for requesting a job for a special proxy (pilot, pUtil)
Added dq2SiteMover from Mario Lassnig (dq2SiteMover)
Added error codes for dq2SiteMover (PilotErrors)
Removed undeclared jobrec variable in pUtil
Treating userflag 'self' as 'user' in isSameType() (pUtil)
Removed redundant sflag global (pilot)
Corrected timeout handling (lcgcpSiteMover, lcgcp2SiteMover)
Corrected call location of postProcessQueuedata() (pilot)
Now dumping athena metadata to log (pilot)
Moved creation of job definition backup file (pilot)

No comments: