Summary
Major update. The pilot is now writing adler32 checksums for the majority of the site movers, see list below.
maxDiskCount and processingType have been added to the job definition as requested, which means that reprocessing jobs will have their max file size determined by the job definition rather than the pilot.
Version info
Now using adler32 with getLocalFileInfo (lcgcp2SiteMover, lcgcpSiteMover)
getChecksumType() now returns either 'md5sum' or 'MD', or 'adler32' or 'AD' (SiteMover)
registerFileLFC() now sets checksum type format automatically (SiteMover)
Added checksum_command to all site movers
The following site movers have adler32 enabled: lcgcp*SiteMover, rfcpLFCSiteMover, CastorSiteMover,
dCacheLFCSiteMover, BNLdCacheSiteMover, dCacheSiteMover, stormSiteMover (not used, only get function)
Created addPaths() in SiteMover
Now using seprodpath to find correct replica in getPoolFileCatalog (Mover)
Corrected dir counting in purge function (Cleaner)
Added exception messages (pilot, pUtil, runJob, SiteMover, RunJobUtilities)
Added maxDiskCount and processingType to job definition (Job)
Added handling of maxDiskCount and processingType (RunJobUtilities, Mover)
Improved error and exception handling of lfc_creatg() and lfc_addreplica() (Mover)
Added exception handling to stageInPyModules() (pUtil)
Added a two hour limit on purge function (Cleaner)
No comments:
Post a Comment