A new pilot has been released. The new features and fixes were (except for
the first one) presented at the last ADC Weekly:
* Fix for bad SE destination paths; when ATLASMCTAPE was selected, the SE
paths were not constructed correctly, now corrected.
* Setup changes for HLT jobs; previously HLT jobs were setup from AFS and
only run at CERN. Now that HLT releases are available in cvmfs, this pilot
update will enable HLT (re)processing on the grid. Requested by Camille
Bélanger-Champagne and Rod Walker for the HLT group.
* Nightlies setup change for AtlasDerivation. Requested by Johannes
Elmsheuser.
* Changes related to handling of job id string; previously the job id was
occasionally handled as an integer, but this could lead to problems with
integer conversions (long int instead of int, and a resulting L at the end
of the job id) leading to failure with reading the metadata file (it
contains the job id), seen as Nordugrid. Job id is now always a string.
Requested by Andrej Filipcic.
* New version of aria2c site mover; code contribution and comments from
Vincenzo Lavorini:
-Added a get-token for rucio in _init_ phase, which is written in a file
-using rucio token to get a metalink4
-aria2c tool is configured for using all the sources in the metalink
Sending readpar('appdir') to extractAppdir instead of thisSite.appdir which might not be updated correctly, in monitor_job (Monitor)
Added debug info to extractAppdir (SiteInformation, ATLASSiteInformation)
New version of aria2c site mover from Vincenzo Lavorini (aria2cSiteMover)
Looking for metadata file in alternative location (pilot init dir), in getPayloadMetadataFilename() (PandaServerClient)
Sending altpath (filenamePayloadMetadata) to getMetadata() from updatePandaServer() (PandaServerClient)
Added altpath argument to getMetadata() (pUtil)
Updated getMetadata() for using altpath when possible. Replaced 'id' with 'jobId' (pUtil)
Added special case for AtlasDerivation in getProperASetup() (ATLASExperiment)
Changed %d to %s for jobId conversion in cleanup() (Cleaner)
Removed repr() around jobId in put(), rename(), remove() (JobState)
Changed default jobId=0 to jobId='0' in Job class definition (Job)
Changed PandaID=%d to PandaID=%s in displayJob() (Job)
Removed int() conversion from jobId in setJobDef() (Job)
Removed str() from jobId in setJobDef() (Job)
Changed %d to %s in jobId conversion in getLogFileGuid(), postJobTask() (JobLog)
Removed str() around jobId in transferActualLogFile(), createMetadataForOutput(), addWantedFiles() (JobLog)
Removed repr() around jobId in createMetadataForOutput(), transferAdditionalCERNVMFiles() (JobLog)
Changed %d to %s for jobId in run(), updateServer(), recoverWithServer() (JobRecovery)
Changed %d to %s for jobId in __killLoopingJob(), __updateJobs(), __createJobWorkdir() (Monitor)
Removed str() from jobId in monitor_job() (Monitor)
Removed str() from jobId in getXML() (PandaServerClient)
Removed repr() from jobId in updatePandaServer() (PandaServerClient)
Changed %d to %s for jobId in cleanup(), createFileMetadata(), __main__() (RunJob)
Removed repr() from jobId in moveTrfMetadata() (RunJob)
Changed %d to %s for jobId in cleanup(), createFileMetadata(), __main__() (RunJobEvent)
Changed %d to %s for jobId in __main__() (RunJobTitan)
Removed int conversion from jobinfo["jobid"] in handle() (UpdateHandler)
Removed str conversion for jobId in __run_glexec() (glexec_utils)
Removed repr() from jobId in getMetadata() (pUtil)
Changed %d to %s in makeJobReport(), moveToExternal() (pUtil)
Removed str() from jobId in moveLostOutputFiles() (pilot)
Changed %d to %s in RecoverLostJobs(), getNewJob() (pilot)
Updated extractAppdir() for allowing AtlasP1HLT and AtlasHLT jobs anywhere (ATLASSiteInformation
Only using special setup for HLT for AFS, ie if $VO_ATLAS_RELEASE_DIR exists, in getProperSiterootAndCmtconfig(), getProperASetup() (ATLASExperiment)
Verifying that atlasProject is not already added to cmd1 in updateCmd1WithProject() (ATLASExperiment)
Updated getProperPaths() to handle non-rucio SURL properly (ATLASSiteInformation)
No comments:
Post a Comment