Summary
* A site mover for using CHIRP either as primary of secondary output file transfer has been included. Secondary output transfer refers to the transfer of an output file to a user specified destination (for fast file access) after a successful primary transfer to the SE. Rodney Walker has prepared a wiki with more details:
https://twiki.cern.ch/twiki/bin/view/Atlas/ChirpForUserOutput
The CHIRP site mover is also expected to be used for primary output file transfers for CERNVM from the user machine to an intermediary storage area. A stand-alone tool (based on PanDA pilot) currently in development will be responsible for the final transfer from the intermediary storage area to the SE.
* In preparation for AthenaMP, the pilot now sets an env variable (ATHENA_PROC_NUMBER) for the number of cores. If new schedconfig.corecount is set, the pilot will use this number. If it is set to -1, the pilot will grab the number of cores using /proc/cpuinfo (courtesy of Adrian Taga and Douglas Smith). If not set, the env variable will not be set either.
Version info
Added CHIRP based site mover (SiteMoverFarm, ChirpSiteMover)
Added dispatchDBlockTokenForOut to mover_put_data() (Mover)
Created chirp_put_data(), called from mover_put_data() (Mover)
Added dispatchDBlockTokenForOut to Job() (Job)
Updated setJobDef() for dispatchDBlockTokenForOut (Job)
Added dispatchDBlockTokenForOut to mover_put_data() call in stageOut() (runJob)
Added dispatchDBlockTokenForOut to mover_put_data() calls in moveLostOutputFiles() and transferLogFile() (pilot)
Created set/getNumberOfCores (Node)
Out-commented occationally misleading info about number of transferred root vs non-root files (Mover)
No comments:
Post a Comment