Changes related to spill-over jobs
- Trf switches over to another output file when max size is reached, but some files are empty; Pilot builds new output file list using info from jobReport, skips empty files
- Wrong filename convention used by the trf; spill-over files should end with "_NNN" not but with "._NNN"; new trf’s fixed but also fixed in pilot
- Number of events not reported correctly by the pilot when several output files were created; now reporting largest number of events among the different file formats
- Issues seen with some HC test jobs due to spill-over changes; Pilot uses output file list from jobReport when available, but some test jobs had additional files listed in jobReport that are not supposed to be transferred to SE -> pilot failed the jobs (fixed by Tadashi)
- Pilot is already running at IN2P3-CC_MCORE_HIMEM since last week
Removed internal subtraction of 2 GB from maxwdir
- Requested hack in place since last April
- Now outdated and led to activated jobs at DESY-ZN not being picked up
- Requested by Rodney Walker
Test import of lfc module removed
- Caused problem on US site where LFC bindings are no longer installed
- Requested by David Lesny
Setting pilot exit code zero instead of general error when no jobs available (as returned to the wrapper)
- Requested by Jose Caballero
Added optional . in reg exp for discovery of additional output files, in discoverAdditionalOutputFiles() (FileHandling)
Created extractOutputFilesFromJSON(), getJobReport(), filterSpilloverFilename(), getOutputFileItem(), getDestinationDBlockItems(), getNumberOf\
Events() (FileHandling)
Now using extractOutputFilesFromJSON() instead of discoverAdditionalOutputFiles() in __main__() (RunJob)
Removed testImportLFCModule() (ATLASExperiment, AMSTaiwanExperiment, NordugridATLASExperiment)
Removed obsolete 2 GB subtraction from the maxinputsize in getMaxInputSize(), requested by Tadashi Maeno (pUtil)
Not setting general error when dispatcher has no jobs, but zero, in getJob(); requested by Jose Caballero (pilot)
No comments:
Post a Comment