UHURA 38a

Summary

The code has many internal changes (such as code optimizations as suggested by Charles Waldman) but of more general interest are the following new features and fixes:

* Get and put functions in lcgcp/cr site movers are now using the proper timeout options depending on which LCG-Utils version is available locally. The current options are: --connect-timeout=300 --sendreceive-timeout=3600. Transfers on sites using older LCG-Utils versions have -t 3600. Problems were seen during the testing phase at Brunel where the new timeout options caused segmentation violations with lcg-cp. A site wide reinstallation of the command solved the problem. A similar problem is also seen at UNI-DORTMUND. Due to known difficulties with debugging jobs on this site (stdout logs are not available) Rod has set the site offline until we have solved the problem there.

* Direct access mode is now available for analysis sites using dCache in combination with the following site movers: dCacheSiteMover, BNLdCacheSiteMover, lcgcpSiteMover, lcgcp2SiteMover. Direct access mode was previously only available for xrootd sites. (LocalSiteMover will be updated next).

* Direct access can now be skipped for individual files (RAW files e.g.) via job attribute prodDBlockToken.

* Correction for missing ./ in the trf name for Nordugrid analysis trfs.

Version info

Created isNewLCGVersion (SiteMover)
get and put functions are now using the proper timeout option depending on the LCGUtils version (lcgcpSiteMover, lcgcp2SiteMover)
Now using dictionary get method with pdict (lcgcpSiteMover, lcgcp2SiteMover, xrootdSiteMover, xrdcpSiteMover, dCacheSiteMover, dCacheLFCSiteMover, castorSvcClassSiteMover, BNLdCacheSiteMover, SiteMover, mvSiteMover, rfcpLFCSiteMover)
get_data() is now properly using copysetupin and not only copysetup to get the direct access info (xrdcpSiteMover, xrootdSiteMover)
Added prodDBlockToken to Job() class (Job)
Added 'access' attribute to mover_get_data() used for controlling direct access mode on a per file basis (Mover)
prodDBlockToken is now used by get_data() (xrootdSiteMover, xrdcpSiteMover, dCacheSiteMover, BNLdCacheSiteMover, lcgcpSiteMover, lcgcp2SiteMover)
Corrected missing ./ in trfName (setupNordugridTrf()) for Nordugrid analysis trfs (RunJobUtilities)
Created verifyCMTCONFIG2() test code (pUtil)
Added code for testing forceConfig parameter (RunJobUtilities)
Added cmtConfig to Job class (Job)