UHURA 42e

Summary

* Begun process of tailing the brief pilot error diagnostics (not completed). Long error messages were previously cut off by the 256 char limit on the server side, which often lead to the actual error not being displayed. Some (not yet all) error messages will now be tailed (i.e. the tail of the error message will be shown and not only the beginning of the string). Requested by I Ueda.

* Now grabbing the number of events from non-standard athena stdout info strings (which are different for running with "good run list"). See discussion in Savannah ticket 62721.

* Added dCache sub directory verification (which in turn is used to determine whether checksum test or file size test should be used on output files). Needed for sites that share dCache with other sites. Requested by Brian Bockelman et al.

* Pilot queuedata downloads are now using new format for retrieving the queuedata from schedconfig. Not yet added to autopilot wrapper. Requested by Graeme Stewart.

* DQ2 tracing report now contains PanDA job id as well as hostname, ip and user dn (a DQ2 trace can now be traced back to the original PanDA job). Requested by Paul Nilsson(!)/Angelos Molfetas.

* Size of user workdir is now allowed to be up to 5 GB (previsouly 3 GB). Discussed in separate thread. Requested by Graeme Stewart.

Version info
Created tailPilotErrorDiag() (pUtil)
Now tailing pilotErrorDiag when adding it to node structure in updatePandaServer() (pilot)
Removed unused maxinputsize variable from get_data(), mover_get_data() (Mover)
Made MAX_INPUT_SIZE local instead of global, moved to getMaxInputSize() (Mover/pUtil)
Mover getMaxInputSize() from Mover to pUtil
Created getLocalSpaceLimit() (pUtil)
Added transfer verification to get_data()/put_data() (dq2SiteMover)
Added protection around getNumberOfEvents() against non-standard info strings in athena stdout (runJob)
Now grabbing number of events from non-standard info strings as well in getNumberOfEvents() (RunJobUtilities)
Removed useless variable fname from get_data() (lcgcpSiteMover, lcgcp2SiteMover)
Created setHTTPProxies() (pUtil, pilot)
Created getAvailableReleases() (pilot)
Created checkLocalDiskSpace() (pilot)
Renamed checkLocalSpace() to checkLocalDDMSpace() (pilot)
Removed psport from getNewJob() (pilot)
Added subdir verification in isPNFSVisible() (SiteMover)
Passing sitename to getLocalSpaceLimit() to exempt CERNVM from large local space limit (pilot)
Renamed global variable loopingLimit to loopingLimitDefault and corrected for multi-jobs (pilot)
Created checkSpecialEnvVars() and moved it outside getJob loop (pilot)
Now using Graeme's new method in getQueuedata() for downloading queuedata (pUtil)
Added more info to tracing report in getInitialTracingReport() (Mover)
Increased localspacelimit_user from 3 to 5 GB (pilot)
Removed unused error codes in putErrorCodes list (PilotErrors)