[8.0] Use plain proxy for pilot bundle

[sfayer]

Hi,

As discussed at the last BiLD meeting, I've been looking at the problem of the bundled proxy expiring in the middle of the pilot job, causing various failures (as this is no longer renewed like the proxy delegated via the CE).

Here is an implementation of my proposed fix: Instead of using the proxy that's used to submit the job to the CE (which is capped by the VO's maximum VOMS lifetime), we generate a new vanilla proxy (with the lifetime set to a multiple of the expected maximum runtime) to send in the bundle. The pilot then uses this new proxy to report back to DIRAC which doesn't need VOMS. This is the same approach we were previously using in the CloudCE (where pilot runtime could easily be 2+ weeks for efficiency reasons).

I've done basic testing and it seems to fix the problems I was initially seeing, seemingly without creating any new issues.

Regards,
Simon

BEGINRELEASENOTES
*WorkloadManagement
CHANGE: Use plain proxy for the pilot bundle
ENDRELEASENOTES

[sfayer]

I think that's the sitedirector test fixed for this patch now... The one remaining failure appears to be a random one.

[aldbr]

Yes I reran the test, it looks good!

[DIRACGridBot]

Sweep summary

Sweep ran in https://github.com/DIRACGrid/DIRAC/actions/runs/11834680708

Failed:

• integration
  cherry-pick 37b625a into integration failed
  check merge conflicts on a local copy of this repository

  git fetch upstream
  git checkout upstream/integration -b cherry-pick-2-37b625a44-integration
  git cherry-pick -x -m 1 37b625a44
  # Fix the conflicts
  git cherry-pick --continue
  git commit --amend -m 'sweep: #7886 Use plain proxy for pilot bundle' --author='Simon Fayer <sf105@ic.ac.uk>'
  git push -u origin cherry-pick-2-37b625a44-integration
  
  # If you have the GitHub CLI installed the PR can be made with
  gh pr create \
       --label 'sweep:from rel-v8r0' \
       --base integration \
       --repo DIRACGrid/DIRAC \
       --title '[sweep:integration] Use plain proxy for pilot bundle' \
       --body 'Sweep #7886 `Use plain proxy for pilot bundle` to `integration`.
  
  Adding original author @sfayer as watcher.
  
  BEGINRELEASENOTES
  *WorkloadManagement
  CHANGE: Use plain proxy for the pilot bundle
  ENDRELEASENOTES
  Closes #7889'