Skip to content

WIP: pulsar file collector#370

Draft
mvdbeek wants to merge 16 commits intogalaxyproject:masterfrom
mvdbeek:offline_collector
Draft

WIP: pulsar file collector#370
mvdbeek wants to merge 16 commits intogalaxyproject:masterfrom
mvdbeek:offline_collector

Conversation

@mvdbeek
Copy link
Member

@mvdbeek mvdbeek commented Jun 28, 2024

No description provided.

@mvdbeek mvdbeek force-pushed the offline_collector branch 3 times, most recently from 8d4e7e9 to 71085e2 Compare November 11, 2024 12:38
This should be the general strategy for collecting input and output
files for ARC, DIRAC, AWS batch etc.
@mvdbeek mvdbeek force-pushed the offline_collector branch 2 times, most recently from bfbb3c3 to fe2dd39 Compare November 13, 2024 12:14
mvdbeek and others added 6 commits November 13, 2024 16:19
Change base image from `conda/miniconda3` (based off Debian Stretch) to `python:3.12-bookworm`. Miniconda is not required in the base image.

Add the Galaxy Depot repository, which provides SLURM DRMAA packages for Debian Buster and newer releases.

Do not install the package `apt-transport-https`, it is now a dummy package, see https://packages.debian.org/en/bookworm/apt-transport-https. Install the package `slurm` instead of `slurm-llnl`.

Newer versions of the `munge` package include the binary `/usr/sbin/mungekey` instead of `/usr/sbin/create-munge-key`. Nevertheless, the key seems to be created automatically when installing the package, as running `mungekey` yields 'mungekey: Error: Failed to create "/etc/munge/munge.key": File exists'.
Build wheel automatically when building the Docker image. Exclude the source code from the output image through a multistage build.
Restore original test behavior but adapting the code to make room for a new test `CliCommandLineAppConfigTestCase`.

For now, remove the draft code for `CliCommandLineAppConfigTestCase`.
`"files_endpoint"` is the name used and expected throughout the rest of the code (including test_cli_submit.py).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants