Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pull and build containers in PDC_TMP #25

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

mahesh-panchal
Copy link
Collaborator

Containers are usually built in $HOME which has a small quota, and can result in pipelines failing.

This changes where the containers are pulled and built ( when converting from docker images ) to PDC_TMP which is private to the user, has no quota limit, and only remains there for 30 days.

The final container images are still copied to the NXF_SINGULARITY_CACHEDIR after they've been built so they're available to everyone.

@Estel-Kitsune Estel-Kitsune self-assigned this Nov 20, 2024
@Estel-Kitsune
Copy link

Hi, I am creating a folder for Hydroglyphus on Dardel, I will try with these modifications.

@mahesh-panchal
Copy link
Collaborator Author

This will only take effect when a new container is pulled. Unless you're adding a new process, you shouldn't see an effect as the containers will be in the shared cache already.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants