Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a tag for the assets of a given model run name #96

Open
mykelalvis opened this issue Jan 21, 2025 · 1 comment
Open

Add a tag for the assets of a given model run name #96

mykelalvis opened this issue Jan 21, 2025 · 1 comment

Comments

@mykelalvis
Copy link
Contributor

It would be very helpful for debugging and killing zombies if all the assets created for a run had some easily human-typable name that aggregated them in the console.

A package like haikunatorpy could easily be used to produce such a name.

Giving all the assets a tag that allows us to aggregate them more easily, as well as informing the user of the contents of that tag so that they can report it when they experience a failure, will allow us to react more decisively and eliminate some of the uncertainty around whether a resource can be safely terminated.

@patrick-tripp
Copy link
Member

This is now implemented in the branch mainPR-20250106

https://github.com/ioos/Cloud-Sandbox/tree/mainPR-20250106

Install the HaikunatorPy library before using:
https://github.com/Atrox/haikunatorpy

pip3 install haikunator

Changes:

  • It prepends a random two word prefix to the Name tag for each cluster node.
  • This branch also implements the requirement to specificy a cluster config file when the workflow is launched with the workflow_main.py script. Example: ./workflows/workflow_main.py ./test.cora.cfg job/jobs/test.hsofs.short
    A usage error message will be given if it is not specified.
  • Also liveocean_hindcasts can use the same workflow_main.py script instead of the one-off launch script it was using before.
  • All previous hsofs/cora fixes from other branches have been merged in to this one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants