Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parse stdout/stderr from forward model steps for Warnings #10039

Open
berland opened this issue Feb 11, 2025 · 1 comment · May be fixed by #10050
Open

Parse stdout/stderr from forward model steps for Warnings #10039

berland opened this issue Feb 11, 2025 · 1 comment · May be fixed by #10050
Assignees

Comments

@berland
Copy link
Contributor

berland commented Feb 11, 2025

Ert wants to be able log warnings (as in all kinds of warnings) emitted from the forward model steps.

These steps run in separate subprocesses for which Erts root logger have no influence, thus such a feature must rely on text-parsing stdout and/or stderr.

(This is an alternative approach to https://github.com/equinor/scout/issues/1151)

@berland berland moved this to Todo in SCOUT Feb 11, 2025
@berland
Copy link
Contributor Author

berland commented Feb 11, 2025

There are some open questions to how this should be implemnted:

  • On the compute side (in forward_model_runner) or on the scheduler side (scheduler.py/job.py).
  • To avoid flooding logging systems with repeated messages, deduplication of warnings must be done on the scheduler side.
  • If parsing is done on the scheduler side, pay attention to CPU-cost, and whether one or every runpath should be checked.
  • Should a human and machine readable file (xml/json/whatever) be left in the runpath with a list of each warning with metadata (step name, name of parsed file, etc)?
  • Should parsing happen constantly, or when a step is finished, or when a realization is finished?

Later, it can be decided if any of this information should be added to a GUI element as in #9381

@berland berland added the needs-discussion Issues requiring further discussions label Feb 11, 2025
@berland berland self-assigned this Feb 12, 2025
@berland berland removed the needs-discussion Issues requiring further discussions label Feb 12, 2025
@berland berland moved this from Todo to In Progress in SCOUT Feb 12, 2025
@berland berland linked a pull request Feb 12, 2025 that will close this issue
9 tasks
@berland berland moved this from In Progress to Ready for Review in SCOUT Feb 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Ready for Review
Development

Successfully merging a pull request may close this issue.

1 participant