Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lotman should dynamically adjust lots whenever cache rediscovers namespaces #1953

Open
jhiemstrawisc opened this issue Jan 28, 2025 · 0 comments
Assignees
Labels
cache Issue relating to the cache component enhancement New feature or request lotman

Comments

@jhiemstrawisc
Copy link
Member

Caches must periodically poll the Director to get namespace information, which caches use to keep a tidy auth/scitokens config. However, as namespaces come and go, Lotman should also be adjusting lots to make sure we don't wind up with unusable lot partitions.

Getting this right will be tricky, because lotman is fed usage updates as diffs by XRootD. This means that the disappearance of a namespace would currently require re-allocation of its lot's disk usage to another lot -- most likely the default lot, but that's not a guarantee. Otherwise, the incoming diffs wouldn't correctly adjust the values Lotman stores.

In addition to usage re-allocation, we should also handle adjustment of lot management policy attributes. Keep the cache full, keep the cache happy!

@jhiemstrawisc jhiemstrawisc added cache Issue relating to the cache component enhancement New feature or request lotman labels Jan 28, 2025
@jhiemstrawisc jhiemstrawisc self-assigned this Jan 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cache Issue relating to the cache component enhancement New feature or request lotman
Projects
None yet
Development

No branches or pull requests

1 participant