We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
it's long time for waiting after postprocessing.
I'm evaluating seedbench_lite.
The text was updated successfully, but these errors were encountered:
It's because saving the samples take long time, maybe seedbench's doc contains too much information.
doc
You could try to remove --log_samples to see if that accelerate the log.
--log_samples
But for long run, you may need to hack to the lines to make sure the results are not too big.
lmms-eval/lmms_eval/loggers/evaluation_tracker.py
Lines 198 to 205 in 16f2c6b
Sorry, something went wrong.
No branches or pull requests
it's long time for waiting after postprocessing.
I'm evaluating seedbench_lite.
The text was updated successfully, but these errors were encountered: