Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to calculate the accuracy evaluation index? #58

Closed
3600067524 opened this issue Apr 30, 2022 · 4 comments
Closed

How to calculate the accuracy evaluation index? #58

3600067524 opened this issue Apr 30, 2022 · 4 comments

Comments

@3600067524
Copy link

Hi,Thank you for your contribution! i want to konw how to calculate the line descriptor metrics.? How to know the number of correct matching lines and ground truth line matches.?
image

@rpautrat
Copy link
Member

Hi, the ground truth matches are obtained either by warping the lines from one image to another with the ground truth homography (e.g. for the Wireframe dataset), or with the ground truth depth and camera parameters (e.g. for ETH3D). When a reprojected line falls close enough to another line (with respect to a line distance metric and a given threshold), they are considered to be matched.

The evaluation scripts are not officially released, but you can find a dev and uncleaned version here: #30 (comment). I am not giving any support for it though, but you can see how the ground truth matches are obtained at least.

@3600067524
Copy link
Author

Hi!Thank you for your reply
Can you answer me that
image
print(len(matched_lines1)) and print(len(matched_lines2)) is this the total number of match lines output?
print(len(line_seg1)) Is it the total number of detection lines in img1 output?
how can i get the correct line matches from the match_lines.ipynb and the visualize_util.py?

@rpautrat
Copy link
Member

rpautrat commented May 1, 2022

Hi, yes you are correct. print(len(matched_lines1)) gives the number of matches output by SOLD2, and print(len(line_seg1)) the number of its lines detected in image 1.

You cannot obtain the ground truth matches from the notebook, because you do not have access to the depth and camera parameters necessary to unproject lines in 3D. You need to follow the instructions in previous message for that.

@3600067524
Copy link
Author

Hi!Thank you for your reply.I will try.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants