Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Information about ZSP metrics #8

Open
AlbertoRemus opened this issue Jan 24, 2024 · 0 comments
Open

Information about ZSP metrics #8

AlbertoRemus opened this issue Jan 24, 2024 · 0 comments

Comments

@AlbertoRemus
Copy link

AlbertoRemus commented Jan 24, 2024

Hi!

By launching the script in "paper" configuration (5 tgt views, 50 correspondences, K-Means)

I get the following results

bicycle Acc 30: 67.0%
hydrant Acc 30: 24.0%
motorcycle Acc 30: 83.0%
teddybear Acc 30: 36.0%
toaster Acc 30: 43.0%
overall Acc 15: 30.55%
overall Acc 30: 45.35%
overall median error: 40.00860786437988 deg
overall mean error: 72.36980981090664 deg

which differ from the results in the main paper
Screenshot from 2024-01-24 22-53-18+

The difference in accuracy 15, 30 degrees is in the order of 1-3 degrees, but median error is completely different and I would like to track down where the issue is

In this zip you can see the script I used to extract results from the logs included for reproducibility
zsp.zip

Alberto

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant