Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KITTI eval does not count FNs? #1692

Open
Kh-Hamed opened this issue Dec 9, 2024 · 0 comments
Open

KITTI eval does not count FNs? #1692

Kh-Hamed opened this issue Dec 9, 2024 · 0 comments

Comments

@Kh-Hamed
Copy link

Kh-Hamed commented Dec 9, 2024

Hi,

I saw the KITTI eval metric. In eval.py there is a function called do_eval. The eval_class returns a dictionary, which contains precision, recall, and aos. The problem is that after that, instead of calculating the area under the P_R curve, the function only passes ret["precision"] for the calculation final result. Is this Wrong? It does not count any of the FNs in this way. It does not use the recall values!!!
Here is the code I'm talking about:

https://github.com/open-mmlab/OpenPCDet/blob/master/pcdet/datasets/kitti/kitti_object_eval_python/eval.py#L590
image
eval

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant