reproduce the nuscenesces tensorboard result

[TianhaoFu]

hi,
I wonder to know how to reproduce the vista nuscenes leaderboard result?

thanks!
@AndlollipopDE @lzhnb @szubing @Yuxin-Wen

[TianhaoFu]

also i test the provided model and got such performance, which is a litter lower
mAP: 0.6283 mATE: 0.2925 mASE: 0.2452 mAOE: 0.2573 mAVE: 0.1980 mAAE: 0.1967 NDS: 0.6952

could you help me ,thanks very much! :)

[AndlollipopDE]

Are these performances on val set? Or you submit results to test server? With double flip testing?

[TianhaoFu]

Are these performances on val set? Or you submit results to test server? With double flip testing?

thanks for your reply!

yes, this is performance on val set with tta! @AndlollipopDE

[AndlollipopDE]

Then these performances are exactly the same as we reported in the README. One thing to know is that the performances on test server are different from the ones on val set. If you upload the test set results to the server, I believe it will produce the same performance as the ones shown on the leaderboard.