Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

imagenet-100 result cannot reproduce #6

Closed
zhaoedf opened this issue May 31, 2022 · 5 comments
Closed

imagenet-100 result cannot reproduce #6

zhaoedf opened this issue May 31, 2022 · 5 comments

Comments

@zhaoedf
Copy link

zhaoedf commented May 31, 2022

for cifar and imagenet-1000, i can get similar results as what paper reported.
how ever, for imangenet-100 only, i cannot get the same result, with 3~4% deviation.

the followings are my running scripts and experiment results.

scipts

bash train.sh 6,7
--options options/data/imagenet100_10-10.yaml options/data/imagenet100_order1.yaml options/model/imagenet_dytox.yaml \
--name dytox \
--data-path ~/ilsvrc2012 \
--output-basedir ./checkpoints

results (i ran two times on different machines)

image

image

i focus on both avg and last acc.

@arthurdouillard
Copy link
Owner

Hello, I've saw your issue. I'll first look into #5, which may (or not) explain your issue and #2

I'll get back to you asap. Sorry for the inconvenience.

@zhaoedf
Copy link
Author

zhaoedf commented Jun 2, 2022

Hello, I've saw your issue. I'll first look into #5, which may (or not) explain your issue and #2

I'll get back to you asap. Sorry for the inconvenience.

ok, i totally understand.

@GengDavid
Copy link

Hi @arthurdouillard
I also tried ImageNet-100 and got a similar result as @zhaoedf.

BTW, I wonder that is it possible to share your trained checkpoints with us?

@GengDavid
Copy link

Hi all, I also tried ImageNet-1000 but got a lower result:(
I am using Pytorch 1.10.1, CUDA 10.1
dytox_imgnet
I'll try to use a different Pytorch version and try again.

@arthurdouillard
Copy link
Owner

Please see erratum.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants