Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bad controllability for box condition. #102

Open
swc-17 opened this issue Nov 6, 2024 · 2 comments
Open

Bad controllability for box condition. #102

swc-17 opened this issue Nov 6, 2024 · 2 comments

Comments

@swc-17
Copy link

swc-17 commented Nov 6, 2024

Hi, thanks for your great work.
I build a model sharing the same camera/box encoder with Magicdrive, without map condition and BEVControlNet, and set all params in UNet trainable. After trained for 100 epochs, I found the generated images do not match with box condition well, for some boxes, the images do not have foreground objects at the corresponding location. Any suggestions on this? And I wonder how many epochs is the released model trained for? 350e as in the config? Thanks!

@swc-17
Copy link
Author

swc-17 commented Nov 6, 2024

clipboard-image-1730862149

@flymin
Copy link
Member

flymin commented Nov 18, 2024

without map condition and BEVControlNet, and set all params in UNet trainable.

We never tried to train like this. You may adjust the parameters, like learning rate or batch size, to optimize the training process.

Typically, 100 epochs should be fine in most cases. The release model is trained with 350 epochs to optimize the results for quantitative evaluation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants