Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The problem of view dependent prompt #5

Open
DSaurus opened this issue Dec 7, 2023 · 3 comments
Open

The problem of view dependent prompt #5

DSaurus opened this issue Dec 7, 2023 · 3 comments

Comments

@DSaurus
Copy link

DSaurus commented Dec 7, 2023

It appears that the SMPLX coordinate system is not aligned with the threestudio coordinate system, resulting in incorrect view-dependent prompts during generation. For instance, an azimuth angle of around -180 should represent a side view, but it currently also corresponds to a back view.

problem
view

@alvinliu0
Copy link
Owner

Hi:

Many thanks for pointing out this problem! I guess there could be some camera coordinate-related issues. Currently, it's OK since we have the per-view body skeleton as an input condition, so the generation correctness is guaranteed by structural guidance (i.e., even if we give a wrong view-dependent prompt of back-view, the skeleton can tell the model it's actually a side-view).

Thanks again for notifying this and we will update it in later commits:)

Best

@y6216886
Copy link

y6216886 commented Dec 19, 2023

@alvinliu0 Hello, have you updated this issue, I also came across this issue, resulting in one human face in the front view and one human face in the back view.

@XiaokunSun
Copy link

@alvinliu0 Hello, have you updated this issue, I also came across this issue, resulting in one human face in the front view and one human face in the back view.

Hi, the bugs don't seem to be fixed!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants