Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kto训练有计划支持desirable weight和undesirable weight参数吗 #6245

Closed
1 task done
xjtulien opened this issue Dec 5, 2024 · 1 comment
Closed
1 task done
Labels
solved This problem has been already solved

Comments

@xjtulien
Copy link

xjtulien commented Dec 5, 2024

Reminder

  • I have read the README and searched the existing issues.

System Info

Reproduction

Expected behavior

Others

如题

@github-actions github-actions bot added the pending This problem is yet to be addressed label Dec 5, 2024
@hiyouga
Copy link
Owner

hiyouga commented Dec 5, 2024

kto_chosen_weight: float = field(
default=1.0,
metadata={"help": "The weight factor of the desirable losses in KTO training."},
)
kto_rejected_weight: float = field(
default=1.0,
metadata={"help": "The weight factor of the undesirable losses in KTO training."},
)

@hiyouga hiyouga added solved This problem has been already solved and removed pending This problem is yet to be addressed labels Dec 5, 2024
@hiyouga hiyouga closed this as completed Dec 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
solved This problem has been already solved
Projects
None yet
Development

No branches or pull requests

2 participants