Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

您好，想请教一下微调成本。 #59

Open
DoiiarX opened this issue Jul 30, 2024 · 3 comments
Open

您好，想请教一下微调成本。 #59

DoiiarX opened this issue Jul 30, 2024 · 3 comments

Comments

@DoiiarX
Copy link

DoiiarX commented Jul 30, 2024

我希望自己学习微调模型作为游戏机器人使用。
想请问一下微调的卡数、微调时间、训练集大小是多少呢？
@CrazyBoyM
Copy link
Owner

其实最低4090单卡就能微调，用lora方式。不缺资源的话就8卡a100

@DoiiarX
Copy link
Author

DoiiarX commented Aug 5, 2024

其实最低4090单卡就能微调，用lora方式。不缺资源的话就8卡a100

那我3090应该也没问题吧。24GB可以调70b模型吗？

@CrazyBoyM
Copy link
Owner

其实最低4090单卡就能微调，用lora方式。不缺资源的话就8卡a100

那我3090应该也没问题吧。24GB可以调70b模型吗？

估计有点难，可以上deepspeed offload3试试。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@DoiiarX @CrazyBoyM