Reward Model training framework for LLM RLHF. For in-depth understanding of Reward modeling, checkout our blog The word nemesis originally meant the distributor of fortune, neither good nor bad, simply in due proportion to each according to what was deserved.
- Inference
from transformers import AutoModelForSequenceClassification, AutoTokenizer
MODEL = "shahules786/Reward-model-gptneox-410M"
model = AutoModelForSequenceClassification.from_pretrained(MODEL)
tokenizer = AutoTokenizer.from_pretrained(MODEL)- Training
python src/training.py --config-name <your-config-name>- All contributions are welcome. Checkout #issues