Skip to content

Commit

Permalink
fix(benchmarks) Update medical evaluation readme (#4171)
Browse files Browse the repository at this point in the history
  • Loading branch information
yan-gao-GY authored Sep 11, 2024
1 parent 4558995 commit 1adc02d
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions benchmarks/flowertune-llm/evaluation/medical/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,9 @@ huggingface-cli login

## Generate model decision & calculate accuracy

> [!NOTE]
> Please ensure that you use `quantization=4` to run the evaluation if you wish to participate in the LLM Leaderboard.
```bash
python eval.py \
--peft-path=/path/to/fine-tuned-peft-model-dir/ \ # e.g., ./peft_1
Expand Down

0 comments on commit 1adc02d

Please sign in to comment.