Skip to content

Commit

Permalink
Add Llama3.1 1B HTP to benchmark
Browse files Browse the repository at this point in the history
  • Loading branch information
Github Executorch committed Dec 19, 2024
1 parent 62016d6 commit fc3ccb4
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 5 deletions.
3 changes: 1 addition & 2 deletions .ci/scripts/gather_benchmark_configs.py
Original file line number Diff line number Diff line change
Expand Up @@ -33,8 +33,7 @@
],
"android": [
"qnn_q8",
# TODO: Add support for llama3 htp
# "llama3_qnn_htp",
"llama3_qnn_htp",
],
"ios": [
"coreml_fp16",
Expand Down
7 changes: 4 additions & 3 deletions .github/workflows/android-perf.yml
Original file line number Diff line number Diff line change
Expand Up @@ -132,10 +132,10 @@ jobs:
matrix: ${{ fromJson(needs.set-parameters.outputs.benchmark_configs) }}
fail-fast: false
with:
runner: linux.2xlarge.memory
runner: linux.4xlarge.memory
docker-image: executorch-ubuntu-22.04-qnn-sdk
submodules: 'true'
timeout: 60
timeout: 120
upload-artifact: android-models
upload-artifact-to-s3: true
secrets-env: EXECUTORCH_HF_TOKEN
Expand Down Expand Up @@ -243,10 +243,11 @@ jobs:
export PYTHONPATH=$(pwd)/..
DOWNLOADED_PATH=$(bash .ci/scripts/download_hf_hub.sh --model_id "${HF_MODEL_REPO}" --subdir "original" --files "tokenizer.model" "params.json" "consolidated.00.pth")
python -m examples.qualcomm.oss_scripts.llama3_2.llama -- \
python -m examples.qualcomm.oss_scripts.llama3_2.llama \
--checkpoint "${DOWNLOADED_PATH}/consolidated.00.pth" \
--params "${DOWNLOADED_PATH}/params.json" \
--tokenizer_model "${DOWNLOADED_PATH}/tokenizer.model" \
-b "cmake-out" \
--compile_only \
--ptq 16a4w \
-m SM8650 \
Expand Down

0 comments on commit fc3ccb4

Please sign in to comment.