-
Notifications
You must be signed in to change notification settings - Fork 33
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Refactor how config and test_cases.json files are handled in iree_tes…
…ts. (#164) Assorted quality of life improvements to iree_tests before we scale up to having more tests with real weights downloaded from Azure. These changes should also help as we move towards having files cached on CI test runners. * Collapse/simplify how remote files are listed from ```json "remote_file_groups": [ { "azure_account_url": "https://sharkpublic.blob.core.windows.net", "azure_container_name": "sharkpublic", "azure_base_blob_name": "sai/sd-unet-tank/", "files": [ "inference_input.0.bin", "inference_input.1.bin", ``` to ```json "remote_files": [ "https://sharkpublic.blob.core.windows.net/sharkpublic/sai/sd-unet-tank/inference_input.0.bin", "https://sharkpublic.blob.core.windows.net/sharkpublic/sai/sd-unet-tank/inference_input.1.bin", ``` (That was premature optimization, [KISS](https://en.wikipedia.org/wiki/KISS_principle), etc. etc.) * Skip downloading remote files if they exist on disk with a matching MD5 hash (requires the files to have MD5 hashes computed in Azure -- some files are missing them) * Relax JSON parsing code to tolerate omitted fields (e.g. instead of requiring `"skip_run_tests": [],`, you can now omit it) * Add a `"file_format": "test_cases_v0",` marker to JSON files and look for that instead of a specific file name * Print file sizes while downloading, e.g. ```bash $ python download_remote_files.py Processing future-pytorch-models\llama-tank\test_cases.json Downloading 'llama-tank.mlirbc' (128.44 MiB) to 'future-pytorch-models\llama-tank' Processing future-pytorch-models\sd-clip-tank\test_cases.json Skipping 'inference_input.0.bin' download (local MD5 hash matches) Skipping 'inference_output.0.bin' download (local MD5 hash matches) Skipping 'inference_output.1.bin' download (local MD5 hash matches) Downloading 'real_weights.irpa' (469.46 MiB) to 'future-pytorch-models\sd-clip-tank' ```
- Loading branch information
Showing
15 changed files
with
268 additions
and
224 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
# Not stored in Git (128MB file, too large for Git LFS), fetch on demand | ||
llama-tank.mlirbc |
12 changes: 3 additions & 9 deletions
12
iree_tests/future-pytorch-models/llama-tank/test_cases.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
20 changes: 7 additions & 13 deletions
20
iree_tests/future-pytorch-models/sd-clip-tank/test_cases.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.