Issue with Canonicalization: Unable to Save Test Outputs

[mamogaaa]

The process of saving test outputs as canonical data (Canonization) is failing due to reliance on Yandex's internal services like the sandbox, accessible only to Yandex employees. Using yatool from the YTsaurus repository.

Command Attempted:

ya make -AZ

Error Encountered:

------- [CANONIZE] {FAILED} $(B)/test/simple_test/test-results/py3test/canoniz{e.log, ation_res.json}
command /home/user/.ya/tools/v4/5523695963/test_tool3 canonize --source-root /home/user/logfather-ya-make --build-root /home/user/.ya/build/build_root/t9qn/00219e --sandbox https://sandbox.yandex-team.ru --output /home/user/.ya/build/build_root/t9qn/00219e/test/simple_test/test-results/py3test --resource-ttl 9223372036854775807 --max-file-size 153600 --log-path /home/user/.ya/build/build_root/t9qn/00219e/test/simple_test/test-results/py3test/canonize.log --result-path /home/user/.ya/build/build_root/t9qn/00219e/test/simple_test/test-results/py3test/canonization_res.json --dir-outputs --input /home/user/.ya/build/build_root/t9qn/00219e/test/simple_test/test-results/py3test --owner user --user user --mds failed with exit code 255 in /home/user/.ya/build/build_root/t9qn/00219e
2023-12-19 13:45:15,225 ERROR yalibrary.oauth: Failed to get token: No SSH keys found
================================================================================
How to setup Ya tool authorization
* By default ya tool takes your default SSH private key and exchanges it for OAuth token. For this to work
  the public key must be added to Staff and the private one must reside in one of its default locations or be provided
  by means of agent forwarding. Check if you have forwarded your SSH key to the remote host correctly.
  The ya whoami command allows you to validate the token and even prefetch it for future uses.
* There's an option to fetch the access token manually:
  https://oauth.yandex-team.ru/authorize?response_type=token&client_id=f4d36b7671004ed9850148fa645acac6
  Put the token into .ya_token file in your home directory, and set proper permissions.
  Alternatively you may set the token using env variable:
  *nix: export YA_TOKEN="<token>"
  Windows cmd: set YA_TOKEN="<token>"
  Windows PowerShell: $env:YA_TOKEN="<token>"
  Keep your access token in secret and never share it with anyone.
* If your local username differs from the Staff login, you can specify the correct login via environment variable:
  *nix: export YA_USER="<username>"
  Windows cmd: set YA_USER="<username>"
  Windows PowerShell: $env:YA_USER="<username>"
* If token is still not being fetched by ya tool, report the issue to devtools@ please.
================================================================================
2023-12-19 13:45:15,225 ERROR yalibrary.upload.uploader: Could not upload /home/user/.ya/build/build_root/t9qn/00219e/r3tmp/tmp8z0_fd1g/resource.tar.gz
Traceback (most recent call last):
  File "devtools/ya/yalibrary/upload/uploader.py", line 131, in do_upload
    return self._upload(
           ^^^^^^^^^^^^^
  File "devtools/ya/yalibrary/upload/mds_uploader.py", line 67, in _upload
    mds_token = get_mds_token(oauth_token=oauth_token)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "devtools/ya/yalibrary/upload/mds_uploader.py", line 142, in get_mds_token
    oauth_token = oauth.resolve_token(params)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "devtools/ya/yalibrary/oauth/__init__.py", line 69, in resolve_token
    raise Failure('Authorization failed')
yalibrary.oauth.Failure: Authorization failed
Traceback (most recent call last):
  File "devtools/ya/yalibrary/upload/uploader.py", line 131, in do_upload
    return self._upload(
           ^^^^^^^^^^^^^
  File "devtools/ya/yalibrary/upload/mds_uploader.py", line 67, in _upload
    mds_token = get_mds_token(oauth_token=oauth_token)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "devtools/ya/yalibrary/upload/mds_uploader.py", line 142, in get_mds_token
    oauth_token = oauth.resolve_token(params)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "devtools/ya/yalibrary/oauth/__init__.py", line 69, in resolve_token
    raise Failure('Authorization failed')
yalibrary.oauth.Failure: Authorization failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "contrib/tools/python3/src/Lib/runpy.py", line 198, in _run_module_as_main
    return _run_code(code, main_globals, None,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "contrib/tools/python3/src/Lib/runpy.py", line 88, in _run_code
    exec(code, run_globals)
  File "devtools/ya/test/programs/test_tool/bin3/__main__.py", line 5, in <module>
    exit(executor())
         ^^^^^^^^^^
  File "contrib/python/contextlib2/py3/contextlib2/__init__.py", line 181, in __exit__
    self.gen.throw(type, value, traceback)
  File "devtools/ya/test/programs/test_tool/main_entry_point/__init__.py", line 10, in configure_display
    yield display.Display(sys.stderr, formatter.DryFormatter())
  File "devtools/ya/test/programs/test_tool/main_entry_point/__init__.py", line 40, in helper
    return run()
           ^^^^^
  File "devtools/ya/test/programs/test_tool/lib/__init__.py", line 46, in run
    rc = module.main()
         ^^^^^^^^^^^^^
  File "devtools/ya/test/programs/test_tool/canonize/canonize.py", line 173, in main
    if canonical_data.canonize(suite):
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "devtools/ya/test/canon/data.py", line 463, in canonize
    upload.upload_to_mds(
  File "devtools/ya/test/canon/upload/__init__.py", line 82, in upload_to_mds
    mds_key = mds_uploader.do(
              ^^^^^^^^^^^^^^^^
  File "devtools/ya/yalibrary/upload/mds_uploader.py", line 127, in do
    return MDSUploader(work_dir).do_upload(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "devtools/ya/yalibrary/upload/uploader.py", line 137, in do_upload
    raise consts.UploadException("Could not upload {}: {}".format(uploading_path, e))
yalibrary.upload.consts.UploadException: Could not upload /home/user/.ya/build/build_root/t9qn/00219e/r3tmp/tmp8z0_fd1g/resource.tar.gz: Authorization failed
Failed