How to access public bucket in AWS S3

[kevinpan45]

I use Java Binding to collect OpenNeuro Datasets, but when I list object in code, the request return 403, what should i do for this error.

Error message

Exception in thread "main" org.apache.opendal.OpenDALException: PermissionDenied (permanent) at List::next => S3Error { code: "AccessDenied", message: "Access Denied", resource: "", request_id: "T27BQ3PG49CJE5MG" }

Context:
uri: https://s3.us-east-1.amazonaws.com/openneuro.org?delimiter=%2F&list-type=2&prefix=ds005619%2F
response: Parts { status: 403, version: HTTP/1.1, headers: {"x-amz-bucket-region": "us-east-1", "x-amz-request-id": "T27BQ3PG49CJE5MG", "x-amz-id-2": "oHGyceLhSyQUmrII5a/nJIf7oiH/wHzrCkx6sLZiLALg+uUeDwcS7a59QNdptV2MELxCdz9ioMs=", "content-type": "application/xml", "transfer-encoding": "chunked", "date": "Wed, 27 Nov 2024 07:41:44 GMT", "server": "AmazonS3"} }
service: s3
path: ds005619/
listed: 0

    at org.apache.opendal.Operator.list(Native Method)
    at org.apache.opendal.Operator.list(Operator.java:108)
    at tech.kp45.bids.bridge.collector.openneuro.sdk.OpenNeuroSdk.main(OpenNeuroSdk.java:60)

OpenNeuro aws cli command
aws s3 sync --no-sign-request s3://openneuro.org/ds005619 ds005619-download/

[Xuanwo]

I use Java Binding to collect OpenNeuro Datasets, but when I list object in code, the request return 403, what should i do for this error.

Hi, please try configuring allow_anonymous = true while setup the operator.

[kevinpan45]

I use Java Binding to collect OpenNeuro Datasets, but when I list object in code, the request return 403, what should i do for this error.

Hi, please try configuring allow_anonymous = true while setup the operator.

I had add this config and test in java and python binding, it's not work , code and error see blow
python

java

[Xuanwo]

Hi, I assume you have the S3 configuration set up locally and it has been loaded. Please also set disable_config_load = true and disable_ec2_metadata = true.

I have tested over google colab: https://colab.research.google.com/gist/Xuanwo/19de269745fcce110438b10255b6eaf2/object.ipynb

[kevinpan45]

It works. I have aws cli configure in local machine, I had test disable_config_load and allow_anonymous before, but not add disable_ec2_metadata , I will do some research of these settings, thanks.