Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Full Object Checksum API #2026

Merged
merged 6 commits into from
Dec 7, 2024

Conversation

klauspost
Copy link
Contributor

Add support for full object checksums as described here:

https://docs.aws.amazon.com/AmazonS3/latest/userguide/checking-object-integrity.html

To enable, use ChecksumCRC64NVME, ChecksumFullObjectCRC32 or ChecksumFullObjectCRC32C as checksum type when uploading.

Mint tests updated, but can be disabled with MINT_NO_FULL_OBJECT=anything env var.

PR will fail against community MinIO without above env var.

Validated against AWS S3.

Add support for full object checksums as described here:

https://docs.aws.amazon.com/AmazonS3/latest/userguide/checking-object-integrity.html

To enable, use `ChecksumCRC64NVME`, `ChecksumFullObjectCRC32` or `ChecksumFullObjectCRC32C` as checksum type when uploading.

Mint tests updated, but can be disabled with `MINT_NO_FULL_OBJECT=anything` env var.

PR will fail against community MinIO without above env var.
@klauspost klauspost requested a review from aead December 3, 2024 17:10
utils_test.go Outdated Show resolved Hide resolved
utils.go Outdated Show resolved Hide resolved
functional_tests.go Outdated Show resolved Hide resolved
Copy link
Contributor

@fwessels fwessels left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@harshavardhana harshavardhana merged commit fdef7d2 into minio:master Dec 7, 2024
5 checks passed
@klauspost klauspost deleted the full-object-checksums branch December 8, 2024 15:57
klauspost added a commit to klauspost/minio that referenced this pull request Dec 8, 2024
harshavardhana pushed a commit to minio/minio that referenced this pull request Dec 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants