Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FLINK-34165] Update apache download url #170

Merged
merged 1 commit into from
Jan 22, 2024

Conversation

JingGe
Copy link
Contributor

@JingGe JingGe commented Jan 22, 2024

Apache changed its download link.

Copy link
Contributor

@MartijnVisser MartijnVisser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@JingGe I checked the download sites at the ASF:

dlcdn.apache.org is our CDN for downloads.a.o, which should arguably be faster than just going straight to downloads.a.o. While the CDN is global, we've had issues in certain countries where it's either slow or unavailable, hence the direct link. Using either is totally fine.

I think we can point all links to https://dlcdn.apache.org. I've verified that this works for existing/active supported versions (currently 1.18, 1.17 and 1.16) but also for older versions (1.15), because that will redirect straight to the archive.

Examples:

This all works, supported versions
https://dlcdn.apache.org/flink/flink-1.18.1/flink-1.18.1-bin-scala_2.12.tgz
https://dlcdn.apache.org/flink/flink-1.18.1/flink-1.18.1-bin-scala_2.12.tgz.asc
https://dlcdn.apache.org/flink/flink-1.18.1/flink-1.18.1-bin-scala_2.12.tgz.sha512

This doesn't work for CDN, since it's not a supported version anymore
https://dlcdn.apache.org/flink/flink-1.15.0/flink-1.15.0-bin-scala_2.12.tgz
https://dlcdn.apache.org/flink/flink-1.15.0/flink-1.15.0-bin-scala_2.12.tgz.asc
https://dlcdn.apache.org/flink/flink-1.15.0/flink-1.15.0-bin-scala_2.12.tgz.sha512

This works doesn't work for all supported/non-supported releases (binary for non-supported version is broken)
https://downloads.apache.org/flink/flink-1.18.1/flink-1.18.1-bin-scala_2.12.tgz
https://downloads.apache.org/flink/flink-1.18.1/flink-1.18.1-bin-scala_2.12.tgz.asc
https://downloads.apache.org/flink/flink-1.18.1/flink-1.18.1-bin-scala_2.12.tgz.sha512
https://downloads.apache.org/flink/flink-1.15.0/flink-1.15.0-bin-scala_2.12.tgz
https://downloads.apache.org/flink/flink-1.15.0/flink-1.15.0-bin-scala_2.12.tgz.asc
https://downloads.apache.org/flink/flink-1.15.0/flink-1.15.0-bin-scala_2.12.tgz.sha512

Edit: wait, it doesn't work for https://downloads.apache.org/flink/flink-1.15.0/flink-1.15.0-bin-scala_2.12.tgz
So, then I think we could change all of the links to dlcdn.apache.org :)

@JingGe
Copy link
Contributor Author

JingGe commented Jan 22, 2024

@MartijnVisser yes, https://dlcdn.apache.org/ is another option which works too. I will update to use that one. Thanks!

Jus out of curiosity, do you know why dlcdn wasn't used for asc in the first place?

@JingGe
Copy link
Contributor Author

JingGe commented Jan 22, 2024

BTW, there are two urls defined for tgz and asc. This PR only changes asc url. For asc, we could use cdn but the difference should be very limited. WDYT?

@MartijnVisser
Copy link
Contributor

For asc, we could use cdn but the difference should be very limited. WDYT?

I think we should keep them the same for consistency

@JingGe
Copy link
Contributor Author

JingGe commented Jan 22, 2024

I think we should keep them the same for consistency

Make sense. I am thinking why it was not consistent in the first place. (cdn was not used for asc previously)

@JingGe
Copy link
Contributor Author

JingGe commented Jan 22, 2024

There is a comment for it:

# Not all mirrors have the .asc files

# Not all mirrors have the .asc files

I think we should indeed use the direct download url. @MartijnVisser WDYT?

@JingGe JingGe force-pushed the FLINK-34165-update-apache-dl-link branch from f213fbd to 1b90d8b Compare January 22, 2024 15:39
@JingGe
Copy link
Contributor Author

JingGe commented Jan 22, 2024

Thanks @MartijnVisser for the review!

@JingGe JingGe merged commit 9a5b2d9 into apache:dev-1.18 Jan 22, 2024
1 check passed
@JingGe JingGe deleted the FLINK-34165-update-apache-dl-link branch January 22, 2024 16:45
bharathv added a commit to bharathv/redpanda that referenced this pull request Jan 23, 2024
Current URL throws a 404 and 1.18.0 is not hosted anywhere.
Also switching the download URL as per
apache/flink-docker#170
savex pushed a commit to bharathv/redpanda that referenced this pull request Jan 23, 2024
Current URL throws a 404 and 1.18.0 is not hosted anywhere.
Also switching the download URL as per
apache/flink-docker#170

ci: Update flink link to archive.apache.org
savex pushed a commit to bharathv/redpanda that referenced this pull request Jan 24, 2024
Current URL throws a 404 and 1.18.0 is not hosted anywhere.
Also switching the download URL as per
apache/flink-docker#170

ci: Update flink link to archive.apache.org
vbotbuildovich pushed a commit to vbotbuildovich/redpanda that referenced this pull request Jan 25, 2024
Current URL throws a 404 and 1.18.0 is not hosted anywhere.
Also switching the download URL as per
apache/flink-docker#170

ci: Update flink link to archive.apache.org
(cherry picked from commit a452101)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants