Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: renew the session token when the token expires #683

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

MqllR
Copy link

@MqllR MqllR commented Dec 5, 2023

This PR fix #678

In a Kubernetes context, when running a very long process, we can easily fall into the ExpiredToken error. In order to not introduce any performance degradation, I propose to keep to global variable caching the session token but clear it when catching this specific error. The session will be renewed by reading again the projected volume /var/run/secrets/eks.amazonaws.com/serviceaccount/token.

@MqllR MqllR requested a review from a team as a code owner December 5, 2023 14:44
@MqllR MqllR requested review from igungor and sonmezonur and removed request for a team December 5, 2023 14:44
@MqllR MqllR force-pushed the token_renew_token branch 3 times, most recently from e98687f to 3e46e7e Compare December 6, 2023 11:50
@MqllR MqllR force-pushed the token_renew_token branch from 3e46e7e to 6706169 Compare December 6, 2023 11:56
@jasonyic
Copy link

jasonyic commented Dec 26, 2023

this is also an issue on our side and could speed up the review & release process? thank you.

storage/s3.go Outdated

useSharedConfig := session.SharedConfigEnable
useSharedConfig := session.SharedConfigDisable
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this an accidental change?

@l1n
Copy link

l1n commented Aug 1, 2024

+1, this would be great to have!

@tooptoop4
Copy link

@MqllR does the error only happen if s5cmd runs for more than hour? or it happens when trying to run short s5cmd on pod that is older than an hour?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

ExpiredToken error when cp large dataset
5 participants