-
Notifications
You must be signed in to change notification settings - Fork 4.1k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[source-klaviyo] - Update to CDK v3.9.0 (#42121)
- Loading branch information
Showing
13 changed files
with
102 additions
and
78 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
32 changes: 32 additions & 0 deletions
32
...egrations/connectors/source-klaviyo/source_klaviyo/components/klaviyo_backoff_strategy.py
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,32 @@ | ||
# | ||
# Copyright (c) 2024 Airbyte, Inc., all rights reserved. | ||
# | ||
|
||
import logging | ||
from typing import Optional, Union | ||
|
||
import requests | ||
from airbyte_cdk.sources.streams.http.error_handlers import DefaultBackoffStrategy | ||
from source_klaviyo.exceptions import KlaviyoBackoffError | ||
|
||
|
||
class KlaviyoBackoffStrategy(DefaultBackoffStrategy): | ||
def __init__(self, max_time: int, name: str) -> None: | ||
|
||
self._max_time = max_time | ||
self._name = name | ||
|
||
def backoff_time( | ||
self, response_or_exception: Optional[Union[requests.Response, requests.RequestException]], **kwargs | ||
) -> Optional[float]: | ||
|
||
if isinstance(response_or_exception, requests.Response): | ||
if response_or_exception.status_code == 429: | ||
retry_after = response_or_exception.headers.get("Retry-After") | ||
retry_after = float(retry_after) if retry_after else None | ||
if retry_after and retry_after >= self._max_time: | ||
raise KlaviyoBackoffError( | ||
f"Stream {self._name} has reached rate limit with 'Retry-After' of {retry_after} seconds, exit from stream." | ||
) | ||
return float(retry_after) if retry_after else None | ||
return None |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters