⚡️ Speed up method Stream._get_checkpoint_reader
by 134% in PR #45701 (lazebnyi/source-stripe-salesforce-add-convert-to-concurrent-stream
)
#45720
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
⚡️ This pull request contains optimizations for PR #45701
If you approve this dependent PR, these changes will be merged into the original PR branch
lazebnyi/source-stripe-salesforce-add-convert-to-concurrent-stream
.📄
Stream._get_checkpoint_reader()
inairbyte-cdk/python/airbyte_cdk/sources/streams/core.py
📈 Performance improved by
134%
(1.34x
faster)⏱️ Runtime went down from
66.6 microseconds
to28.4 microseconds
Explanation and details
Here are several optimizations made to your script for improved runtime performance.
StreamSlice
toMapping
.try-except
blocks.The code has been refactored to eliminate repeated type checks, streamline the logic for selecting the next slice, and minimize unnecessary function calls. These changes should maintain the existing functionality while improving the runtime performance.
Correctness verification
The new optimized code was tested for correctness. The results are listed below.
✅ 1 Passed − ⚙️ Existing Unit Tests
(click to show existing tests)
✅ 0 Passed − 🌀 Generated Regression Tests
(click to show generated tests)
🔘 (none found) − ⏪ Replay Tests