Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Concurrent Low-Code] ConcurrentDeclarativeSource class that low-code connectors can inherit from to uptake Concurrent CDK #46662

Open
wants to merge 52 commits into
base: master
Choose a base branch
from
Open

[Concurrent Low-Code] ConcurrentDeclarativeSource class that low-code connectors can inherit from to uptake Concurrent CDK #46662

wants to merge 52 commits into from

Commits on Sep 23, 2024

  1. initial work to create the ConcurrentDeclarativeSource that can run i… 

    …n the concurrent framework
    @brianjlai
    brianjlai committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    1130a74 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Merge branch 'master' into brian/concurrent_declarative_source

    @brianjlai
    brianjlai committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    54a1f85 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. adding more tests and fixing bugs for only syncing streams in catalog… 

    … and correctly merging intervals
    @brianjlai
    brianjlai committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    0bd2deb View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. Merge branch 'master' into brian/concurrent_declarative_source

    @brianjlai
    brianjlai committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    2ad65d9 View commit details
    Browse the repository at this point in the history

  2. fix a few more merge conflict errors

    @brianjlai
    brianjlai committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    8861054 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. Fix tests and add cursor granularity to the cursor partition generator

    @brianjlai
    brianjlai committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    aa55ab7 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. integrate YamlDeclarativeSource with ConcurrentDeclarativeSource and … 

    …fix bugs found during functional testing
    @brianjlai
    brianjlai committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    4288b8d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into brian/concurrent_declarative_source

    @brianjlai
    brianjlai committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    1650e30 View commit details
    Browse the repository at this point in the history

  3. rebase, formatting, fix tests, add new test cases for concurrency level

    @brianjlai
    brianjlai committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    98c42a7 View commit details
    Browse the repository at this point in the history

  4. forgot to remove change to test

    @brianjlai
    brianjlai committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    0f79069 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2024

  1. fix mypy errors and a few others bugs and testing

    @brianjlai
    brianjlai committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    5992e19 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into brian/concurrent_declarative_source

    @brianjlai
    brianjlai committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    6a160c0 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. add logic to skip streams using non-thread safe stream_state, pr feed… 

    …back, adding more tests
    @brianjlai
    brianjlai committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    b09311f View commit details
    Browse the repository at this point in the history

  2. fix formatting and mypy checks

    @brianjlai
    brianjlai committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    0180e11 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into brian/concurrent_declarative_source

    @brianjlai
    brianjlai committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    0c0c019 View commit details
    Browse the repository at this point in the history

  4. fix more mypy

    @brianjlai
    brianjlai committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    61dfb9b View commit details
    Browse the repository at this point in the history

  5. mypy

    @brianjlai
    brianjlai committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    5dd1121 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. pr feedback and updates to source-sentry for testing

    @brianjlai
    brianjlai committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    7bd3056 View commit details
    Browse the repository at this point in the history

  2. sentry lockfile

    @brianjlai
    brianjlai committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    bef1c03 View commit details
    Browse the repository at this point in the history

  3. update base image

    @brianjlai
    brianjlai committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    c2e3bdb View commit details
    Browse the repository at this point in the history

  4. bump amplitude dependencies and versions for testing

    @brianjlai
    brianjlai committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    9116da6 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into brian/concurrent_declarative_source

    @brianjlai
    brianjlai committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    80186ca View commit details
    Browse the repository at this point in the history

  6. add logging for incremental streams that are not thread safe

    @brianjlai
    brianjlai committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    1242296 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'master' into brian/concurrent_declarative_source

    @brianjlai
    brianjlai committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    b74b942 View commit details
    Browse the repository at this point in the history

  8. remove amplitude version bump

    @brianjlai
    brianjlai committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    99bee1e View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. get rid of stream_state interpolation in sentry

    @brianjlai
    brianjlai committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    15cb6dd View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. whatever

    @brianjlai
    brianjlai committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    9b5eb62 View commit details
    Browse the repository at this point in the history

  2. parse DatetimeBasedCursorModel to ConcurrentCursor, bugfixes, pr feed… 

    …back
    @brianjlai
    brianjlai committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    b82c21c View commit details
    Browse the repository at this point in the history

  3. formatting + mypy

    @brianjlai
    brianjlai committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    6a91848 View commit details
    Browse the repository at this point in the history

  4. fix mypy by replacing empty tuple() with None to make it truly optional

    @brianjlai
    brianjlai committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    15127a7 View commit details
    Browse the repository at this point in the history

  5. remove local cdk from sentry

    @brianjlai
    brianjlai committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    977c525 View commit details
    Browse the repository at this point in the history

  6. update lockfile

    @brianjlai
    brianjlai committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    4e38c4e View commit details
    Browse the repository at this point in the history

  7. swapped updating lockfiles

    @brianjlai
    brianjlai committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    f7f3e9d View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. reducing granularity of events stream cursor partitions which only su… 

    …pports second precision
    @brianjlai
    brianjlai committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    7ab1bf1 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. Merge branch 'master' into brian/concurrent_declarative_source

    @brianjlai
    brianjlai committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    69aa511 View commit details
    Browse the repository at this point in the history

  2. add more complete testing of the datetimebasedcursor model to concurr… 

    …ent cursor transformation
    @brianjlai
    brianjlai committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    626e78d View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. add concurrency to chargebee and fix usage of epoch timestamps

    @brianjlai
    brianjlai committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    e5efec4 View commit details
    Browse the repository at this point in the history

  2. extra space

    @brianjlai
    brianjlai committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    b571301 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into brian/concurrent_declarative_source

    @brianjlai
    brianjlai committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    c131645 View commit details
    Browse the repository at this point in the history

  4. fix mypy errors

    @brianjlai
    brianjlai committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    10431bc View commit details
    Browse the repository at this point in the history

  5. formatting

    @brianjlai
    brianjlai committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    3fa228f View commit details
    Browse the repository at this point in the history

  6. fix lockfile and remove jira

    @brianjlai
    brianjlai committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    96cf12b View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. fix spec command

    @brianjlai
    brianjlai committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    2ca0f74 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Maxi297/fix streams interface (#46995)

    @maxi297
    maxi297 authored Oct 25, 2024
    Configuration menu
    Copy the full SHA
    55b53df View commit details
    Browse the repository at this point in the history

  2. add is_resumable to concurrent DefaultStream

    @brianjlai
    brianjlai committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    13b9ccb View commit details
    Browse the repository at this point in the history

  3. remove lockfile changes to individual connectors

    @brianjlai
    brianjlai committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    d13a1e6 View commit details
    Browse the repository at this point in the history

  4. update sentry lockfile

    @brianjlai
    brianjlai committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    c9e1441 View commit details
    Browse the repository at this point in the history

  5. fix tests and increase retry attempts

    @brianjlai
    brianjlai committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    32941cc View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2024

  1. reduce chargebee concurrency to 1 for testing

    @brianjlai
    brianjlai committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    651be92 View commit details
    Browse the repository at this point in the history

  2. test keeping the cursor on the declarative stream

    @brianjlai
    brianjlai committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    f21b209 View commit details
    Browse the repository at this point in the history

  3. remove cursor on the declarative stream

    @brianjlai
    brianjlai committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    57127bc View commit details
    Browse the repository at this point in the history

  4. remove chargebee concurrency for testing

    @brianjlai
    brianjlai committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    5054469 View commit details
    Browse the repository at this point in the history