Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ADD] Interval Join Operator Implementation #20

Open
wants to merge 70 commits into
base: master
Choose a base branch
from
Open

[ADD] Interval Join Operator Implementation #20

wants to merge 70 commits into from

Commits on Dec 11, 2023

  1. [ADD] Added new operator - Interval Join ( Key Parallelism )

    @DropB1t
    DropB1t committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    8066b5a View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2023

  1. [FIX] Fixed nondeterministic behavior of get_MergedNodes1() function

    @DropB1t
    DropB1t committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    559f5c0 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2023

  1. [FIX] Added a condition to increment the index pointer more securely

    @DropB1t
    DropB1t committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    d8676c7 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #1 from DropB1t/deterministic-merge-order 

    Deterministic merge order
    @DropB1t
    DropB1t authored Dec 13, 2023
    Configuration menu
    Copy the full SHA
    c1dd0ae View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2023

  1. [FIX] Fixed interval evaluation logic 

    Fixed watermark based purge function
    @DropB1t
    DropB1t committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    4cea4c4 View commit details
    Browse the repository at this point in the history

  2. [ADD] Added get/set StreamTag methods to all batch variants

    @DropB1t
    DropB1t committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    4268f60 View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2023

  1. [FIX] Fixed join logic function signature

    @DropB1t
    DropB1t committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    c7e4b9d View commit details
    Browse the repository at this point in the history

  2. Merge pull request #2 from DropB1t/optional-result-signature 

    [FIX] Fixed join logic function signature
    @DropB1t
    DropB1t authored Dec 15, 2023
    Configuration menu
    Copy the full SHA
    2b22340 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2023

  1. [FIX] Removed GPU's batch JoinStream tag attribute

    @DropB1t
    DropB1t committed Dec 16, 2023
    Configuration menu
    Copy the full SHA
    206057d View commit details
    Browse the repository at this point in the history

  2. [FIX] Refactored collectors logic 

    Refactored join buffer purge logic
Join operator can now run in Deterministic & Probabilistic mode
Added purge with punctuations for join operators
    @DropB1t
    DropB1t committed Dec 16, 2023
    Configuration menu
    Copy the full SHA
    7f67372 View commit details
    Browse the repository at this point in the history

  3. [FIX] Fixed tagging streams in ordering/kslack collectors

    @DropB1t
    DropB1t committed Dec 16, 2023
    Configuration menu
    Copy the full SHA
    962bab9 View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2023

  1. [ADD] Added Data Parallelism join execution mode

    @DropB1t
    DropB1t committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    4b8c9c2 View commit details
    Browse the repository at this point in the history

  2. [ADD] Added synthetic join tests

    @DropB1t
    DropB1t committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    6c2eb42 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2023

  1. [FIX] Fixed join tests 4 and 5

    @DropB1t
    DropB1t committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    d617c46 View commit details
    Browse the repository at this point in the history

Commits on Dec 31, 2023

  1. [ADD] Swappable archive's buffer structure

    @DropB1t
    DropB1t committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    779492a View commit details
    Browse the repository at this point in the history

  2. [FIX] Fixed constructor signature

    @DropB1t
    DropB1t committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    9a89bab View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2024

  1. [FIX] minor fixes

    @DropB1t
    DropB1t committed Jan 3, 2024
    Configuration menu
    Copy the full SHA
    c22c7f2 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. Added buffer A stats gathering

    @DropB1t
    DropB1t committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    5fe135e View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. Added buffer A balance measurement

    @DropB1t
    DropB1t committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    340685f View commit details
    Browse the repository at this point in the history

  2. Added stats flag macro + buffer stats structure

    @DropB1t
    DropB1t committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    09a1c3f View commit details
    Browse the repository at this point in the history

  3. type fix

    @DropB1t
    DropB1t committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    0cd06f5 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2024

  1. minor

    @DropB1t
    DropB1t committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    da7e315 View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2024

  1. minor fix

    @DropB1t
    DropB1t committed Feb 14, 2024
    Configuration menu
    Copy the full SHA
    81503b7 View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2024

  1. cleaned comments

    @DropB1t
    DropB1t committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    5ecc075 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #3 from DropB1t/join-buffer-stats 

    Join Buffers Stats Monitoring
    @DropB1t
    DropB1t authored Feb 18, 2024
    Configuration menu
    Copy the full SHA
    c86c50d View commit details
    Browse the repository at this point in the history

  3. [FIX] refactored type of tuple wrapper scruct

    @DropB1t
    DropB1t committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    3b5f357 View commit details
    Browse the repository at this point in the history

  4. [FIX] fixed join archive redundant typename

    @DropB1t
    DropB1t committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    85dce0a View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. join logic refactor

    @DropB1t
    DropB1t committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    531ceef View commit details
    Browse the repository at this point in the history

Commits on Feb 25, 2024

  1. Added interval join tests to regression 

    Fixed bounds parameters
    @DropB1t
    DropB1t committed Feb 25, 2024
    Configuration menu
    Copy the full SHA
    536d95e View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2024

  1. Bug fixes, minor refactor, test correctness check fixed

    @DropB1t
    DropB1t committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    5e7c891 View commit details
    Browse the repository at this point in the history

  2. Refactored Interval range retrieving logic

    @DropB1t
    DropB1t committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    49092c9 View commit details
    Browse the repository at this point in the history

  3. Minor fixes 

    Added comments
    @DropB1t
    DropB1t committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    e4ff80e View commit details
    Browse the repository at this point in the history

  4. Refactor getJoinRange() in join_archive.hpp

    @DropB1t
    DropB1t committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    6ca0f53 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2024

  1. Refactored archive implementation 

    Updated archive headers in wf/ffat_replica.hpp, wf/window_replica.hpp, and wf/join_archive.hpp
    @DropB1t
    DropB1t committed Mar 2, 2024
    Configuration menu
    Copy the full SHA
    14172b7 View commit details
    Browse the repository at this point in the history

  2. minor fixes

    @DropB1t
    DropB1t committed Mar 2, 2024
    Configuration menu
    Copy the full SHA
    b0c9f66 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2024

  1. fnv-1a hashing test

    @DropB1t
    DropB1t committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    2bba8e9 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2024

  1. join tests fixes

    @DropB1t
    DropB1t committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    3c146e6 View commit details
    Browse the repository at this point in the history

  2. Fix comparison function in JoinArchive and WinArchive, finished refactor

    @DropB1t
    DropB1t committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    5bad6b9 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #4 from DropB1t/archive-refactor 

    Archive refactor
    @DropB1t
    DropB1t authored Mar 4, 2024
    Configuration menu
    Copy the full SHA
    758558b View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2024

  1. Update hash function and join functor implementation

    @DropB1t
    DropB1t committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    064d9c0 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. Merge branch 'upstream/master' into interval-join

    @DropB1t
    DropB1t committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    ee60a5a View commit details
    Browse the repository at this point in the history

  2. Removed deprecated code

    @DropB1t
    DropB1t committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    82165e0 View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2024

  1. Mix refactor

    @DropB1t
    DropB1t committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    90346b2 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. Debug commit

    @DropB1t
    DropB1t committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    fdbae79 View commit details
    Browse the repository at this point in the history

  2. fixed if condition

    @DropB1t
    DropB1t committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    214fb2e View commit details
    Browse the repository at this point in the history

  3. Removed all deprecated debug features

    @DropB1t
    DropB1t committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    e1ae30e View commit details
    Browse the repository at this point in the history

  4. bug fix

    @DropB1t
    DropB1t committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    5032831 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. [ADD] join_collector for data parallelism mode in interval join opera… 

    …tors
    @DropB1t
    DropB1t committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    0508204 View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2024

  1. Fixed join_collector eosnotify logic

    @DropB1t
    DropB1t committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    37058fa View commit details
    Browse the repository at this point in the history

Commits on Mar 17, 2024

  1. Fixed RR for Single_t tuple dispatching in join_collector.hpp

    @DropB1t
    DropB1t committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    37c4d4d View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. [FIX] New round robin logic implemented

    @DropB1t
    DropB1t committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    3b612e4 View commit details
    Browse the repository at this point in the history

  2. [FIX] Fixed skewed batch bug (dp mode)

    @DropB1t
    DropB1t committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    fbe8dc6 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. Fixed fnv-1a hashing method, used uint64_t type

    @DropB1t
    DropB1t committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    f62b7a8 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. feat: new fnv1-a hash function

    @DropB1t
    DropB1t committed May 14, 2024
    Configuration menu
    Copy the full SHA
    39688f5 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Merge branch 'interval-join' into join-collector

    @DropB1t
    DropB1t authored Jun 13, 2024
    Configuration menu
    Copy the full SHA
    34166ec View commit details
    Browse the repository at this point in the history

  2. Merge pull request #6 from DropB1t/join-collector 

    Join collector
    @DropB1t
    DropB1t authored Jun 13, 2024
    Configuration menu
    Copy the full SHA
    a1ed948 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2024

  1. Fix mean buffer size calculation in printBufferStats

    @DropB1t
    DropB1t committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    805caee View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. [FIX] Enable measurement of tuple distribution in data partitioning f… 

    …or interval join operator
    @DropB1t
    DropB1t committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    fb835bc View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2024

  1. fix: Refactored whole buffer size measurement logic to be more fine-g… 

    …rained
    @DropB1t
    DropB1t committed Jul 14, 2024
    Configuration menu
    Copy the full SHA
    e3ad596 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. [FIX] Changed boundaries inclusion logic, fixed ij mode comments

    @DropB1t
    DropB1t committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    495e748 View commit details
    Browse the repository at this point in the history

  2. feat: Refactor archive size measurement logic for interval join 

    Made more coincise functions and structures naming

The commit refactors the archive size measurement logic in the interval join code to provide more fine-grained measurements. This change improves the accuracy of archive size calculations and ensures more precise tracking of archive metrics
    @DropB1t
    DropB1t committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    9a8ae98 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #7 from DropB1t/buffer-metrics-refactor 

    [ADD] Archive metrics refactor
    @DropB1t
    DropB1t authored Aug 26, 2024
    Configuration menu
    Copy the full SHA
    e02583e View commit details
    Browse the repository at this point in the history

  4. [MERGE] 'upstream/master' updates into interval-join 

    Update headers license URL in all files
Update emitter logic in Interval Join replicas
    @DropB1t
    DropB1t committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    9706a27 View commit details
    Browse the repository at this point in the history

  5. [FIX] Fixed join tests files, added interval_join.hpp as doxygen inpu… 

    …t files
    @DropB1t
    DropB1t committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    9e42d18 View commit details
    Browse the repository at this point in the history

  6. [FIX] Redesigned comments

    @DropB1t
    DropB1t committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    671a6a2 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. [ADD] Added size in KB for mean archive size

    @DropB1t
    DropB1t committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    ad634c8 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. [FIX] Added purgeArchives procedure in case of Deterministic mode exe… 

    …cution
    @DropB1t
    DropB1t committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    474801e View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. [FIX] Fixed .gitignore

    @DropB1t
    DropB1t committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    e35eb42 View commit details
    Browse the repository at this point in the history

  2. [FIX] Remove WF_JOIN_MEASUREMENT macro from CMakeLists

    @DropB1t
    DropB1t committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    c9e657e View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. [FIX] incorrect compare function type in assert evaluation in Win Arc… 

    …hive
    @DropB1t
    DropB1t committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    b3cc8b7 View commit details
    Browse the repository at this point in the history