v1.25.0 #4111

romange announced in Announcements

romange
Nov 11, 2024
Maintainer

Dragonfly v1.25.0

Some prominent changes include:

FT.SEARCH fixes: fix(search_family): Temporary remove the error when a field name does not have the '@' sign at the beginning in the FT.AGGREGATE command #3956 fix(search_family): Fix indexes loading in the FT.SEARCH and Ft.AGGREGATE commands #3955 fix(search_family): Fix crash in FT.PROFILE command for invalid queries #4043
Prefix search - supporting queries like "@color:{gre* | orange | yellow*}: feat(search): Prefix search for tags #3972
GCS save/load support chore: support load/save from GCS #4006
Few Improvements around replication/snapshotting - it should be more efficient around large entries feat(server): dont use channel for replication / save df #4041
zrevrank/zrank support withscore option feat(zset_family): support WITHSCORE in zrevrank/zrank commands (#3921) #4001

What's Changed

chore: ignore applying the same cluster config twice by @BorysTheDev in chore: ignore applying the same cluster config twice #3932
test: add test to reproduce a lot of memory consumtion during migration by @BorysTheDev in test: add test to reproduce a lot of memory consumtion during migration #3939
chore(refactoring): header clean ups by @romange in chore(refactoring): header clean ups #3943
chore: get rid of ToUpper call and use AsciiStrToUpper by @romange in chore: get rid of ToUpper call and use AsciiStrToUpper #3944
chore: remove ToUpper calls in main_service by @romange in chore: remove ToUpper calls in main_service #3947
chore: get rid of ToUpper/ToLower mutations on arguments by @romange in chore: get rid of ToUpper/ToLower mutations on arguments #3950
chore(facade): Fix bad new IO glue by @dranikpg in chore(facade): Fix bad new IO glue #3940
feat: track request sizes histograms by @romange in feat: track request sizes histograms #3951
chore: pass SinkReplyBuilder and Transaction explicitly. Part1 by @romange in chore: pass SinkReplyBuilder and Transaction explicitly. Part1 #3946
chore: disable test_cluster_memory_consumption_migration by @kostasrim in chore: disable test_cluster_memory_consumption_migration #3948
fix(search_family): Temporary remove the error when a field name does not have the '@' sign at the beginning in the FT.AGGREGATE command by @BagritsevichStepan in fix(search_family): Temporary remove the error when a field name does not have the '@' sign at the beginning in the FT.AGGREGATE command #3956
chore: tune test_rss_used_mem_gap by @kostasrim in chore: tune test_rss_used_mem_gap #3958
test: add test to test big collections or collections with big values by @BorysTheDev in test: add test to test big collections or collections with big values #3959
chore: increase load in test_noreply_pipeline by @kostasrim in chore: increase load in test_noreply_pipeline #3960
chore(fakeredis): Enable JSON tests in the Fakeredis tests by @BagritsevichStepan in chore(fakeredis): Enable JSON tests in the Fakeredis tests #3773
chore: add defrag logic for zsets by @kostasrim in chore: add defrag logic for zsets #3836
chore: pass SinkReplyBuilder and Transaction explicitly. Part2 by @romange in chore: pass SinkReplyBuilder and Transaction explicitly. Part2 #3954
chore: pass SinkReplyBuilder and Transaction explicitly. Part3 by @romange in chore: pass SinkReplyBuilder and Transaction explicitly. Part3 #3966
fix: crash if we OOM during migration process by @BorysTheDev in fix: crash if we OOM during migration process #3968
fix(cluster): fix backoff on unknown migration by @andydunstall in fix(cluster): fix backoff on unknown migration #3965
chore: pass SinkReplyBuilder and Transaction explicitly. Part4 by @romange in chore: pass SinkReplyBuilder and Transaction explicitly. Part4 #3967
chore: get rid of MutableSlice by @romange in chore: get rid of MutableSlice #3952
chore: reduce dependency of debug/memory commands on ConnectionContext by @romange in chore: reduce dependency of debug/memory commands on ConnectionContext #3977
fix: properly set object with DenseLinkKey by @romange in fix: properly set object with DenseLinkKey #3980
fix(memory-leak): add missing destructor to RaxTreeMap by @kostasrim in fix(memory-leak): add missing destructor to RaxTreeMap #3975
fix: dangling string in DebugCmd::Reload by @kostasrim in fix: dangling string in DebugCmd::Reload #3981
chore: pass SinkReplyBuilder and Transaction explicitly. Part5 by @romange in chore: pass SinkReplyBuilder and Transaction explicitly. Part5 #3976
chore: pass SinkReplyBuilder and Transaction explicitly. Part6 by @romange in chore: pass SinkReplyBuilder and Transaction explicitly. Part6 #3987
fix(build): Reduced checks permission in build to read Fix code scanning alert - Token-Permissions #3821 by @irufus in fix(build): Reduced checks permission in build to read #3821 #3916
fix: properly set ttl bit during object replacement by @romange in fix: properly set ttl bit during object replacement #3991
fix: replace string_view with string in RaxTreeMap::FindIterator by @kostasrim in fix: replace string_view with string in RaxTreeMap::FindIterator #3982
fix: prevent starting migrations from replica by @BorysTheDev in fix: prevent starting migrations from replica #3985
feat(search): Prefix search for tags by @dranikpg in feat(search): Prefix search for tags #3972
chore: pass SinkReplyBuilder and Transaction explicitly. Part8 by @romange in chore: pass SinkReplyBuilder and Transaction explicitly. Part8 #3992
chore: pass SinkReplyBuilder and Transaction explicitly. Part7 by @romange in chore: pass SinkReplyBuilder and Transaction explicitly. Part7 #3988
chore: pass SinkReplyBuilder and Transaction explicitly. Part9 by @romange in chore: pass SinkReplyBuilder and Transaction explicitly. Part9 #3996
fix: keep the ttl bit when dense_set grows with expiring items by @romange in fix: keep the ttl bit when dense_set grows with expiring items #3995
refactor(workflow): changes default permissions to read for few workflows increasing security by @BLANKatGITHUB in refactor(workflow): changes default permissions to read for few workflows increasing security #3905
fix(search_family): Fix indexes loading in the FT.SEARCH and Ft.AGGREGATE commands by @BagritsevichStepan in fix(search_family): Fix indexes loading in the FT.SEARCH and Ft.AGGREGATE commands #3955
feat: introduce metrics/logs of when pipelining is being throttled by @romange in feat: introduce metrics/logs of when pipelining is being throttled #4000
chore: clean up conn_use_incoming_cpu heuristic by @romange in chore: clean up conn_use_incoming_cpu heuristic #3978
chore: refactor snapshot expanding logic by @romange in chore: refactor snapshot expanding logic #4003
chore: introduce GcsSnapshotStorage by @romange in chore: introduce GcsSnapshotStorage #4004
fix: flaky test_failover test by @romange in fix: flaky test_failover test #4007
chore: pass SinkReplyBuilder and Transaction explicitly. Part10 by @romange in chore: pass SinkReplyBuilder and Transaction explicitly. Part10 #3998
fix: build break in search_family by @romange in fix: build break in search_family #4008
feat(zset_family): support WITHSCORE in zrevrank/zrank commands (Zrank [WITHSCORE] support #3921) by @Diskein in feat(zset_family): support WITHSCORE in zrevrank/zrank commands (#3921) #4001
fix: separate Heartbeat and ShardHandler to fibers by @kostasrim in fix: separate Heartbeat and ShardHandler to fibers #3936
chore: improve verbosity logging during shutdown by @romange in chore: improve verbosity logging during shutdown #4010
chore: skip AggregateWithLoadOptionHard on sanitizers (false positive) by @kostasrim in chore: skip AggregateWithLoadOptionHard on sanitizers (false positive) #4013
chore: pass RedisReplyBuilder explicitly from dragonfly connection by @romange in chore: pass RedisReplyBuilder explicitly from dragonfly connection #4009
chore: print info stats if test_noreply_pipeline fails by @romange in chore: print info stats if test_noreply_pipeline fails #4016
chore: flush journal to channel for non auto journal commands by @kostasrim in chore: flush journal to channel for non auto journal commands #3945
chore: support load/save from GCS by @romange in chore: support load/save from GCS #4006
chore: pull helio by @romange in chore: pull helio #4036
chore: decrease logs severity for OOM from error to warning by @BorysTheDev in chore: decrease logs severity for OOM from error to warning #4031
feat(pre-commit): adds senstive data check like api keys by @BLANKatGITHUB in feat(pre-commit): adds senstive data check like api keys #4030
test: update test_big_containers by @BorysTheDev in test: update test_big_containers #4025
fix: reduce memory consumption during migration by @BorysTheDev in fix: reduce memory consumption during migration #4017
chore: add tx queue head debug info in AnalyzeTxQueue by @kostasrim in chore: add tx queue head debug info in AnalyzeTxQueue #4026
chore: refactor part of s3 logic for loading a snapshot. by @romange in chore: refactor part of s3 logic for loading a snapshot. #4044
chore: add retry to test_noreply_pipeline test by @romange in chore: add retry to test_noreply_pipeline test #4045
chore(DenseSet): defrag all links in a chain by @kostasrim in chore(DenseSet): defrag all links in a chain #4019
chore: add ForceUpdate to BPTree by @kostasrim in chore: add ForceUpdate to BPTree #3993
fix(search_family): Fix crash in FT.PROFILE command for invalid queries by @BagritsevichStepan in fix(search_family): Fix crash in FT.PROFILE command for invalid queries #4043
feat(dependabot): Add dependabot to check for vulnerabilies and updat… by @BLANKatGITHUB in feat(dependabot): Add dependabot to check for vulnerabilies and updat… #4035
chore: pass reply_builder explicitly to pubsub module by @romange in chore: pass reply_builder explicitly to pubsub module #4021
chore(deps): bump numpy from 1.24.1 to 2.1.3 in /tools by @dependabot in chore(deps): bump numpy from 1.24.1 to 2.1.3 in /tools #4063
chore(deps): bump github.com/redis/go-redis/v9 from 9.5.1 to 9.7.0 in /tools/replay by @dependabot in chore(deps): bump github.com/redis/go-redis/v9 from 9.5.1 to 9.7.0 in /tools/replay #4062
chore(deps): bump tomli from 2.0.1 to 2.0.2 in /tests/dragonfly by @dependabot in chore(deps): bump tomli from 2.0.1 to 2.0.2 in /tests/dragonfly #4059
chore(deps): bump github.com/gruntwork-io/terratest from 0.41.11 to 0.47.2 in /contrib/charts/dragonfly by @dependabot in chore(deps): bump github.com/gruntwork-io/terratest from 0.41.11 to 0.47.2 in /contrib/charts/dragonfly #4058
chore(deps): bump redis-om from 0.2.2 to 0.3.3 in /tests/dragonfly by @dependabot in chore(deps): bump redis-om from 0.2.2 to 0.3.3 in /tests/dragonfly #4060
chore(deps): bump mikepenz/action-junit-report from 4 to 5 by @dependabot in chore(deps): bump mikepenz/action-junit-report from 4 to 5 #4052
chore(deps): bump mozilla-actions/sccache-action from 0.0.4 to 0.0.6 by @dependabot in chore(deps): bump mozilla-actions/sccache-action from 0.0.4 to 0.0.6 #4051
chore(deps): bump ossf/scorecard-action from 2.3.1 to 2.4.0 by @dependabot in chore(deps): bump ossf/scorecard-action from 2.3.1 to 2.4.0 #4053
chore(deps): bump github/codeql-action from 3.24.9 to 3.27.0 by @dependabot in chore(deps): bump github/codeql-action from 3.24.9 to 3.27.0 #4054
chore(deps): bump docker/build-push-action from 5 to 6 by @dependabot in chore(deps): bump docker/build-push-action from 5 to 6 #4055
chore(deps): bump pytest-repeat from 0.9.1 to 0.9.3 in /tests/dragonfly by @dependabot in chore(deps): bump pytest-repeat from 0.9.1 to 0.9.3 in /tests/dragonfly #4057
chore: eliminate redundant ConnectionContext arguments by @romange in chore: eliminate redundant ConnectionContext arguments #4065
feat(server): dont use channel for replication / save df by @adiholden in feat(server): dont use channel for replication / save df #4041
feat: support GCS storage for saving/loading snapshots by @romange in feat: support GCS storage for saving/loading snapshots #4064
chore: parser clean ups by @romange in chore: parser clean ups #4077
chore: add QList class by @romange in chore: add QList class #4078
chore: add push functionality to QList class by @romange in chore: add push functionality to QList class #4079
chore: Add QList::Iterator by @romange in chore: Add QList::Iterator #4082
Add index based iterator to QList interface by @romange in Add index based iterator to QList interface #4083
chore(dependabot): Allows only security patches by @BLANKatGITHUB in chore(dependabot): Allows only security patches #4075
chore: implement QList::Iterate by @romange in chore: implement QList::Iterate #4086
chore(acl): Implicit categories by @dranikpg in chore(acl): Implicit categories #3411
chore: implement QList::Insert function by @romange in chore: implement QList::Insert function #4087
fix(sanitizers): disable false positive FtProfileInvalidQuery by @kostasrim in fix(sanitizers): disable false positive FtProfileInvalidQuery #4090
chore: implement QList::Erase functionality by @romange in chore: implement QList::Erase functionality #4092
chore: Add initial bindings for QList in list_family by @romange in chore: Add initial bindings for QList in list_family #4093
fix(server): handle running script load inside multi by @adiholden in fix(server): handle running script load inside multi #4074

New Contributors

@irufus made their first contribution in fix(build): Reduced checks permission in build to read #3821 #3916
@BLANKatGITHUB made their first contribution in refactor(workflow): changes default permissions to read for few workflows increasing security #3905

Huge thanks to all the contributors! ❤️

Full Changelog: v1.24.0...v1.25.0

This discussion was created from the release v1.25.0.

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment