Release 2.15.0-early-access

Changelog

Release v2.14.1

Changelog

🪛 Improvement and 🐞 Bug fixes

• c7f8ad0 chore: update release workflow (Florian Hussonnois)
• 705bc24 chore: update release workflow (Florian Hussonnois)
• f52b3ed chore: update release workflow (Florian Hussonnois)
• 2c16195 chore: bump dependencies (Florian Hussonnois)
• 616be3e chore: bump dependencies (Florian Hussonnois)

⬆️ Dependencies

• 0b0fc73 build(deps): bump maven.surefire.plugin.version from 3.1.2 to 3.2.5 (dependabot[bot])
• 79c37dd build(deps): bump com.github.spotbugs:spotbugs-maven-plugin (dependabot[bot])
• 9244d51 build(deps): bump org.mockito:mockito-core from 5.5.0 to 5.11.0 (dependabot[bot])
• 14233d7 build(deps): bump org.apache.maven.plugins:maven-assembly-plugin (dependabot[bot])

Contributors

We'd like to thank the following people for their contributions:
'- Florian Hussonnois (@fhussonnois)', '- dependabot[bot] (@dependabot[bot])', '- github-actions[bot] (@github-actions[bot])'

Release v2.14.0

Changelog

🚀 New Features

• 89729eb feat(plugin): add parquet file reader (jAVA)

🪛 Improvement and 🐞 Bug fixes

• 9960290 chore: jacoco to 0.8.9 (Florian Hussonnois)
• a9de29d chore: bump docker image to cp-kafka-connect-base:7.6.0 (Florian Hussonnois)
• dae1f7c chore: migrate to SPDX-License-Identifier (Florian Hussonnois)
• 3a12e7e chore: fix checkstyle (Florian Hussonnois)
• fae3d56 chore: update docker-compose files (Florian Hussonnois)
• 1aee27a fix(filters): fix fields by index logic (TheWorkshopCom)
• 636e73c docs(gh-page): update (Florian Hussonnois)
• 7493f8e docs: update (Florian Hussonnois)

⬆️ Dependencies

• 9d4f243 build(deps): bump com.github.spotbugs:spotbugs from 4.7.3 to 4.8.3 (dependabot[bot])
• 498a3c1 build(deps): bump junit.version from 5.10.1 to 5.10.2 (dependabot[bot])
• e894318 build(deps): bump org.apache.commons:commons-compress (dependabot[bot])
• d62f43f build(deps): bump com.fasterxml.jackson.core:jackson-core (dependabot[bot])
• 2404bb0 build(deps): bump com.azure:azure-identity from 1.10.1 to 1.11.4 (dependabot[bot])
• dbe079c build(deps): bump org.apache.kafka.version from 3.5.1 to 3.6.1 (dependabot[bot])
• cc260f6 build(deps): bump com.aliyun.oss:aliyun-sdk-oss from 3.17.1 to 3.17.4 (dependabot[bot])
• 2a20b81 build(deps): bump org.jreleaser:jreleaser-maven-plugin (dependabot[bot])
• 13fac18 build(deps): bump org.jacoco:jacoco-maven-plugin from 0.8.10 to 0.8.11 (dependabot[bot])
• 7101f4a build(deps): bump junit.version from 5.10.0 to 5.10.1 (dependabot[bot])
• 7ce8ff9 build(deps): bump org.apache.maven.plugins:maven-checkstyle-plugin (dependabot[bot])
• 5543afa build(deps): bump actions/cache from 3 to 4 (dependabot[bot])
• 81ef2ba build(deps): bump org.apache.commons:commons-compress (dependabot[bot])
• cfebb36 build(deps): bump testcontainer.version from 1.19.0 to 1.19.1 (dependabot[bot])
• 45f34ec build(deps): bump com.github.spotbugs:spotbugs-maven-plugin (dependabot[bot])
• 9ccc2cb build(deps): bump commons-io:commons-io from 2.13.0 to 2.15.0 (dependabot[bot])
• e7116c1 build(deps): bump org.apache.maven.plugins:maven-javadoc-plugin (dependabot[bot])
• f6c5336 build(deps): bump aws.version from 1.12.553 to 1.12.555 (dependabot[bot])
• b6daea4 build(deps): bump slf4j.version from 2.0.7 to 2.0.9 (dependabot[bot])
• 9d2ad70 build(deps): bump org.apache.avro:avro from 1.11.2 to 1.11.3 (dependabot[bot])
• 35e97ff build(deps): bump com.azure:azure-storage-blob from 12.21.1 to 12.24.0 (dependabot[bot])
• dc47ee9 build(deps): bump com.aliyun.oss:aliyun-sdk-oss from 3.16.3 to 3.17.1 (dependabot[bot])
• fcb4050 build(deps): bump com.diffplug.spotless:spotless-maven-plugin (dependabot[bot])
• 957fb2f build(deps): bump aws.version from 1.12.552 to 1.12.553 (dependabot[bot])
• a462522 build(deps): bump org.apache.avro:avro from 1.11.1 to 1.11.2 (dependabot[bot])
• 5bb6f0b build(deps): bump aws.version from 1.12.550 to 1.12.552 (dependabot[bot])
• 57d721e build(deps): bump com.google.cloud:libraries-bom from 26.12.0 to 26.23.0 (dependabot[bot])
• 325e166 build(deps): bump aws.version from 1.12.548 to 1.12.550 (dependabot[bot])
• e00af4e build(deps): bump com.azure:azure-identity from 1.9.1 to 1.10.1 (dependabot[bot])
• c02d08d build(deps): bump junit.version from 5.9.3 to 5.10.0 (dependabot[bot])
• 2332941 build(deps): bump testcontainer.version from 1.18.3 to 1.19.0 (dependabot[bot])
• 41ebbd4 build(deps): bump docker/build-push-action from 4 to 5 (dependabot[bot])
• fe1d02f build(deps): bump crazy-max/ghaction-import-gpg from 5 to 6 (dependabot[bot])
• fdadc0b build(deps): bump docker/login-action from 2 to 3 (dependabot[bot])
• 38dc3d1 build(deps): bump docker/setup-buildx-action from 1 to 3 (dependabot[bot])
• 5d15d70 build(deps): bump org.apache.maven.plugins:maven-checkstyle-plugin (dependabot[bot])
• 30f73f9 build(deps): bump org.codehaus.mojo:build-helper-maven-plugin (dependabot[bot])
• e4810d1 build(deps): bump org.apache.commons:commons-compress (dependabot[bot])
• 33c753d build(deps): bump antlr4.version from 4.12.0 to 4.13.1 (dependabot[bot])

Contributors

We'd like to thank the following people for their contributions:
'- Florian Hussonnois (@fhussonnois)', '- TheWorkshopCom', '- dependabot[bot] (@dependabot[bot])', '- github-actions[bot] (@github-actions[bot])', '- jAVA'

Release 2.14.0-early-access

Changelog

Release v2.13.0

Changelog

🚀 New Features

• 3d31dbe feat(filters): add built-in NamingConventionFilter (TheWorkshopCom)
• 0531d63 feat(filters): add documentation for built-in MoveAllFieldsFilter, ExtractValueFilter, ExcludeFieldsMatchingPatternFilter (TheWorkshopCom)
• 0355ca6 feat(filters): add built-in MoveAllFieldsFilter (TheWorkshopCom)
• 7fec3c1 feat(filters): add built-in ExtractValueFilter (TheWorkshopCom)
• e854995 feat(filters): add built-in ExcludeFieldsMatchingPatternFilter (TheWorkshopCom)
• 6752c23 feat(filters): add built-in ExcludeFieldsMatchingPatternsFilter (TheWorkshopCom)
• d5375b7 feat(filters): updating documentation date (TheWorkshopCom)
• 79333f6 feat(filters): removing dependency to assertj (TheWorkshopCom)
• d78219a feat(plugin): add built-in DateInFilenameFileListFilter (TheWorkshopCom)
• d8e8df8 feat(plugin): add SFTP Filesystem (TheWorkshopCom)
• e91cbd9 feat(plugin): add tasks.file.status.storage.topic.creation.enable props (Florian Hussonnois)

🪛 Improvement and 🐞 Bug fixes

• be13d5d bump confluent image version (Florian Hussonnois)
• 32f9770 chore: fix apache-license header (Florian Hussonnois)
• baa79dc fix CSV example (pka23)
• 35e85ea add test case for AliyunOSSURI (sunxiaojian)
• dec3ba6 Support for reading files from Aliyun OSS #386 (sunxiaojian)
• ce329c0 perf(plugin): optimize aws s3 file listing (Bartosz Jaroszewski)
• e2bf74f fix(plugin): fix NPE in DefaultFileSystemMonitor (#465) (Florian Hussonnois)
• df7c71f fix(filters): fix wrong index for DelimitedRowIndex (Agustin Gonzalez)
• aa53cc2 bump project version for next iteration (Florian Hussonnois)

⬆️ Dependencies

• 243248f build(deps): bump actions/checkout from 3 to 4 (dependabot[bot])
• fa07d97 build(deps): bump aws.version from 1.12.502 to 1.12.548 (dependabot[bot])
• 6fd8b11 build(deps): bump org.jacoco:jacoco-maven-plugin from 0.8.9 to 0.8.10 (dependabot[bot])
• 5b526b8 build(deps): bump com.opencsv:opencsv from 5.7.1 to 5.8 (dependabot[bot])
• 03105fd build(deps): bump com.azure:azure-storage-blob from 12.21.1 to 12.23.1 (dependabot[bot])
• 3fa31d6 build(deps): bump software.amazon.msk:aws-msk-iam-auth (dependabot[bot])
• 9b65463 build(deps): bump org.mockito:mockito-core from 5.3.1 to 5.5.0 (dependabot[bot])
• 163e626 build(deps): bump org.apache.maven.plugins:maven-assembly-plugin (dependabot[bot])
• 683ca75 build(deps): bump org.apache.maven.plugins:maven-source-plugin (dependabot[bot])
• f275a54 build(deps): bump com.github.spotbugs:spotbugs-maven-plugin (dependabot[bot])
• 8aa5849 build(deps): bump org.apache.kafka.version from 3.4.0 to 3.5.1 (dependabot[bot])
• 75304f9 build(deps): bump testcontainer.version from 1.18.0 to 1.18.3 (dependabot[bot])
• f506e42 build(deps): bump maven.surefire.plugin.version from 3.0.0 to 3.1.2 (dependabot[bot])
• ec0f27e build(deps): bump junit.version from 5.9.2 to 5.9.3 (dependabot[bot])
• d2b2c62 build(deps): bump aws.version from 1.12.483 to 1.12.502 (dependabot[bot])
• 6929c39 build(deps): bump Saxon-HE from 12.1 to 12.3 (dependabot[bot])
• c92a7a3 build(deps): bump json from 20230227 to 20230618 (dependabot[bot])
• 0acf316 build(deps): bump spotless-maven-plugin from 2.36.0 to 2.37.0 (dependabot[bot])
• 68b0b98 build(deps): bump aws.version from 1.12.447 to 1.12.483 (dependabot[bot])
• 3238d83 build(deps): bump commons-io from 2.11.0 to 2.13.0 (dependabot[bot])
• fccfff6 build(deps): fix build (Florian Hussonnois)
• 36ab512 build(deps): bump aws.version from 1.12.445 to 1.12.447 (dependabot[bot])
• ccb9e0a build(deps): bump mockito-core from 5.2.0 to 5.3.1 (dependabot[bot])
• bfa2573 build(deps): bump jackson-databind from 2.14.2 to 2.15.2 (dependabot[bot])
• e6cd947 build(deps): bump azure-identity from 1.8.1 to 1.9.1 (dependabot[bot])
• e843cff build(deps): bump aws.version from 1.12.444 to 1.12.445 (dependabot[bot])
• 555f964 build(deps): bump aws.version from 1.12.443 to 1.12.444 (dependabot[bot])
• 4288bd0 build(deps): bump spotbugs-maven-plugin from 4.7.3.3 to 4.7.3.4 (dependabot[bot])
• 9f578f7 build(deps): bump spotless-maven-plugin from 2.35.0 to 2.36.0 (dependabot[bot])
• 1887176 build(deps): bump aws.version from 1.12.442 to 1.12.443 (dependabot[bot])
• ca320ca build(deps): bump testcontainer.version from 1.17.6 to 1.18.0 (dependabot[bot])
• b4ae964 build(deps): bump libraries-bom from 26.11.0 to 26.12.0 (dependabot[bot])
• df8fa35 build(deps): bump spotless-maven-plugin from 2.33.0 to 2.35.0 (dependabot[bot])
• 700aa83 build(deps): bump aws.version from 1.12.428 to 1.12.442 (dependabot[bot])
• fba4f57 build(deps): bump actions/cache from 1 to 3 (dependabot[bot])

Contributors

We'd like to thank the following people for their contributions:

• Agustin Gonzalez(@loquisgon)
• Bartosz Jaroszewski (@bjarosze)
• Florian Hussonnois (@fhussonnois)
• TheWorkshopCom (@theworkshopcom)
• pka23 (@pka23)
• sunxiaojian (@sunxiaojian)

RELEASE 2.12.0

Features

Improvements & Bugfixes

• fix(plugin): fix KafkaFileObjectStateBackingStoreConfig by @fhussonnois

Docs

Sub-Tasks

• build(deps): bump libraries-bom from 26.10.0 to 26.11.0 by @dependabot in #434
• build(deps): bump spotbugs-maven-plugin from 4.5.3.0 to 4.7.3.3 by @dependabot in #433
• build(deps): bump jacoco-maven-plugin from 0.8.8 to 0.8.9 by @dependabot in #432
• build(deps): bump mockito-core from 2.21.0 to 5.2.0 by @dependabot in #410

Docker Images

$ docker pull streamthoughts/kafka-connect-file-pulse:2.12.0

For verifying distirbution zip file

$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.12.0.zip https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.12.0/streamthoughts-kafka-connect-file-pulse-2.12.0.zip
$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.12.0.zip.asc https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.12.0/streamthoughts-kafka-connect-file-pulse-2.12.0.zip.asc
$ gpg --keyserver keyserver.ubuntu.com --recv-keys D12696955654914F
$ gpg --verify streamthoughts-kafka-connect-file-pulse-2.12.0.zip.asc streamthoughts-kafka-connect-file-pulse-2.12.0

Full Changelog: v2.11.0...v2.12.0

RELEASE 2.11.0

Features

• feat: Add AWS MSK IAM support by @fhussonnois in #431

Improvements & Bugfixes

Docs

Sub-Tasks

• build(deps): bump commons-compress from 1.22 to 1.23.0 by @dependabot in #429
• build(deps): bump slf4j.version from 1.7.32 to 2.0.7 by @dependabot in #430
• build(deps): bump actions/stale from 7 to 8 by @dependabot in #423
• build(deps): bump maven-javadoc-plugin from 3.4.1 to 3.5.0 by @dependabot in #409
• build(deps): bump maven-checkstyle-plugin from 3.1.0 to 3.2.1 by @dependabot in #425

Docker Images

$ docker pull streamthoughts/kafka-connect-file-pulse:2.11.0

For verifying distirbution zip file

$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.11.0.zip https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.11.0/streamthoughts-kafka-connect-file-pulse-2.11.0.zip
$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.11.0.zip.asc https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.11.0/streamthoughts-kafka-connect-file-pulse-2.11.0.zip.asc
$ gpg --keyserver keyserver.ubuntu.com --recv-keys D12696955654914F
$ gpg --verify streamthoughts-kafka-connect-file-pulse-2.11.0.zip.asc streamthoughts-kafka-connect-file-pulse-2.11.0

Full Changelog: v2.10.0...v2.11.0

RELEASE v2.10.0

Features

• feat(plugin): add new RegexRouterCleanupPolicy by @fhussonnois in #427

Improvements & Bugfixes

• fix: handle special character in S3 bucket or file name by @kirito73 in #415

Docs

Sub-Tasks

• build(deps): bump antlr4.version from 4.11.1 to 4.12.0 by @dependabot in #406
• build(deps): bump azure-storage-blob from 12.20.1 to 12.21.0 by @dependabot in #411
• build(deps): bump maven.surefire.plugin.version from 3.0.0-M9 to 3.0.0 by @dependabot in #414
• build(deps): bump azure-identity from 1.6.0 to 1.8.1 by @dependabot in #408
• build(deps): bump aws-java-sdk.version from 1.12.423 to 1.12.428 by @dependabot in #417
• build(deps): bump libraries-bom from 26.9.0 to 26.10.0 by @dependabot in #416
• build(deps-dev): bump google-cloud-nio from 0.126.8 to 0.126.9 by @dependabot in #422
• build(deps): bump spotbugs from 4.7.0 to 4.7.3 by @dependabot in #421
• build(deps-dev): bump google-cloud-nio from 0.126.9 to 0.126.10 by @dependabot in #424
• build(deps): bump Saxon-HE from 12.0 to 12.1 by @dependabot in #426
• build(deps): bump azure-storage-blob from 12.21.0 to 12.21.1 by @dependabot in #428

Docker Images

$ docker pull streamthoughts/kafka-connect-file-pulse:2.10.0

For verifying distirbution zip file

$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.10.0.zip https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.10.0/streamthoughts-kafka-connect-file-pulse-2.10.0.zip
$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.10.0.zip.asc https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.10.0/streamthoughts-kafka-connect-file-pulse-2.10.0.zip.asc
$ gpg --keyserver keyserver.ubuntu.com --recv-keys D12696955654914F
$ gpg --verify streamthoughts-kafka-connect-file-pulse-2.10.0.zip.asc streamthoughts-kafka-connect-file-pulse-2.10

New Contributors

• @kirito73 made their first contribution in #415

Full Changelog: v2.9.0...v2.10.0

RELEASE v2.9.0

Features

• feat: allow to configure value schema using Avro by @fhussonnois in #393

Improvements & Bugfixes

• fix: Add application/gzip to recognize gzipped files by @loquisgon in #398
• fix(api): fix connect schema mapping for map and array by @fhussonnois in #397

Docs

Sub-Tasks

• build(deps-dev): bump google-cloud-nio from 0.124.15 to 0.126.0 by @dependabot in #354
• build(deps): bump azure-storage-blob from 12.20.0 to 12.20.1 by @dependabot in #351
• build(deps): bump antlr4.version from 4.10.1 to 4.11.1 by @dependabot in #350
• build(deps): bump maven-compiler-plugin from 3.8.1 to 3.10.1 by @dependabot in #342
• build(deps): bump Saxon-HE from 11.3 to 11.4 by @dependabot in #359
• build(deps): bump jackson-databind from 2.13.4.2 to 2.14.1 by @dependabot in #358
• build(deps): bump httpclient from 4.5.13 to 4.5.14 by @dependabot in #360
• build(deps): bump actions/stale from 5 to 7 by @dependabot in #356
• build(deps): bump junit.version from 5.9.0 to 5.9.1 by @dependabot in #357
• build(deps): bump commons-compress from 1.21 to 1.22 by @dependabot in #364
• build(deps): bump junit.version from 5.9.1 to 5.9.2 by @dependabot in #367
• build(deps): bump json from 20220320 to 20230227 by @dependabot in #390
• build(deps): bump libraries-bom from 25.4.0 to 26.9.0 by @dependabot in #387
• build(deps): bump testcontainer.version from 1.17.5 to 1.17.6 by @dependabot in #365
• build(deps): bump jackson-core from 2.14.0 to 2.14.2 by @dependabot in #395
• build(deps-dev): bump json-path from 5.2.0 to 5.3.0 by @dependabot in #394
• build(deps): bump aws-java-sdk.version from 1.12.324 to 1.12.421 by @dependabot in #396
• build(deps-dev): bump google-cloud-nio from 0.126.7 to 0.126.8 by @dependabot in #402
• build(deps): bump Saxon-HE from 11.4 to 12.0 by @dependabot in #399
• build(deps): bump maven.surefire.plugin.version from 3.0.0-M7 to 3.0.0-M9 by @dependabot in #401
• build(deps): bump maven-compiler-plugin from 3.10.1 to 3.11.0 by @dependabot in #400

New Contributors

• @loquisgon made their first contribution in #398

Docker Images

$ docker pull streamthoughts/kafka-connect-file-pulse:2.9.0

For verifying distirbution zip file

$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.9.0.zip https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.9.0/streamthoughts-kafka-connect-file-pulse-2.9.0.zip
$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.9.0.zip.asc https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.9.0/streamthoughts-kafka-connect-file-pulse-2.9.0.zip.asc
$ gpg --keyserver keyserver.ubuntu.com --recv-keys D12696955654914F
$ gpg --verify streamthoughts-kafka-connect-file-pulse-2.9.0.zip.asc streamthoughts-kafka-connect-file-pulse-2.9.0.zip

Full Changelog: v2.8.0...v2.9.0

Release v2.8.0

Features

Improvements & Bugfixes

• 8c5fe6c fix(plugins): fix FilePulseSourceTask can fail to stop gracefully
• fix(api): fix filter-chain behavior to handle errors (#325) by @fhussonnois in #326

Docs

Sub-Tasks

• b5c7866 build(deps): bump confluentinc/cp-kafka-connect-base to 7.3.0
• 30a652a build(deps): bump kafka-connect-avro-converter to 7.3.0
• aef0e28 build(deps): bump kafka version to 3.3.1
• build(deps): bump avro from 1.11.0 to 1.11.1 by @dependabot in #312
• build(deps): bump azure-storage-blob from 12.14.2 to 12.18.0 by @dependabot in #307
• build(deps): bump junit.version from 5.8.2 to 5.9.0 by @dependabot in #315
• build(deps): bump azure-identity from 1.2.5 to 1.6.0 by @dependabot in #330
• build(deps-dev): bump google-cloud-nio from 0.122.11 to 0.124.15 by @dependabot in #329
• build(deps): bump aws-java-sdk.version from 1.12.210 to 1.12.275 by @dependabot in #314
• build(deps): bump jackson-databind from 2.13.3 to 2.13.4.2 by @dependabot in #338
• build(deps): bump azure-storage-blob from 12.18.0 to 12.20.0 by @dependabot in #336
• build(deps): bump maven-failsafe-plugin from 3.0.0-M3 to 3.0.0-M7 by @dependabot in #335
• build(deps): bump jackson-core from 2.13.3 to 2.14.0 by @dependabot in #343
• build(deps-dev): bump json-path from 5.1.0 to 5.2.0 by @dependabot in #340
• build(deps): bump testcontainer.version from 1.17.2 to 1.17.5 by @dependabot in #347
• build(deps): bump aws-java-sdk.version from 1.12.275 to 1.12.324 by @dependabot in #339

Docker Images

$ docker pull streamthoughts/kafka-connect-file-pulse:2.8.0

For verifying distirbution zip file

$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.8.0.zip https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.8.0/streamthoughts-kafka-connect-file-pulse-2.8.0.zip
$ curl -L -o streamthoughts-kafka-connect-file-pulse-2.8.0.zip.asc https://github.com/streamthoughts/kafka-connect-file-pulse/releases/download/v2.8.0/streamthoughts-kafka-connect-file-pulse-2.8.0.zip.asc
$ gpg --keyserver keyserver.ubuntu.com --recv-keys D12696955654914F
$ gpg --verify streamthoughts-kafka-connect-file-pulse-2.8.0.zip.asc streamthoughts-kafka-connect-file-pulse-2.8.0.zip

Full Changelog: v2.7.0...v2.8.0