Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sync with open source how #118

Draft
wants to merge 5,243 commits into
base: li_trunk
Choose a base branch
from
Draft

sync with open source how #118

wants to merge 5,243 commits into from

Conversation

lesterhaynes
Copy link

Please add a meaningful description for your change here


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI.

tvalentyn and others added 21 commits September 30, 2024 14:18
Reduce  spammy logs
Reduce the logging severity to remove verbose logging.
* iceberg dynamic destinations

* update CHANGES

* spotless

* fix null error

* fix some tests

* fix some tests

* better row filter error message

* clarify keep-only-drop mutual exclusivity

* use constants for field names
* add support for dynamic write in MqttIO

* Update CHANGES.md

* add some assertions in testDynamicWrite

* remove whitespace in CHANGES.md

* refactor duplicated Write transform

* change WriteFn to use Write spec
* Build release candidate with Java 11

* cleanup leftover flag
* Update staticcheck version.

* Add the workflow itself to it's trigger condition.

* go mod tidy

* [staticcheck] remove redundant nil checks

---------

Co-authored-by: lostluck <13907733+lostluck@users.noreply.github.com>
Co-authored-by: lostluck <13907733+lostluck@users.noreply.github.com>
* [YAML] - Remove warning message

* [YAML] - Remove import
Co-authored-by: Claude <cvandermerwe@google.com>
* Support string FQN as a way to add lineage information

* clarify the two use case of lineage.add
Signed-off-by: Jeffrey Kinard <jeff@thekinards.com>
* [prism] Register the option types as well. Move to single registrar file.

* spotless

* spotless period

---------

Co-authored-by: lostluck <13907733+lostluck@users.noreply.github.com>
robertwb and others added 30 commits October 22, 2024 10:39
* Fix java sdk container dependency for Python PostCommit

* trigger tests
* Add kafka poll latency metrics

* Address Sam's comments

[Dataflow Streaming] Use isolated windmill streams based on job settings (#32503)

* Add kafka poll latency metrics

* address comments

* Ensure this is disabled for now until flag to enable it is explicitly
passed

---------

Co-authored-by: Naireen <naireenhussain@google.com>
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.199.0 to 0.202.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](googleapis/google-api-go-client@v0.199.0...v0.202.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.44.0 to 1.45.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](googleapis/google-cloud-go@pubsub/v1.44.0...spanner/v1.45.0)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/storage
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Disable affected Samza runner test in Java9+

* Specify text log_kind for platorm independent logging
* Test fix after runner bump to Java11

* Revert workflow change as it handled in separate PR
… in Dataflow Streaming Java Legacy Runner without Streaming Engine (#32893)

* Check WorkItemCommitRequest is buildable in WindmillStateInternalTest
Sync version with GCP libraries, pulling 1.17.1
* Add a vLLM notebook

* Fix string

* Feedback + minor instruction fix

* quoting
* Fix DebeziumIO JmsIO PreCommit

* Update sdks/go/test/integration/io/xlang/debezium/debezium_test.go

---------

Co-authored-by: Jack McCluskey <34928439+jrmccluskey@users.noreply.github.com>
Co-authored-by: lostluck <13907733+lostluck@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.