Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Regression][SPIKE] Understand DataProc Batch Jobs Failure Scenarios #1327

Open
2 tasks done
colin-rogers-dbt opened this issue Aug 28, 2024 · 0 comments · May be fixed by #1386
Open
2 tasks done

[Regression][SPIKE] Understand DataProc Batch Jobs Failure Scenarios #1327

colin-rogers-dbt opened this issue Aug 28, 2024 · 0 comments · May be fixed by #1386
Assignees
Labels
bug Something isn't working regression

Comments

@colin-rogers-dbt
Copy link
Contributor

Is this a regression in a recent version of dbt-bigquery?

  • I believe this is a regression in dbt-bigquery functionality
  • I have searched the existing issues, and I could not find an existing issue for this regression

Current Behavior

Users have noted (see: #1157 ) inconsistent performance in production with python models on dataproc.

We need to map out when/why jobs on dataproc are failing and how dbt-bigquery should handle those scenarios (i.e. retry, raise a warning etc.)

Expected/Previous Behavior

Python model execution should be stable.

Steps To Reproduce

N/A

Relevant log output

No response

Environment

- OS:
- Python:
- dbt-core (working version):
- dbt-bigquery (working version):
- dbt-core (regression version):
- dbt-bigquery (regression version):

Additional Context

No response

@colin-rogers-dbt colin-rogers-dbt added bug Something isn't working triage regression and removed triage labels Aug 28, 2024
@colin-rogers-dbt colin-rogers-dbt changed the title [Regression] Understand DataProc Batch Jobs Failure Scenarios [Regression][SPIKE] Understand DataProc Batch Jobs Failure Scenarios Aug 28, 2024
@mikealfare mikealfare linked a pull request Oct 25, 2024 that will close this issue
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working regression
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants