Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[async] Fallback to using dbt-core to run transformation if async fails #1273

Open
tatiana opened this issue Oct 21, 2024 · 0 comments
Open

[async] Fallback to using dbt-core to run transformation if async fails #1273

tatiana opened this issue Oct 21, 2024 · 0 comments
Labels
area:execution Related to the execution environment/mode, like Docker, Kubernetes, Local, VirtualEnv, etc execution:async Related to the Async execution mode
Milestone
Cosmos 1.9.0

Comments

@tatiana
Copy link
Collaborator

tatiana commented Oct 21, 2024

There will be scenarios when the async transformation may fail (either due to a macro, or some other misconfiguration) when using ExecutionMode.AIRFLOW_ASYNC.

In those cases, Cosmos should fallback to run them using dbt-core in the worker node similar to ExecutionMode.LOCAL
@tatiana tatiana added the execution:async Related to the Async execution mode label Oct 21, 2024
@dosubot dosubot bot added the area:execution Related to the execution environment/mode, like Docker, Kubernetes, Local, VirtualEnv, etc label Oct 21, 2024
@tatiana tatiana added this to the Cosmos 1.9.0 milestone Oct 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area:execution Related to the execution environment/mode, like Docker, Kubernetes, Local, VirtualEnv, etc execution:async Related to the Async execution mode
Projects
None yet
Milestone
Cosmos 1.9.0
Development

No branches or pull requests
1 participant
@tatiana