feat(ingest): use mainline sqlglot #11693

hsheth2 · 2024-10-22T19:49:03Z

This moves us onto using sqlglot instead of our acryl-sqlglot fork.

Closes #10184.

Checklist

The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
Links to related issues (if applicable)
Tests for the changes have been added/updated (if applicable)
Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

github-actions · 2024-10-22T19:51:45Z

Hello @hsheth2 😄

Thank you so much for opening a pull request!

You can check out your contributor card and see all your past stats here!

hsheth2 added 3 commits October 22, 2024 12:47

start patching sqlglot

7447d1e

add lineage patches

2f75a32

add unnest patch

c1b2866

github-actions bot added the ingestion PR or Issue related to the ingestion of metadata label Oct 22, 2024

hsheth2 marked this pull request as ready for review October 22, 2024 19:56

treff7es approved these changes Oct 22, 2024

View reviewed changes

vercel bot deployed to Preview October 22, 2024 20:23 View deployment

hsheth2 added 3 commits October 22, 2024 13:57

fix dagster plugin deps

99bc69e

start working on python diff apply

dd6af08

add patcher to avoid subprocesses

73b288c

vercel bot deployed to Preview October 23, 2024 01:15 View deployment

add comment

097174d

hsheth2 added the merge-pending-ci A PR that has passed review and should be merged once CI is green. label Oct 23, 2024

rename method

b0312e1

vercel bot deployed to Preview October 23, 2024 01:57 View deployment

hsheth2 merged commit 35f30b7 into master Oct 23, 2024
73 checks passed

hsheth2 deleted the sqlglot-mainline branch October 23, 2024 02:57