Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Load SQL data natively in Polars #456

Open
matt035343 opened this issue Jul 22, 2024 · 0 comments
Open

[FEATURE] Load SQL data natively in Polars #456

matt035343 opened this issue Jul 22, 2024 · 0 comments
Labels
code/new-feature New feature or request

Comments

@matt035343
Copy link
Member

To quickly release the MetaFrame changes, we chose to load SQL data in Pandas and then convert it to Polars. To ensure maximal performance, these operations should be done natively in Polars.

Example:

MetaFrame.from_pandas(chunk)
for chunk in read_sql(query, con=self._get_connection(), chunksize=chunksize)

@matt035343 matt035343 added the code/new-feature New feature or request label Jul 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
code/new-feature New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant