Skip to content

Commit

Permalink
docs(datasets): add example of Polars read_delta
Browse files Browse the repository at this point in the history
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
  • Loading branch information
deepyaman committed Oct 11, 2024
1 parent 23584b4 commit b43163e
Showing 1 changed file with 9 additions and 1 deletion.
10 changes: 9 additions & 1 deletion kedro-datasets/kedro_datasets/ibis/file_dataset.py
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ class FileDataset(AbstractVersionedDataset[ir.Table, ir.Table]):
.. code-block:: yaml
cars:
type: ibis.TableDataset
type: ibis.FileDataset
filepath: data/01_raw/company/cars.csv
file_format: csv
table_name: cars
Expand All @@ -35,6 +35,14 @@ class FileDataset(AbstractVersionedDataset[ir.Table, ir.Table]):
sep: ","
nullstr: "#NA"
motorbikes:
type: ibis.FileDataset
filepath: s3://your_bucket/data/02_intermediate/company/motorbikes/
file_format: delta
table_name: motorbikes
connection:
backend: polars
Example usage for the
`Python API <https://docs.kedro.org/en/stable/data/\
advanced_data_catalog_usage.html>`_:
Expand Down

0 comments on commit b43163e

Please sign in to comment.