Skip to content

deltalake 0.15.2 prints partitions_values and paths which is not desired #2176

@0xdarkman

Description

@0xdarkman

reading delta table with deltalake 0.15.2 results in printing all partitin_values and path.
This is not observed in deltalake < 0.15.2
The expected behaviour is NOT to print all partition_values and all paths.

df = pl.read_delta(table_path, storage_options=storage_options)

partition_values: {"name": String("test")}
path: "name=test/7-9ce0b50b-06db-4161-98b1-0501365b0120-0.parquet"
partition_values: {"name": String("foo")}
path: "name=foo/6-5d491bc3-286d-4252-9f1a-040b0af19c22-0.parquet"
partition_values: {"name": String("foo")}
path: "name=foo/5-86c20d8b-625a-4a03-9001-9280f6a8fe1e-0.parquet"
partition_values: {"name": String("foo")}
path: "name=foo/part-00000-aea5a35e-8164-4b72-b017-c85fe191c78c.c000.snappy.parquet"
partition_values: {"name": String("foo")}
path: "name=foo/part-00000-91e85e96-1ec6-479f-ac6b-35a4d9edc058.c000.snappy.parquet"
partition_values: {"name": String("foo")}
path: "name=foo/part-00000-b34142b8-ac55-4b08-be50-63cf803f2df6.c000.snappy.parquet"
partition_values: {"name": String("foo")}
path: "name=foo/part-00000-cbc8c35d-b179-4449-b8e3-d812dc5c75c6.c000.snappy.parquet"
partition_values: {"name": String("foo")}
path: "name=foo/part-00000-528c7682-3aec-4061-9a1b-b8e0b52568fb.c000.snappy.parquet"

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions