Commit Properties / Custom Metadata not loaded

[tkauf15k]

Environment

Delta-rs version: 0.25.4

Binding: python

Environment:

• Cloud provider: local filesystem & s3
• OS: ubuntu
• Other:

---

Bug

What happened:
I'm trying to write custom metadata to my table (tested both on s3 and filesystem); but when reloading the table the metadata is not loaded.

What you expected to happen:
Custom metadata / commit properties should be returned e.g., by .metadata().

How to reproduce it:

path = pathlib.Path("./table")
if path.exists():
    shutil.rmtree(path)
path.mkdir(exist_ok=False)
write_deltalake(path, pd.DataFrame({"id": [1], "value": [1]}), mode="overwrite",
                    commit_properties=CommitProperties(custom_metadata={"custom": "attribute"}))
ds = DeltaTable(path)
print(ds.metadata())

More details:

Is this only possible through .history() of a table? If so, can i generally assume that i have one history entry for each version (excluding retention/cleanup scenarios - more if i find a previous version, i should be able to do a .history(2)[1] )?

[ion-elgreco]

Commit Metadata is added to the commit info of your transaction, so indeed only visible through the History