Onelake incompatible with rustls

[djouallah]

Environment

Delta-rs version: 0.25.1

Binding: Python

Environment: Linux

• Cloud provider: Microsoft Fabric onelake
• OS:
• Other:

---

running

pip install deltalake --upgrade
dt = DeltaTable(result_table)

get

OSError: Generic MicrosoftAzure error: Error after 10 retries in 2.475340161s, max_retries:10, retry_timeout:180s, source:error sending request for url (https://onelake.blob.fabric.microsoft.com/sqlengines/ETL.Lakehouse/Tables/dbo/results/_delta_log/_last_checkpoint)

cc @RobinLin666

[ion-elgreco]

@djouallah have you tried another os to read with?

(btw a normal azure read works fine, manually verified that)

[ion-elgreco]

@djouallah I suggest you try to compile of each of these branches and report back if it resolves the connection issue:

• https://github.com/ion-elgreco/delta-rs/tree/fix/rustls
• https://github.com/ion-elgreco/delta-rs/tree/fix/use-native-tls-vendored

[djouallah]

windows works fine with onelake

[ion-elgreco]

Ok then it's related to the SSL handshakes. Please compile both of these branches I've shared above and let me know the results of each, then I can narrow down the fix

[ion-elgreco]

@djouallah can you check the latest release out please

[djouallah]

same errors

OSError: Generic MicrosoftAzure error: Error after 10 retries in 3.247428205s, max_retries:10, retry_timeout:180s, source:error sending request for url (https://onelake.blob.fabric.microsoft.com/sqlengines/ETL.Lakehouse/Tables/T10/streaming/_delta_log/_last_checkpoint)

[ion-elgreco]

@djouallah then it's a seperate issue for you, which architecture are you running it on?

[djouallah]

Linux , python notebook running in fabric

[ion-elgreco]

Linux , python notebook running in fabric

That's OS, I mean CPU architecture

[djouallah]

Intel 64

[liamphmurphy]

We're seeing similar errors on our S3 bucket on delta tables that were written on v0.19.2 (rust engine) and bumping up to v0.25.4.

@ion-elgreco is there any additional info I can provide to narrow things down?

Unknown error writing to Delta Lake: Generic S3 error: Error after 10 retries in 1.909096604s, max_retries:10, retry_timeout:180s, source:error sending request for url (https://s3.us-east-1.amazonaws.com/.../_delta_log/_last_checkpoint)