Skip to content

docs: add dask page to integration docs#2122

Merged
ion-elgreco merged 4 commits intodelta-io:mainfrom
avriiil:dask-integration-doc
Jan 27, 2024
Merged

docs: add dask page to integration docs#2122
ion-elgreco merged 4 commits intodelta-io:mainfrom
avriiil:dask-integration-doc

Conversation

@avriiil
Copy link
Copy Markdown
Contributor

@avriiil avriiil commented Jan 26, 2024

No description provided.

@avriiil avriiil requested a review from MrPowers as a code owner January 26, 2024 14:32
@github-actions
Copy link
Copy Markdown

ACTION NEEDED

delta-rs follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

@avriiil avriiil changed the title Add Dask to Integration docs docs: Add Dask page to Integration docs Jan 26, 2024
@avriiil avriiil changed the title docs: Add Dask page to Integration docs docs: add dask page to integration docs Jan 26, 2024
Copy link
Copy Markdown
Contributor

@MrPowers MrPowers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@ion-elgreco
Copy link
Copy Markdown
Collaborator

@MrPowers do we want to show that in our docs?

It seems dask-deltalake hasn't been updated for over 6 months and relies on an older python version of deltalake

@MrPowers
Copy link
Copy Markdown
Contributor

@ion-elgreco - yea, I think it's good to highlight.

Does it depend on a specific version of deltalake? Here's the dependency I could spot: https://github.com/dask-contrib/dask-deltatable/blob/main/requirements.txt#L2

@ion-elgreco
Copy link
Copy Markdown
Collaborator

ion-elgreco commented Jan 26, 2024

@MrPowers well it doesn't depend but our new releases broke their package since they are using private methods, which ofcourse is at someone's own risk :)

@MrPowers
Copy link
Copy Markdown
Contributor

@ion-elgreco - yep, well we should help them make fixes I think 😄

I kind of view us as being responsible for the whole Delta Lake ecosystem that depends on delta-rs too.

@ion-elgreco ion-elgreco enabled auto-merge (squash) January 27, 2024 10:57
@ion-elgreco ion-elgreco merged commit 603a81e into delta-io:main Jan 27, 2024
RobinLin666 pushed a commit to RobinLin666/delta-rs that referenced this pull request Feb 2, 2024
Co-authored-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants