Skip to content

Use HF buckets as backend#465

Merged
abidlabs merged 25 commits into
mainfrom
buckets
Mar 31, 2026
Merged

Use HF buckets as backend#465
abidlabs merged 25 commits into
mainfrom
buckets

Conversation

@abidlabs
Copy link
Copy Markdown
Member

@abidlabs abidlabs commented Mar 30, 2026

PR to switch the default storage of metrics from Datasets to Buckets! (Dataset is still an option for backwards-compatibility)

You can see it in action in e.g. this Space: https://huggingface.co/spaces/abidlabs/trackio-on-spaces-614128 which has a mounted bucket with logs: https://huggingface.co/buckets/abidlabs/trackio-on-spaces-614128-bucket

Closes: #457
Closes: #458

cc @Wauplin @julien-c for visibility

@gradio-pr-bot
Copy link
Copy Markdown
Contributor

gradio-pr-bot commented Mar 30, 2026

🪼 branch checks and previews

Name Status URL
🦄 Changes detected! Details

@gradio-pr-bot
Copy link
Copy Markdown
Contributor

🦄 change detected

This Pull Request includes changes to the following packages.

Package Version
trackio minor

  • Use HF buckets as backend

‼️ Changeset not approved. Ensure the version bump is appropriate for all packages before approving.

  • Maintainers can approve the changeset by checking this checkbox.

Something isn't right?

  • Maintainers can change the version label to modify the version bump.
  • If the bot has failed to detect any changes, or if this pull request needs to update multiple packages to different versions or requires a more comprehensive changelog entry, maintainers can update the changelog file directly.

@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

HuggingFaceDocBuilderDev commented Mar 30, 2026

🪼 branch checks and previews

Name Status URL
Spaces ready! Spaces preview

Install Trackio from this PR (includes built frontend)

pip install "https://huggingface.co/buckets/trackio/trackio-wheels/resolve/db6334051c2be33d33974a27ad5c7dd8915b2fef/trackio-0.20.2-py3-none-any.whl"

Comment thread trackio/README.md
tags:
- trackio
hf_oauth: true
{LINKED_HUB_METADATA}hf_oauth: true
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For #457

@abidlabs abidlabs marked this pull request as ready for review March 31, 2026 08:05
@abidlabs abidlabs requested review from qgallouedec and znation March 31, 2026 08:05
@abidlabs abidlabs requested a review from Saba9 March 31, 2026 08:09
Comment thread trackio/space_volumes.py
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

note that this module will be added to huggingface_hub officially pretty soon

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok great was just going to ask you about that

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@abidlabs
Copy link
Copy Markdown
Member Author

Going to merge this in since we need it for #459 and #460, but let's not release a new version of trackio yet to give us more time to test this

@abidlabs abidlabs merged commit 3e11174 into main Mar 31, 2026
8 of 9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Use buckets instead of datasets when deploying to Spaces In deployed Trackio Spaces, show the linked dataset/bucket

4 participants