Skip to content

Files inconsistently present/absent from metadata API while consistently present in WaterButler storage (de-1 instance) #11721

@leoauri

Description

@leoauri

When uploading a batch of 430 files to the de-1 instance, 20 files per run are consistently in an inconsistent state:

  • GET /v2/nodes/{id}/files/osfstorage/ does not list them
  • Attempting to upload them returns 409 (WaterButler confirms they exist in storage)
  • They are visible in the Fangorn file browser (WaterButler listing)

The pattern cycles: after deleting and re-uploading the 20 affected files, a subsequent metadata API listing shows a different 20 files missing. The total count in the metadata API stays fixed at 410/430 regardless of how many fix cycles are run.

Notably, the files reported as missing by the metadata API are sometimes the same files returned by the metadata API seconds earlier during a pre-fetch — suggesting API inconsistency across requests rather than missing data.

Instance: de-1 (files.de-1.osf.io)
Project: vskp7
Storage: osfstorage

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions