Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
5788385
add zarrs and organize dependency groups
ziw-liu Jul 3, 2025
838e46b
configurable sharding
ziw-liu Jul 3, 2025
cc8bf6d
update chunking test
ziw-liu Jul 3, 2025
dd0771c
use clean env helper
ziw-liu Jul 3, 2025
8c162c5
update example config
ziw-liu Jul 3, 2025
83cd243
disable threading for the zarrs codec
ziw-liu Jul 3, 2025
0ee2e33
test variable sharding in time
ziw-liu Jul 9, 2025
edef626
print the correct cluster name
ziw-liu Jul 9, 2025
203054a
allow blocking
ziw-liu Jul 10, 2025
25c5562
fix typing
ziw-liu Jul 10, 2025
01883f4
wip: test values of the concatenated array
ziw-liu Jul 10, 2025
47db527
Merge branch 'main' into concat-zarr3
ziw-liu Jul 10, 2025
d25a090
fix monitoring
ziw-liu Jul 10, 2025
f7e3555
remove zarrs codec
ziw-liu Jul 10, 2025
65cbea5
tweak resource estimation
ziw-liu Jul 10, 2025
71f5fae
block in testing
ziw-liu Jul 10, 2025
606a0c4
require tensorstore
ziw-liu Jul 10, 2025
8394696
update dependency groups
ziw-liu Jul 11, 2025
ca97861
combine context managers
ieivanov Aug 8, 2025
47605dc
Merge branch 'main' into concat-zarr3
ieivanov Aug 9, 2025
f2cc948
ultrack lazy import
ieivanov Aug 15, 2025
5d73bd4
Merge remote-tracking branch 'origin/main' into lazy_imports
ieivanov Aug 15, 2025
b6442be
style
ieivanov Aug 15, 2025
acd4c14
Merge remote-tracking branch 'origin/lazy_imports' into concat-zarr3
ieivanov Aug 15, 2025
0af810d
Merge branch 'main' into concat-zarr3
ieivanov Sep 2, 2025
980f8b8
point to the pre-release
ziw-liu Sep 12, 2025
e2c223e
Merge branch 'main' into concat-zarr3
srivarra Oct 28, 2025
6fe996b
Merge branch 'main' into concat-zarr3
ieivanov Dec 8, 2025
fbc4ab0
raise error is trying to concatenate zarr stores with pyramids
ieivanov Dec 8, 2025
c67a2f0
Merge branch 'concat-zarr3' of github.com:czbiohub-sf/biahub into con…
ieivanov Dec 9, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion biahub/concatenate.py
Original file line number Diff line number Diff line change
Expand Up @@ -365,7 +365,7 @@ def concatenate(
# Estimate resources
batch_size = settings.shards_ratio[0] if settings.shards_ratio else 1
num_cpus, gb_ram_per_cpu = estimate_resources(
shape=(T // batch_size, C, Z, Y, X), ram_multiplier=4 * batch_size, max_num_cpus=48
shape=(T // batch_size, C, Z, Y, X), ram_multiplier=4 * batch_size, max_num_cpus=16
)
# Prepare SLURM arguments
slurm_args = {
Expand Down
13 changes: 9 additions & 4 deletions pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -47,11 +47,16 @@ dependencies = [
]

[project.optional-dependencies]
# note that dev dependencies are only pinned to major versions
segmentation = ["cellpose"]
sharding = ["tensorstore"]
segment = ["cellpose"]

track = ["ultrack @ git+https://github.com/royerlab/ultrack.git@v0.6.3"]
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this any different than the one from PyPI?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good question - I'm guessing no? @tayllatheodoro may know better


shard = ["tensorstore"]

build = ["build", "twine"]
all = ["biahub[segmentation,sharding,build]"]

all = ["biahub[segment,track,shard,build]"]

dev = [
"biahub[all]",
"black==25.1",
Expand Down
Loading
You are viewing a condensed version of this merge commit. You can view the full changes here.