Skip to content

nccopy must use defaulting when there are no -c parameters#1438

Merged
WardF merged 3 commits intoUnidata:masterfrom
DennisHeimbigner:nccopy-chunking.dmh
Jul 18, 2019
Merged

nccopy must use defaulting when there are no -c parameters#1438
WardF merged 3 commits intoUnidata:masterfrom
DennisHeimbigner:nccopy-chunking.dmh

Conversation

@DennisHeimbigner
Copy link
Copy Markdown
Collaborator

@DennisHeimbigner DennisHeimbigner commented Jul 14, 2019

It used to be that when no -c parameters were specified
(and the input was some variant of netcdf-3) that nccopy
let the netcdf-c library decide on any default chunking.
Now, it attempts to do it itself and is not doing it
correctly when unlimited dimensions are involved.

So fix is to revert to previous behavior.

Note: The chunking rules are getting too complicated; consider revising.

re: issue Unidata#1436

It used to be that when no -c parameters were specified
(and the input was some variant of netcdf-3) that nccopy
let the netcdf-c library decide on any default chunking.
Now, it attempts to do it itself and is not doing it
correctly when unlimited dimensions are involved.

So fix is to revert to previous behavior.

Note: The chunking rules are getting too complicated; consider revising.
@DennisHeimbigner DennisHeimbigner requested a review from WardF as a code owner July 14, 2019 21:22
@WardF WardF self-assigned this Jul 17, 2019
@WardF WardF added this to the 4.7.1 milestone Jul 17, 2019
@WardF
Copy link
Copy Markdown
Member

WardF commented Jul 17, 2019

@DennisHeimbigner Would you mind updating the RELEASE_NOTES.md with a note regarding this? I can also merge it and then update the file if that's easier. Thanks!

@DennisHeimbigner
Copy link
Copy Markdown
Collaborator Author

ok, will do.

@DennisHeimbigner
Copy link
Copy Markdown
Collaborator Author

Ok, Updated RELEASE_NOTES

Copy link
Copy Markdown
Member

@WardF WardF left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Merging.

@WardF
Copy link
Copy Markdown
Member

WardF commented Jul 18, 2019

Well, merging after travis succeeds. It had succeeded before, not sure why it failed now, restarted the tests.

@WardF WardF merged commit 90d3386 into Unidata:master Jul 18, 2019
@DennisHeimbigner DennisHeimbigner deleted the nccopy-chunking.dmh branch March 29, 2020 21:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

nccopy to compressed NetCDF-4 file is magnitudes slower on version 4.6.0+

2 participants