Skip to content

Byte range support failing #2643

@dopplershift

Description

@dopplershift

As noted recently at the end of Unidata/netcdf4-python#1043, the following URL https://crudata.uea.ac.uk/cru/data/temperature/HadCRUT.4.6.0.0.median.nc\#mode\=bytes fails with both ncdump and netcdf4-python's Dataset class with:

ncdump: https://crudata.uea.ac.uk/cru/data/temperature/HadCRUT.4.6.0.0.median.nc#mode=bytes: NetCDF: HDF error

I think this might be the same data as was working as a test when #1849 was merged, but under a new DNS (but still actually being served from S3 using a CNAME).

Note that using h5dump, you can successfully get the data through the ROS3 driver:

❯ h5dump -pBH --filedriver=ros3 https://crudata.uea.ac.uk/cru/data/temperature/HadCRUT.4.6.0.0.median.nc
HDF5 "https://crudata.uea.ac.uk/cru/data/temperature/HadCRUT.4.6.0.0.median.nc" {
SUPER_BLOCK {
   SUPERBLOCK_VERSION 2
   FREELIST_VERSION 0
   SYMBOLTABLE_VERSION 0
   OBJECTHEADER_VERSION 0
   OFFSET_SIZE 8
   LENGTH_SIZE 8
   BTREE_RANK 16
   BTREE_LEAF 4
   ISTORE_K 32
   FILE_SPACE_STRATEGY H5F_FSPACE_STRATEGY_FSM_AGGR
   FREE_SPACE_PERSIST FALSE
   FREE_SPACE_SECTION_THRESHOLD 1
   FILE_SPACE_PAGE_SIZE 4096
   USER_BLOCK {
      USERBLOCK_SIZE 0
   }
}
GROUP "/" {
   ATTRIBUTE "Conventions" {
      DATATYPE  H5T_STRING {
         STRSIZE 6;
         STRPAD H5T_STR_NULLTERM;
         CSET H5T_CSET_ASCII;
         CTYPE H5T_C_S1;
      }
      DATASPACE  SCALAR
   }
   ATTRIBUTE "comment" {
      DATATYPE  H5T_STRING {
         STRSIZE 1;
         STRPAD H5T_STR_NULLTERM;
         CSET H5T_CSET_ASCII;
         CTYPE H5T_C_S1;
      }
      DATASPACE  SCALAR
   }
   ATTRIBUTE "ensemble_member_index" {
      DATATYPE  H5T_STD_I16LE
      DATASPACE  SIMPLE { ( 1 ) / ( 1 ) }
   }
<SNIP>

Metadata

Metadata

Labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions