通过NAS读取H5文件

发布于 2025-01-28 00:29:09 字数 2198 浏览 2 评论 0原文

我正在从远程读取H5文件,以前是在服务器上,但最近我不得不将其中存储在NAS设备上。当我试图阅读NAS上的内容时,对于其中一些,我有以下错误:

HDF5ExtError: HDF5 error back trace

  File "C:\ci\hdf5_1593121603621\work\src\H5Dio.c", line 199, in H5Dread
    can't read data
  File "C:\ci\hdf5_1593121603621\work\src\H5Dio.c", line 603, in H5D__read
    can't read data
  File "C:\ci\hdf5_1593121603621\work\src\H5Dcontig.c", line 621, in H5D__contig_read
    contiguous read failed
  File "C:\ci\hdf5_1593121603621\work\src\H5Dselect.c", line 283, in H5D__select_read
    read error
  File "C:\ci\hdf5_1593121603621\work\src\H5Dselect.c", line 218, in H5D__select_io
    read error
  File "C:\ci\hdf5_1593121603621\work\src\H5Dcontig.c", line 956, in H5D__contig_readvv
    can't perform vectorized sieve buffer read
  File "C:\ci\hdf5_1593121603621\work\src\H5VM.c", line 1500, in H5VM_opvv
    can't perform operation
  File "C:\ci\hdf5_1593121603621\work\src\H5Dcontig.c", line 753, in H5D__contig_readvv_sieve_cb
    block read failed
  File "C:\ci\hdf5_1593121603621\work\src\H5Fio.c", line 118, in H5F_block_read
    read through page buffer failed
  File "C:\ci\hdf5_1593121603621\work\src\H5PB.c", line 732, in H5PB_read
    read through metadata accumulator failed
  File "C:\ci\hdf5_1593121603621\work\src\H5Faccum.c", line 260, in H5F__accum_read
    driver read request failed
  File "C:\ci\hdf5_1593121603621\work\src\H5FDint.c", line 205, in H5FD_read
    driver read request failed
  File "C:\ci\hdf5_1593121603621\work\src\H5FDsec2.c", line 725, in H5FD_sec2_read
    file read failed: time = Tue May 10 11:37:06 2022
, filename = 'Y:/myFolder\myFile.h5', file descriptor = 4, errno = 22, error message = 'Invalid argument', buf = 0000020F03F14040, total read size = 16560000, bytes this sub-read = 16560000, bytes actually read = 18446744073709551615, offset = 480252764

End of HDF5 error back trace

Problems reading the array data.

我真的不了解错误,它总是会出现相同的文件,但是我可以打开文件并阅读数据我自己与hdfview。如果我将其放在服务器上,我可以在相同的代码行中毫无问题地读取它(两者都正确):

hdf5store = pd.HDFStore(myPath[fich])
        
datacopy = hdf5store['my_data']

顺便说明该错误发生在此第二行代码上。现在,我无法访问服务器,也无法在本地复制文件,因为我没有足够的空间。如果有人知道如何纠正此问题,以便我可以继续通过NAS工作?

I'm reading h5 files from remote, previously it was on a server but more recently I had to store some on a NAS device. When I'm trying to read the ones on the NAS, for some of them I have the following error:

HDF5ExtError: HDF5 error back trace

  File "C:\ci\hdf5_1593121603621\work\src\H5Dio.c", line 199, in H5Dread
    can't read data
  File "C:\ci\hdf5_1593121603621\work\src\H5Dio.c", line 603, in H5D__read
    can't read data
  File "C:\ci\hdf5_1593121603621\work\src\H5Dcontig.c", line 621, in H5D__contig_read
    contiguous read failed
  File "C:\ci\hdf5_1593121603621\work\src\H5Dselect.c", line 283, in H5D__select_read
    read error
  File "C:\ci\hdf5_1593121603621\work\src\H5Dselect.c", line 218, in H5D__select_io
    read error
  File "C:\ci\hdf5_1593121603621\work\src\H5Dcontig.c", line 956, in H5D__contig_readvv
    can't perform vectorized sieve buffer read
  File "C:\ci\hdf5_1593121603621\work\src\H5VM.c", line 1500, in H5VM_opvv
    can't perform operation
  File "C:\ci\hdf5_1593121603621\work\src\H5Dcontig.c", line 753, in H5D__contig_readvv_sieve_cb
    block read failed
  File "C:\ci\hdf5_1593121603621\work\src\H5Fio.c", line 118, in H5F_block_read
    read through page buffer failed
  File "C:\ci\hdf5_1593121603621\work\src\H5PB.c", line 732, in H5PB_read
    read through metadata accumulator failed
  File "C:\ci\hdf5_1593121603621\work\src\H5Faccum.c", line 260, in H5F__accum_read
    driver read request failed
  File "C:\ci\hdf5_1593121603621\work\src\H5FDint.c", line 205, in H5FD_read
    driver read request failed
  File "C:\ci\hdf5_1593121603621\work\src\H5FDsec2.c", line 725, in H5FD_sec2_read
    file read failed: time = Tue May 10 11:37:06 2022
, filename = 'Y:/myFolder\myFile.h5', file descriptor = 4, errno = 22, error message = 'Invalid argument', buf = 0000020F03F14040, total read size = 16560000, bytes this sub-read = 16560000, bytes actually read = 18446744073709551615, offset = 480252764

End of HDF5 error back trace

Problems reading the array data.

I don't really understand the error, it always happend for the same files, but I can open the file and read the data myself with HDFView. If I put it on the server I can read it without problem with the same lines of code (path is correct for both):

hdf5store = pd.HDFStore(myPath[fich])
        
datacopy = hdf5store['my_data']

Btw the error occurs at this 2nd line of code. Right now I don't have access to the server and can't copy the file on local because I don't have enough space. If anyone know how to correct this so I could continue to work through the NAS ?

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。
列表为空,暂无数据
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文