hdfread, NFS, and I/O Performance

2 visualizzazioni (ultimi 30 giorni)
millercommamatt
millercommamatt il 18 Lug 2014
I'm encountering a vexing performance issue.
I have a script that uses the hdfread command to get variables from HDF files stored on a remote directory mounted in Windows via NFS. I wrote a benchmarking script that's telling me that when I try to read data from the network mounted directory, it's taking about 196 seconds per file. If I copy those file to a local directory and point the hdfread command at that directory, it's taking 3 seconds per file.
Here's were things get interesting. Copying and pasting the files in Windows sees them all copied in only a second or two per file. I used the copyfile command to copy the files from the remote directory to a local folder. The per file copy time is 2 seconds per file. It would seem that network I/O doesn't explain the extreme slowness.
Is there something about the hdfread command or its subfunctions that can explain this behavior? Is there some quirk about network file systems at play that I'm not aware of?

Risposte (0)

Categorie

Scopri di più su Downloads in Help Center e File Exchange

Prodotti

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by