how shall I read/write/add-write big data in MatLab?

1 visualizzazione (ultimi 30 giorni)
vx2008
vx2008 il 1 Gen 2017
Commentato: vx2008 il 2 Gen 2017
I set big data in variable X and Now I want to save it on my hard disk;
I use "save output X", and get warning: "out of memory";
I use "xlswrite('output.xlsx',X)", and get warnning: it is too big for this format;
Now how shall I write this big data and especially what if I want to add other data for other code into the "output" and how shall I read it out if it is too big?

Risposte (2)

Walter Roberson
Walter Roberson il 1 Gen 2017
If it is a numeric array, you could fwrite() it as a binary file.
For non-numeric items sometimes using memory mapping is appropriate.
You might be able to use the matFile interface to save part of it at a time.
  2 Commenti
vx2008
vx2008 il 2 Gen 2017
thanks a lot! I now try to use "dlmwrite/dlmread' and it is ok; thanks everyone.

Accedi per commentare.


Image Analyst
Image Analyst il 1 Gen 2017
One option is to split the workbook up into smaller workbooks, if there is anyway that makes sense, otherwise just arbitrarily at rows like 'firstHalf.xlsx' and 'secondHalf.xlsx'.

Categorie

Scopri di più su Large Files and Big Data in Help Center e File Exchange

Tag

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by