big differences in saving variables

1 visualizzazione (ultimi 30 giorni)
Abolfazl Nejatian
Abolfazl Nejatian il 24 Set 2020
Commentato: Mario Malic il 26 Set 2020
Hi,
i need to save some tables and variables as Mat and CSV files.
but I have faced a strange behavior on saving the files.
when I save my file and evaluate the time of each of them individually, the saving time much less than I evaluate total saving time.
I also should mention the true elapsed time is a bigger time.
here are my code and output,
folderAddress = 'D:\Nejatian\';
tic
delete([folderAddress 'signals.csv'])
delete([folderAddress 'LatestSignals.csv'])
t1 = toc;
tic
writetable(T,[folderAddress 'signals.csv']);
t2 = toc;
tic
writetable(lT,[folderAddress 'LatestSignals.csv'])
t3 = toc;
tic
save([folderAddress 'visualData'],'visualData')
t4 = toc;
tic
delete('workspace.mat')
save('workspace.mat');
t5 = toc;
str1 = string(['Deleting CSV files = ' num2str(t1) 'Sec']);
str2 = string(['Writing CSV file one = ' num2str(t2) 'Sec']);
str3 = string(['Writing CSV file one = ' num2str(t3) 'Sec']);
str4 = string(['Saving Mat file from a struct variable = ' num2str(t1) 'Sec']);
str5 = string(['Saving all workspace variables = ' num2str(t1) 'Sec']);
disp([str1;str2;str3;str4;str5]);
  • Deleting CSV files = 0.0320444Sec
  • Writing CSV file one = 1.99078Sec
  • Writing CSV file one = 0.273289Sec
  • Saving Mat file from a struct variable = 0.0120444Sec
  • Saving all workspace variables = 0.00220444Sec
and the total time is
tic
folderAddress = 'D:\Nejatian\';
delete([folderAddress 'signals.csv'])
delete([folderAddress 'LatestSignals.csv'])
writetable(T,[folderAddress 'signals.csv']);
writetable(lT,[folderAddress 'LatestSignals.csv'])
save([folderAddress 'visualData'],'visualData')
delete('workspace.mat')
save('workspace.mat');
t=toc;
str = string(['Total time = ' num2str(t) 'Sec']);
disp(str);
  • Total time = 78.3331Sec
why this big difference happens and how i can speed up my File saving time?
i mean is there any way to parallelize or decompressed the output for reducing the saving file?
  5 Commenti
Abolfazl Nejatian
Abolfazl Nejatian il 26 Set 2020
Dear Mario,
yep im agree with you.
Delete function should use for CSV or text files
this line of code can be omitted.
Mario Malic
Mario Malic il 26 Set 2020
There's an option -nocompression, but I don't know if it would make things different.

Accedi per commentare.

Risposte (0)

Categorie

Scopri di più su Shifting and Sorting Matrices in Help Center e File Exchange

Prodotti


Release

R2020b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by