Working on large .db file (database file) using MapReduce?

2 visualizzazioni (ultimi 30 giorni)
I have a very large signal file stored in a sqlite database file, it over 100 gb. I have the code section for extracting the data over to a matrix in matlab and storing it in a ,mat file, which has worked fine for small signals. However, I would like to do this to the large signal also but the signal is too large for memory.
I read that you can work on large files using MapReduce, however i only see how to use this with .csv files or other types of table data.
Is it possible to use MapReduce with this type of file? Or are there any other method to work on this signal without loading it into memory in its entirety?

Risposte (0)

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by