work with huge matrix

Hello, I have a matrix of which dimension is so huge (10^6 column and 37 rows). I have to do some computation with this matrix, like multiple, divide,...

But when I try to proceed computations with this matrix, the matlab could not work, it shows some problems with limitation of dimensions and memory.

So I plan to divide the matrix into 4 small matrix, and redo the job for each partitioned matrix. But it seems very tedious.

Is there anyone having an idea to deal with this issue?

Thank you,

[Walter Roberson]

In some cases tall array can take care of the work for you. However I wonder if your computations are correct. Is it intended that the computation for each column is independent of the other columns?

Answer 1

[madhan ravi]

As you said it’s also better you split the main huge matrix into subsets using rows which are few compared to columns

Answer 2

[Steven Lord]

Is the orientation of your data fixed? If you can store and work with your data in a matrix with many rows and a few columns (rather than the other way around) and your data has few non-zero elements consider storing it as a sparse matrix.

If not, as Walter suggested I'd consider using tall arrays constructed from a datastore.