How to handle big csv files

I have huge .csv files comming daily and i want to know how i can handle them. For the moment, only to have an idea, i run a python script first in order to decrease the size by averaging the file. Is splitting the big file the only option i have?

P.S. one line of my file looks like:

00:00:0;0.0;0.00540500736377

Answer 1

[Walter Roberson]

See https://www.mathworks.com/help/matlab/datastore.html for the general solution.

Another approach is to fopen() the file, and textscan() using a repeat count (a number as the parameter after the format string) to control how many lines are read at a time; you would read a chunk, process it, go back to read another chunk, and so on.