How can I view the source of a webpage using webread

Hi,

I am trying to load data from the following webpage http://flow.gassco.no/ by using the following two lines:

URL = 'http://flow.gassco.no/';
out = webread(URL)

However, in the output file (out) I only get a set of the data on the webpage.

Is it somehow possible to load the 'view source' of the webpage to Matlab?

[José-Luis]

I am not sure I follow. What you get from webread() is the source code for the page. If you want to access the data behind the links in the html that's a different story.

[Christian Præstegaard Sørensen]

Hi José-Luis,

I would like to access the data behind the link. Do you know how I could do that?

[Guillaume]

The main problem is that when you first ask for the page, you get a disclaimer that you must agree to before it updates itself with the data.

So, when matlab requests the page it gets the disclaimer. I don't think that there is a way for webread to agree to that disclaimer (the obvious webread([URL, '?acceptDisclaimer=Accept']) does not work) so I don't think that there is a way for you to download that content from matlab.

Answer 1

[Pavithra Ashok Kumar]

Hi

From your description, I am assuming you are trying to create a web crawler. In that case, you would have to use "webread" on the links (obtained from the page) to read the data of the .html page. if this is not what you are looking for, could you give a sample input and the corresponding output expected to explain your requirement?

[Christian Præstegaard Sørensen]

Hi Pavithra,

Sorry, but "webread" is new to me, so I have no idea how to solve my issue.

If I go to a crome-browser and enter "view-source:http://flow.gassco.no/" I can see the text I would like to load into Matlab. Do you have an idea how I can access it from Matlab.

/Christian