tokfun

This program reduces an entered string into sentences.

The following program reduces an enterd string into sentences. It can also be utilised reduce the string into words.

This program is supported by two function :
a) isdelimiter,
b) token.

They both are included in the tokfun.zip.

isdelimiter returns a matrix and basically identifies delimiters such as full-stop, comma,space,etc. This list can be increased or reduced.

token is an implementation of MATLAB standard function strtok.