datamining .txt-files, library?

[globalrev]

i have a big collection of .txt files that i want to open and parse to
extract information.

is there a library for this or maybe even built in?

[Chris]

On May 15, 2:27*pm, globalrev <[e-mail]:

i have a big collection of .txt files that i want to open and parse to
extract information.

is there a library for this or maybe even built in?

os.open to open the files and iterate through it and built in string
functions to parse it.

[George Sakkis]

On May 15, 8:27*am, globalrev <[e-mail]:

i have a big collection of .txt files that i want to open and parse to
extract information.

is there a library for this or maybe even built in?

This has a lot to do with how well-structured are your files and what
kind of information you hope to extract (shallow or deep). NLTK might
be a good starting point: http://nltk.sourceforge.net/

George

[globalrev]

On 15 Maj, 14:40, George Sakkis <[e-mail]:

On May 15, 8:27 am, globalrev <[e-mail]:

i have a big collection of .txt files that i want to open and parse to
extract information.

is there a library for this or maybe even built in?

This has a lot to do with how well-structured are your files and what
kind of information you hope to extract (shallow or deep). NLTK might
be a good starting point:http://nltk.sourceforge.net/

George

superstructured, 10K+files, all look the same.

[Ville M. Vainio]

Chris <cw****@gmail.comwrites:

On May 15, 2:27*pm, globalrev <[e-mail]:

>i have a big collection of .txt files that i want to open and parse to
extract information.

is there a library for this or maybe even built in?

os.open to open the files and iterate through it and built in string
functions to parse it.

Or more probably, regular expression library "re".

[Bruno Desthuilliers]

Chris a écrit :

On May 15, 2:27 pm, globalrev <[e-mail]:

>i have a big collection of .txt files that i want to open and parse to
extract information.

is there a library for this or maybe even built in?

os.open to open the files

What's wrong with (builtin) open ?

[martindesalinas]

look at module re (rgular expression) or pyparser

see http://nedbatchelder.com/text/python-parsers.html

[castironpi]

On May 16, 3:22*am, [e-mail] wrote:

look at module re (rgular expression) or pyparser

seehttp://nedbatchelder.com/text/python-parsers.html

This ties in to 'call tree tool?' from yesterday. Do we have any
visualization modules? My two examples were 're' and 'call trees'