how to search multiple textfiles ?

[Stef Mientki]

hello,

I want to search multiple textfiles (python source files) for a specific
word.
I can find all files, open them and do a search,
but I guess that will be rather slow.

I couldn't find any relevant information through google.

Does anyone know of a search library that performs this task fast ?

If it indeed only concerns py-files,
is there another way of searching words ?
( I could imagine that such a "py-only-search" would have benefits,
because you could set a flag to see the words in comment yes or no )

thanks,
Stef Mientki
Het UMC St Radboud staat geregistreerd bij de Kamer van Koophandel in het handelsregister onder nummer 41055629.
The Radboud University Nijmegen Medical Centre is listed in the Commercial Register of the Chamber of Commerce under file number 41055629.

[Mike Driscoll]

On Sep 26, 8:35*am, Stef Mientki <s.mien...@ru.n lwrote:

hello,

I want to search multiple textfiles (python source files) for a specific
word.
I can find all files, open them and do a search,
but I guess that will be rather slow.

I couldn't find any relevant information through google.

Does anyone know of a search library that performs this task fast ?

If it indeed only concerns py-files,
is there another way of searching words ?
( I could imagine that such a "py-only-search" would have benefits,
because you could set a flag to see the words in comment yes or no )

thanks,
Stef Mientki

Het UMC St Radboud staat geregistreerd bij de Kamer van Koophandel in hethandelsregis ter onder nummer 41055629.
The Radboud University Nijmegen Medical Centre is listed in the Commercial Register of the Chamber of Commerce under file number 41055629.

On Windows I use the free version of Bare Grep: http://www.baremetalsoft.com/baregrep/

No, it's not a Python solution, but it works for my needs. You should
try using Python to search your script files and see if it really is
too slow though.

Mike

[George Sakkis]

On Sep 26, 9:35 am, Stef Mientki <s.mien...@ru.n lwrote:

hello,

I want to search multiple textfiles (python source files) for a specific
word.
I can find all files, open them and do a search,
but I guess that will be rather slow.

I couldn't find any relevant information through google.

Does anyone know of a search library that performs this task fast ?

If it indeed only concerns py-files,
is there another way of searching words ?
( I could imagine that such a "py-only-search" would have benefits,
because you could set a flag to see the words in comment yes or no )

If you're on *nix platform, you can use:

$ find -name "*py" | xargs egrep "\bword\b"

HTH,
George

[Méta-MCI \(MVP\)]

Hi!

On Windows, you can use the (standard) command findstr

Example:
findstr /n /s /I strsearched *.py

@-salutations
--
Michel Claveau

[Paul Rubin]

Stef Mientki <s.*******@ru.n lwrites:

Does anyone know of a search library that performs this task fast ?

You mean you want a Python search engine (with inverted indexes and all that)?
Try: nucular.sf.net

[Sean DiZazzo]

On Sep 26, 6:35*am, Stef Mientki <s.mien...@ru.n lwrote:

hello,

I want to search multiple textfiles (python source files) for a specific
word.
I can find all files, open them and do a search,
but I guess that will be rather slow.

I couldn't find any relevant information through google.

Does anyone know of a search library that performs this task fast ?

If it indeed only concerns py-files,
is there another way of searching words ?
( I could imagine that such a "py-only-search" would have benefits,
because you could set a flag to see the words in comment yes or no )

thanks,
Stef Mientki

Het UMC St Radboud staat geregistreerd bij de Kamer van Koophandel in hethandelsregis ter onder nummer 41055629.
The Radboud University Nijmegen Medical Centre is listed in the Commercial Register of the Chamber of Commerce under file number 41055629.

I use 'fgrep' ie... `fgrep -r "toFind" /source`

~Sean

[Méta-MCI \(MVP\)]

Hi !

Thanks for return.

Some infos: from a long time, I found that it's often more fast to use
windows's command, instead of develop in high level language (and also,
low level...)

FINDSTR is fast. OK. But internal commands are more fast. Example : DIR
(with all his options)
And it's faster to read the result via a Pipe.
Thus, I use frequently this sort of function:
import os

def cmdone(repstart , commande, moderetour="LIS T"):
os.chdir(repsta rt)
sret=''.join(os .popen(commande ))
if moderetour.uppe r() == "STR":
return sret
else:
return sret.split('\n' )

print cmdone('D:\\dev \\python','find str /N /I ponx *.py','STR')
print
print cmdone('D:\\dev \\python','dir *.jpg /B')


Sorry for my bad english, and have a good day...
--
Michel Claveau

[Lawrence D'Oliveiro]

In message
<bf************ *************** *******@k30g200 0hse.googlegrou ps.com>, George
Sakkis wrote:

$ find -name "*py" | xargs egrep "\bword\b"

Better:

find -name '*.py' -exec grep -E "\bword\b" {} \;

[George Sakkis]

On Sep 29, 5:16*am, Lawrence D'Oliveiro <l...@geek-
central.gen.new _zealandwrote:

In message
<bf1664da-1e2e-48c8-a108-66b0fb457...@k3 0g2000hse.googl egroups.com>, George

Sakkis wrote:

$ find -name "*py" | xargs egrep "\bword\b"

Better:

* * find -name '*.py' -exec grep -E "\bword\b" {} \;

In what way is this better ? I don't dispute it, I'm just curious.

[Lawrence D'Oliveiro]

In message <ma************ *************** ***********@pyt hon.org>, Stef
Mientki wrote:

Lawrence D'Oliveiro wrote:

>In message <ma************ *************** ***********@pyt hon.org>, Stef
Mientki wrote:

>>I'm really amazed by the speed of Python !!
It can only be beaten by findstr, which is only available on windows.

Did you try find -exec grep -F?

well my windows version doesn't understand that :

I assumed when you said "It can only be beaten by findstr, which is only
available on windows", that meant you had tried some non-Windows options,
before concluding that Windows "findstr" was the fastest.