tokenise a string

[Matthias Teege]

Moin,

I'm new to python. I try to build a "easy" search interface to a
database table in python. I have a input string like this:
"name=matthias;count>10" or this "location!=thisone". From this input
I try to build a SQL query like this: select * from tbl where
nme='matthias' and cnt > 10.

So I must parse the input, build tokens and map the fieldnames. Is
there a special modul which I can use or are the standard string
functions adequate?

Many thanks
Matthias
--
Matthias Teege -- http://www.mteege.de
make world not war

[Cousin Stanley]

On 2004-10-09, Matthias Teege <ma************@mteege.de> wrote:

Moin,
....
So I must parse the input, build tokens and map the fieldnames.

Is there a special modul which I can use
or are the standard string functions adequate?

Matthias ....

You might check the tokenize module ....

import tokenize

help( tokenize )

I only know of it, but have never used it myself ....
--
Cousin Stanley
Human Being
Phoenix, Arizona

[Lonnie Princehouse]

The tokenize module is only useful for parsing Python code. That
said, reading the code of tokenize.py might be helpful in writing your
own tokenizer.

Look into the re (regular expression) module, or PLY or Spark if you
need more sophisticated parsers.

Also check out SQLObject (http://sqlobject.org/) --- it makes SQL
almost pleasant =)

Cousin Stanley <co***********@hotmail.com> wrote in message news:<2s*************@uni-berlin.de>...

On 2004-10-09, Matthias Teege <ma************@mteege.de> wrote:

Moin,
....
So I must parse the input, build tokens and map the fieldnames.

Is there a special modul which I can use
or are the standard string functions adequate?

Matthias ....

You might check the tokenize module ....

import tokenize

help( tokenize )

I only know of it, but have never used it myself ....

[M.E.Farmer]

Matthias Teege <ma************@mteege.de> wrote in message

I have a input string like this:
"name=matthias;count>10" or this "location!=thisone".
So I must parse the input, build tokens and map the fieldnames. Is
there a special modul which I can use or are the standard string
functions adequate?

Many thanks
Matthias
This might be helpful.
Shlex can do much more, but I have not had the time to explore it.
#python shell#

import shlex
import cStringIO
myFilelikeString = cStringIO.StringIO("name=matthias;count>10")
lexer = shlex.shlex(myFilelikeString)
while 1:

.... token = lexer.get_token()
.... if token:
.... print token
.... else:
.... break
....
name
=
matthias
;
count

Also look at PySourceColor that I posted it covers token and tokenize.
HTH,
M.E.Farmer