I have a string s, possibly megabytes in size, and two regexps, p and q.
I want to find the first occurence of q that occurs after the first
occurence of p.
Is there a reasonable way to do it?
g1 = re.search(p, s)
g2 = re.search(q, s[g1.end():])
q_offset = g1.end() + g2.start()
is not a reasonable way, since it copies a ton of data around
(slicing an arbitrary sized chunk off s into a new temporary string).
Most regexps libs I know of have a way to start the search at a
specified offset. Python's string.find and string.index methods
have a similar optional arg. But I don't see it described in the
re module docs.
Am I missing something?
Thanks. 4 1869
"Paul Rubin" <http://ph****@NOSPAM.invalid> wrote in message
news:7x***************@ruckus.brouhaha.com... I have a string s, possibly megabytes in size, and two regexps, p and q.
I want to find the first occurence of q that occurs after the first occurence of p.
Is there a reasonable way to do it?
g1 = re.search(p, s) g2 = re.search(q, s[g1.end():]) q_offset = g1.end() + g2.start()
is not a reasonable way, since it copies a ton of data around (slicing an arbitrary sized chunk off s into a new temporary string).
Most regexps libs I know of have a way to start the search at a specified offset. Python's string.find and string.index methods have a similar optional arg. But I don't see it described in the re module docs.
Am I missing something?
Yes: you can specify an offset, but only in the search METHOD (of re
objects), not the search function (for that, you just use slicing of the
string, see?)
Alternative 1:
Instead of slicing the string, make a buffer object that references to a
slice of the string (using the buffer() builtin)
NOTE: Don't do this!
Alternative 2:
Compile a regular expression object for p and q, instead of doing a match.
Since I don't know the implementation details or re, I don't know if the
start/end args to REOBJECT.search will copy the string or use a buffer--so
that may not be different from what you're doing. However, compiling the re
will certainly be faster, if you do this search more than once.
(NOTE: untested code!)
p = re.compile(ppattern)
q = re.compile(qpattern)
matchp = p.search(somestring)
pend = matchp.end()
matchq = q.search(somestring, pend)
qstart = matchq.start()
Now I'm not sure if matchq.start() returns index from the substring or the
whole string. You'll just have to try it and see...
if counts from substring:
offset = matchq.pos + matchq.start() # == matchp.end() + matchq.start().
else:
offset = matchq.start()
Alternative 3:
You could probably combine p and q into a single regexp specifying that you
match p, then q, with anything inbetween. Using groups (p is grp 1, q is
grp 2), get your offset with matchpq.end(1) + matchpq.start(2)
There are probably many other ways.
Thanks.
No problem.
--
Francis Avila
"Francis Avila" <fr***********@yahoo.com> wrote in message
news:vp***********@corp.supernews.com... Alternative 3: You could probably combine p and q into a single regexp specifying that
you match p, then q, with anything inbetween. Using groups (p is grp 1, q is grp 2), get your offset with matchpq.end(1) + matchpq.start(2)
Gah, that's wrong: the offset of q will be in matchpq.start(2).
--
Francis Avila
"Francis Avila" <fr***********@yahoo.com> writes: Yes: you can specify an offset, but only in the search METHOD (of re objects), not the search function (for that, you just use slicing of the string, see?)
Thanks, this is what I wanted. I missed it when first looking at the
doc. I just need to compile the regexp separately. Slight nuisance
but no big deal.
Paul Rubin wrote: I have a string s, possibly megabytes in size, and two regexps, p and q.
I want to find the first occurence of q that occurs after the first occurence of p.
Is there a reasonable way to do it?
g1 = re.search(p, s) g2 = re.search(q, s[g1.end():]) q_offset = g1.end() + g2.start()
is not a reasonable way, since it copies a ton of data around (slicing an arbitrary sized chunk off s into a new temporary string).
Most regexps libs I know of have a way to start the search at a specified offset. Python's string.find and string.index methods have a similar optional arg. But I don't see it described in the re module docs.
Am I missing something?
Thanks.
Can't you just combine the two regexps? for example if p='abc' and
q='stu', can't you compile and match against something like the following:
import re
pq=re.compile(r'abc.*?(stu)')
s=pq.search('aaass_abcsd_stuqwer_stu')
s.start(1) 12
Notice i used .*?, the non greedy match to return the first occurrence
of q after p. This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics
by: Anand Pillai |
last post by:
To search a word in a group of words, say a paragraph or a web page,
would a string search or a regexp search be faster?
The string search would of course be,
if str.find(substr) != -1:...
|
by: Lukas Holcik |
last post by:
Hi Python crazies!:))
There is a problem to be solved. I have a text and I have to parse
it using a lot of regular expressions. In (lin)u(ni)x I could write in
bash:
cat file | sed 's/../../' |...
|
by: Lukas Holcik |
last post by:
Hi everyone!
How can I simply search text for regexps (lets say <a
href="(.*?)">(.*?)</a>) and save all URLs(1) and link contents(2) in a
dictionary { name : URL}? In a single pass if it could....
|
by: Rizyak |
last post by:
********************
alt.php.sql,comp
databases.ms-sqlserver
microsoft.public.sqlserver.programming
***********************************
Why doesn't this work:
SELECT *
FROM 'Events'
|
by: Sped Erstad |
last post by:
There must be a simple regexp reason for this little question but it's
driving me nuts. Below is a simple regexp to determine if a string
contains only numbers. I'm running these two strings...
|
by: arno |
last post by:
Hi,
I want to search a substring within a string :
fonction (str, substr) {
if (str.search(substr) != -1) {
// do something
}
}
|
by: Flyzone |
last post by:
Hello,
i have again problem with regexp :-P
I need to match all lines that contain one word but not contain
another.
Like to do "grep one | grep -v two:"
The syntax of the string is:
(any...
|
by: Ben Amada |
last post by:
Hi all. I know very little about regular expressions, but wanted to use one
to validate an email address a user would be entering before the form is
submitted. There are many examples out there. ...
|
by: Paddy |
last post by:
Lets say i have a generator running that generates successive
characters of a 'string'
characters then I would have to 'freeze' the generator and pass the
characters so far to re.search.
It is...
|
by: Faith0G |
last post by:
I am starting a new it consulting business and it's been a while since I setup a new website. Is wordpress still the best web based software for hosting a 5 page website? The webpages will be...
|
by: Charles Arthur |
last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
|
by: aa123db |
last post by:
Variable and constants
Use var or let for variables and const fror constants.
Var foo ='bar';
Let foo ='bar';const baz ='bar';
Functions
function $name$ ($parameters$) {
}
...
|
by: ryjfgjl |
last post by:
If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...
|
by: ryjfgjl |
last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
|
by: emmanuelkatto |
last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud.
Please let me know.
Thanks!
Emmanuel
|
by: nemocccc |
last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
|
by: Sonnysonu |
last post by:
This is the data of csv file
1 2 3
1 2 3
1 2 3
1 2 3
2 3
2 3
3
the lengths should be different i have to store the data by column-wise with in the specific length.
suppose the i have to...
|
by: Hystou |
last post by:
There are some requirements for setting up RAID:
1. The motherboard and BIOS support RAID configuration.
2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
| |