Sorry, yet another REGEX question. I've been struggling with trying to get
a regular expression to do the following example in Python:
Search and replace all instances of "sleeping" with "dead".
This parrot is sleeping. Really, it is sleeping.
to
This parrot is dead. Really, it is dead.
But not if part of a link or inside a link:
This parrot <a href="sleeping.htm" target="new">is sleeping</a>. Really, it
is sleeping.
to
This parrot <a href="sleeping.htm" target="new">is sleeping</a>. Really, it
is dead.
This is the full extent of the "html" that would be seen in the text, the
rest of the page has already been processed. Luckily I can rely on the
formating always being consistent with the above example (the url will
normally by much longer in reality though). There may though be more than
one link present.
I'm hoping to use this to implement the automatic addition of links to other
areas of a website based on keywords found in the text.
I'm guessing this is a bit too much to ask for regex. If this is the case,
I'll add some more manual Python parsing to the string, but was hoping to
use it to learn more about regex.
Any pointers would be appreciated.
Martin 6  5833 
Martin Evans wrote:
Sorry, yet another REGEX question. I've been struggling with trying to get
a regular expression to do the following example in Python:
Search and replace all instances of "sleeping" with "dead".
This parrot is sleeping. Really, it is sleeping.
to
This parrot is dead. Really, it is dead.
But not if part of a link or inside a link:
This parrot <a href="sleeping.htm" target="new">is sleeping</a>. Really, it
is sleeping.
to
This parrot <a href="sleeping.htm" target="new">is sleeping</a>. Really, it
is dead.
This is the full extent of the "html" that would be seen in the text, the
rest of the page has already been processed. Luckily I can rely on the
formating always being consistent with the above example (the url will
normally by much longer in reality though). There may though be more than
one link present.
I'm hoping to use this to implement the automatic addition of links to other
areas of a website based on keywords found in the text.
I'm guessing this is a bit too much to ask for regex. If this is the case,
I'll add some more manual Python parsing to the string, but was hoping to
use it to learn more about regex.
Any pointers would be appreciated.
Martin
What you want is:
re.sub(regex, replacement, instring)
The replacement can be a function. So use a function.
def sleeping_to_dead(inmatch):
instr = inmatch.group(0)
if needsfixing(instr):
return instr.replace('sleeping','dead')
else:
return instr
as for the regex, something like
(<a)?[^<>]*(</a>)?
could be a start. It is probaly better to use the regex to recognize
the links as you might have something like
sleeping.sleeping/sleeping/sleeping.html in your urls. Also you
probably want to do many fixes, so you can put them all within the same
replacer function.
"Juho Schultz" <ju**********@pp.inet.fiwrote in message
news:11*********************@l70g2000cwa.googlegro ups.com...
Martin Evans wrote:
>Sorry, yet another REGEX question. I've been struggling with trying to
get
a regular expression to do the following example in Python:
Search and replace all instances of "sleeping" with "dead".
This parrot is sleeping. Really, it is sleeping.
to
This parrot is dead. Really, it is dead.
But not if part of a link or inside a link:
This parrot <a href="sleeping.htm" target="new">is sleeping</a>. Really,
it
is sleeping.
to
This parrot <a href="sleeping.htm" target="new">is sleeping</a>. Really,
it
is dead.
This is the full extent of the "html" that would be seen in the text, the
rest of the page has already been processed. Luckily I can rely on the
formating always being consistent with the above example (the url will
normally by much longer in reality though). There may though be more than
one link present.
I'm hoping to use this to implement the automatic addition of links to
other
areas of a website based on keywords found in the text.
I'm guessing this is a bit too much to ask for regex. If this is the
case,
I'll add some more manual Python parsing to the string, but was hoping to
use it to learn more about regex.
Any pointers would be appreciated.
Martin
What you want is:
re.sub(regex, replacement, instring)
The replacement can be a function. So use a function.
def sleeping_to_dead(inmatch):
instr = inmatch.group(0)
if needsfixing(instr):
return instr.replace('sleeping','dead')
else:
return instr
as for the regex, something like
(<a)?[^<>]*(</a>)?
could be a start. It is probaly better to use the regex to recognize
the links as you might have something like
sleeping.sleeping/sleeping/sleeping.html in your urls. Also you
probably want to do many fixes, so you can put them all within the same
replacer function.
Many thanks for that, the function method looks very useful. My first
working attempt had been to use the regex to locate all links. I then looped
through replacing each with a numbered dummy entry. Then safely do the
find/replaces and then replace the dummy entries with the original links. It
just seems overly inefficient.
>>import SE
>>Editor = SE.SE ('sleeping=dead sleeping.htm== sleeping<==')
Editor ('This parrot <a href="sleeping.htm" target="new">is
sleeping</a>. Really, it is sleeping.'
'This parrot <a href="sleeping.htm" target="new">is sleeping</a>. Really, it
is dead.'
Or:
>>Editor ( (name of htm file), (name of output file) )
Usage: You make an explicit list of what you want and don't want after
identifying the distinctions.
I am currently trying to upload SE to the Cheese Shop which seems to be
quite a procedure. So far I have only been successful uploading the
description, but not the program. Gudidance welcome. In the interim I can
send SE out individually by request.
Regards
Frederic
----- Original Message -----
From: "Martin Evans" <ma****@browns-nospam.co.uk>
Newsgroups: comp.lang.python
To: <py*********@python.org>
Sent: Wednesday, July 05, 2006 1:34 PM
Subject: RegEx conditional search and replace
Sorry, yet another REGEX question. I've been struggling with trying to
get
a regular expression to do the following example in Python:
Search and replace all instances of "sleeping" with "dead".
This parrot is sleeping. Really, it is sleeping.
to
This parrot is dead. Really, it is dead.
But not if part of a link or inside a link:
This parrot <a href="sleeping.htm" target="new">is sleeping</a>. Really,
it
is sleeping.
to
This parrot <a href="sleeping.htm" target="new">is sleeping</a>. Really,
it
is dead.
This is the full extent of the "html" that would be seen in the text, the
rest of the page has already been processed. Luckily I can rely on the
formating always being consistent with the above example (the url will
normally by much longer in reality though). There may though be more than
one link present.
I'm hoping to use this to implement the automatic addition of links to
other
areas of a website based on keywords found in the text.
I'm guessing this is a bit too much to ask for regex. If this is the case,
I'll add some more manual Python parsing to the string, but was hoping to
use it to learn more about regex.
Any pointers would be appreciated.
Martin
--
http://mail.python.org/mailman/listinfo/python-list
On Thu, 06 Jul 2006 08:32:46 +0100, Martin Evans wrote:
"Juho Schultz" <ju**********@pp.inet.fiwrote in message
news:11*********************@l70g2000cwa.googlegro ups.com...
>Martin Evans wrote:
>>Sorry, yet another REGEX question. I've been struggling with trying to
get
a regular expression to do the following example in Python:
Search and replace all instances of "sleeping" with "dead".
This parrot is sleeping. Really, it is sleeping.
to
This parrot is dead. Really, it is dead.
But not if part of a link or inside a link:
This parrot <a href="sleeping.htm" target="new">is sleeping</a>. Really,
it
is sleeping.
to
This parrot <a href="sleeping.htm" target="new">is sleeping</a>. Really,
it
is dead.
This is the full extent of the "html" that would be seen in the text, the
rest of the page has already been processed. Luckily I can rely on the
formating always being consistent with the above example (the url will
normally by much longer in reality though). There may though be more than
one link present.
I'm hoping to use this to implement the automatic addition of links to
other
areas of a website based on keywords found in the text.
I'm guessing this is a bit too much to ask for regex. If this is the
case,
I'll add some more manual Python parsing to the string, but was hoping to
use it to learn more about regex.
Any pointers would be appreciated.
Martin
What you want is:
re.sub(regex, replacement, instring)
The replacement can be a function. So use a function.
def sleeping_to_dead(inmatch):
instr = inmatch.group(0)
if needsfixing(instr):
return instr.replace('sleeping','dead')
else:
return instr
as for the regex, something like
(<a)?[^<>]*(</a>)?
could be a start. It is probaly better to use the regex to recognize
the links as you might have something like
sleeping.sleeping/sleeping/sleeping.html in your urls. Also you
probably want to do many fixes, so you can put them all within the same
replacer function.
... My first
working attempt had been to use the regex to locate all links. I then looped
through replacing each with a numbered dummy entry. Then safely do the
find/replaces and then replace the dummy entries with the original links. It
just seems overly inefficient.
Someone may have made use of
multiline links:
_________________________
This parrot
<a
href="sleeping.htm"
target="new" >
is sleeping
</a>.
Really, it is sleeping.
_________________________
In such a case you may need to make the page
into one string to search if you don't want to use some complex
method of tracking state with variables as you move from
string to string. You'll also have to make it possible
for non-printing characters to have been inserted in all sorts
of ways around the '>' and '<' and 'a' or 'A'
characters using ' *' here and there in he regex.
"mbstevens" <NO***********@XmbstevensX.comwrote in message
news:pa****************************@XmbstevensX.co m...
On Thu, 06 Jul 2006 08:32:46 +0100, Martin Evans wrote:
>"Juho Schultz" <ju**********@pp.inet.fiwrote in message
news:11*********************@l70g2000cwa.googlegr oups.com...
>>Martin Evans wrote:
Sorry, yet another REGEX question. I've been struggling with trying to
get
a regular expression to do the following example in Python:
Search and replace all instances of "sleeping" with "dead".
This parrot is sleeping. Really, it is sleeping.
to
This parrot is dead. Really, it is dead.
But not if part of a link or inside a link:
This parrot <a href="sleeping.htm" target="new">is sleeping</a>.
Really,
it
is sleeping.
to
This parrot <a href="sleeping.htm" target="new">is sleeping</a>.
Really,
it
is dead.
This is the full extent of the "html" that would be seen in the text,
the
rest of the page has already been processed. Luckily I can rely on the
formating always being consistent with the above example (the url will
normally by much longer in reality though). There may though be more
than
one link present.
I'm hoping to use this to implement the automatic addition of links to
other
areas of a website based on keywords found in the text.
I'm guessing this is a bit too much to ask for regex. If this is the
case,
I'll add some more manual Python parsing to the string, but was hoping
to
use it to learn more about regex.
Any pointers would be appreciated.
Martin
What you want is:
re.sub(regex, replacement, instring)
The replacement can be a function. So use a function.
def sleeping_to_dead(inmatch):
instr = inmatch.group(0)
if needsfixing(instr):
return instr.replace('sleeping','dead')
else:
return instr
as for the regex, something like
(<a)?[^<>]*(</a>)?
could be a start. It is probaly better to use the regex to recognize
the links as you might have something like
sleeping.sleeping/sleeping/sleeping.html in your urls. Also you
probably want to do many fixes, so you can put them all within the same
replacer function.
... My first
working attempt had been to use the regex to locate all links. I then
looped
through replacing each with a numbered dummy entry. Then safely do the
find/replaces and then replace the dummy entries with the original links.
It
just seems overly inefficient.
Someone may have made use of
multiline links:
_________________________
This parrot
<a
href="sleeping.htm"
target="new" >
is sleeping
</a>.
Really, it is sleeping.
_________________________
In such a case you may need to make the page
into one string to search if you don't want to use some complex
method of tracking state with variables as you move from
string to string. You'll also have to make it possible
for non-printing characters to have been inserted in all sorts
of ways around the '>' and '<' and 'a' or 'A'
characters using ' *' here and there in he regex.
I agree, but luckily in this case the HREF will always be formated the same
as it happens to be inserted by another automated system, not a user. Ok it
be changed by the server but AFAIK it hasn't for the last 6 years. The text
in question apart from the links should be plain (not even <bis allowed I
think).
I'd read about back and forward regex matching and thought it might somehow
be of use here ie back search for the "<A" and forward search for the "</A>"
but of course this would easily match in between two links.
mbstevens wrote:
In such a case you may need to make the page
into one string to search if you don't want to use some complex
method of tracking state with variables as you move from
string to string.
In general it's a very hard problem to do stateful regexes.
I recall something from last year about the new Perl implementation
that tried to address this sort of problem. But I may have been
reading old docs and it could have been done years ago.
Parsing the HTML would be the only sure way to accomplish
it. Let something that already knows the hierarchy tell you
that you're entering a URL and you can skip past all of its
recursive inclusions of strings with URLs with strings that
have URLs and so on...
Of course, that means reconstructing the HTML from the
parse tree afterward...
--Blair This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics
by: Peter Kleiweg |
last post by:
I want to use regular expressions with less typing. Like this:
A / 'b.(..)' # test for regex 'b...' in A
A # get the last whole match
A # get the first group in the...
|
by: Jon Maz |
last post by:
Hi All,
Am getting frustrated trying to port the following (pretty simple) function
to CSharp. The problem is that I'm lousy at Regular Expressions....
//from...
|
by: bill tie |
last post by:
I'd appreciate it if you could advise.
1. How do I replace "\" (backslash) with anything?
2. Suppose I want to replace
(a) every occurrence of characters "a", "b", "c", "d" with "x",
(b)...
|
by: Craig Buchanan |
last post by:
Is there a way to combine these two Replace into a single line?
Regex.Replace(Subject, "\&", "&")
Regex.Replace(Subject, "\'", "'")
Perhaps Regex.Replace(Subject, "{\&|\'}", "{&|'}")...
|
by: Just Me |
last post by:
I want to use regular expressions to search a string, give the user the
option of replacing, and then maybe replacing the data - using reg
expressions for the search and the replace strings.
...
|
by: Sačo Zagoranski |
last post by:
Hi,
could someone help me putting together a regex expression for my problem?
I need my search filter to treat spaces and commas in the query the same
way no matter how many there are...
...
|
by: Alex Maghen |
last post by:
This is a bit of an abuse of this group. Just a nit, but I'm hoping someone
really good with Regular Expressions can help me out here.
I need to write a regular expression that will do the...
|
by: MooMaster |
last post by:
I'm trying to develop a little script that does some string
manipulation. I have some few hundred strings that currently look like
this:
cond(a,b,c)
and I want them to look like this:
...
|
by: Jeremy |
last post by:
I am trying to replace a string "P" with "\P" as long as the string "P" does
not already have a "\" in front.
for my search string I've used @"(P)" so my regex replace statement is:
...
|
by: taylorcarr |
last post by:
A Canon printer is a smart device known for being advanced, efficient, and reliable. It is designed for home, office, and hybrid workspace use and can also be used for a variety of purposes. However,...
|
by: ryjfgjl |
last post by:
If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...
|
by: ryjfgjl |
last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
|
by: emmanuelkatto |
last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud.
Please let me know.
Thanks!
Emmanuel
|
by: Sonnysonu |
last post by:
This is the data of csv file
1 2 3
1 2 3
1 2 3
1 2 3
2 3
2 3
3
the lengths should be different i have to store the data by column-wise with in the specific length.
suppose the i have to...
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
|
by: Hystou |
last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
|
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers,...
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
| |
