Beautiful parse joy - Oh what fun

[rh0dium]

Hi all,

I am trying to parse into a dictionary a table and I am having all
kinds of fun. Can someone please help me out.

What I want is this:

dic={'Division Code':'SALS','E mployee':'LOO ABLE'}

Here is what I have..

html="""<table> <tr valign="top"><t d width="24"><img
src="/icons/ecblank.gif" border="0" height="1" width="1" alt=""
/></td><td width="129"><b> <font size="2" face="Arial">Di vision Code:
</font></b></td><td width="693"><fo nt size="2"
face="Arial">SA LS</font></td></tr> <tr valign="top"><t d width="24"><img
src="/icons/ecblank.gif" border="0" height="1" width="1" alt="" /> <td
width="129"><b> <font size="2" face="Arial">Em ployee:
</font></b></td> <td width="693"><fo nt size="2"
face="Arial">LO O</font><b><font size="2" face="Arial"> </font></b><font
size="2" face="Arial">AB LE</font></td></tr></table> """
from BeautifulSoup import BeautifulSoup
soup = BeautifulSoup()
soup.feed(html)

dic={}
for row in soup('table')[0]('tr'):
column = row('td')
print column[1].findNext('font ').string.strip (),
column[2].findNext('font ').string.strip ()
dic[column[1].findNext('font ').string.strip ()]=
column[2].findNext('font ').string.strip ()

for key in dic.keys():
print key, dic[key]

The problem is I am missing the last name ABLE. How can I get "ALL"
of the text. Clearly I have something wrong with my font string.. but
what it is I am not sure of.

Please and thanks!!

[Larry Bates]

rh0dium wrote:

Hi all,

I am trying to parse into a dictionary a table and I am having all
kinds of fun. Can someone please help me out.

What I want is this:

dic={'Division Code':'SALS','E mployee':'LOO ABLE'}

Here is what I have..

html="""<table> <tr valign="top"><t d width="24"><img
src="/icons/ecblank.gif" border="0" height="1" width="1" alt=""
/></td><td width="129"><b> <font size="2" face="Arial">Di vision Code:
</font></b></td><td width="693"><fo nt size="2"
face="Arial">SA LS</font></td></tr> <tr valign="top"><t d width="24"><img
src="/icons/ecblank.gif" border="0" height="1" width="1" alt="" /> <td
width="129"><b> <font size="2" face="Arial">Em ployee:
</font></b></td> <td width="693"><fo nt size="2"
face="Arial">LO O</font><b><font size="2" face="Arial"> </font></b><font
size="2" face="Arial">AB LE</font></td></tr></table> """
from BeautifulSoup import BeautifulSoup
soup = BeautifulSoup()
soup.feed(html)

dic={}
for row in soup('table')[0]('tr'):
column = row('td')
print column[1].findNext('font ').string.strip (),
column[2].findNext('font ').string.strip ()
dic[column[1].findNext('font ').string.strip ()]=
column[2].findNext('font ').string.strip ()

for key in dic.keys():
print key, dic[key]

The problem is I am missing the last name ABLE. How can I get "ALL"
of the text. Clearly I have something wrong with my font string.. but
what it is I am not sure of.

Please and thanks!!

In the last row you have 3 <font> tags. The first one
contains LOO the second one is empty and the third one
contains ABLE.

<td width="693"><fo nt size="2" face="Arial">LO O</font><b>
<font size="2" face="Arial"> </font></b>
<font size="2" face="Arial">AB LE</font></td>

Your code is not expecting the second (empty) tag.

-Larry Bates

[KvS]

Maybe a more robust approach is just to walk through the string
counting the (increments) of the number of brackets "<" and ">" as you
know that all the relevant text occurs right after a ">" has occured
that sets your counter to 0 (meaning you're at the "highest level").
There's no relevant text if the next character is again a "<".

[George Sakkis]

Here's one way to do it:

import re
_any_re = re.compile('.+' )

d = {}
for row in BeautifulSoup(h tml).fetch('tr' ):
columns = row.fetch('td')
field = columns[1].firstText(_any _re).rstrip(' \t\n:')
value = ' '.join(text.rst rip()
for text in columns[2].fetchText(_any _re))
d[field] = value
print d

George