Help running BeautifulSoup script

[treblex]

Hi,
I'm very new to Python. Basically all I want to do is run this scipt. But I don't know how to.

My OS is MS Widows XP
Any help is much appreciated.

P.S. I have already installed BeautifulSoup

[bartonc]

Hi,
I'm very new to Python. Basically all I want to do is run this scipt. But I don't know how to.

My OS is MS Widows XP
Any help is much appreciated.

P.S. I have already installed BeautifulSoup

You'll need to add the Python directory to your PATH environment variable. After that, I'd say de-compress the backup_fotopic.tar.gz file into a folder. Start a DOS shell and cd to that folder and type

backup_fotopic.py

Assuming that Python is installed correctly (.py files have the python icon) the script will run.

[treblex]

You'll need to add the Python directory to your PATH environment variable.

How do I do this?

Thanks

[bartonc]

You'll need to add the Python directory to your PATH environment variable.

Right-click My Computer, go to Properties. On the Advanced tab, click the Environment Variables button. In the "User variables for <your name>" list, find the one called PATH. Select it and click the Edit button. Add some like

C:\python24;

(depending on the actual path and version of your python installation)
to the beginning or the line (yours may not have anything in it yet).

[treblex]

Got the PATH variable set, thanks.

When I run the script I get:

Traceback (most recent call last):
  File "C:/Python25/backup_fotopic", line 30, in <module>
    title = image_soup.first('title').contents[0]
AttributeError: 'NoneType' object has no attribute 'contents' 

How do I fix this?

Thank you for your continued support.

[bartonc]

Got the PATH variable set, thanks.

When I run the script I get:

Traceback (most recent call last):
  File "C:/Python25/backup_fotopic", line 30, in <module>
    title = image_soup.first('title').contents[0]
AttributeError: 'NoneType' object has no attribute 'contents' 

How do I fix this?

Thank you for your continued support.

This is telling you that the result of

image_soup.first('title')

is None.
My guess is that 'title' is meaningless to the function.

You'll need to include some code and an explanation of what you expect it to do.

[treblex]

#! /usr/bin/env python
 
import urllib, string
from BeautifulSoup import BeautifulSoup
 
collections_soup = BeautifulSoup()
 
# Replace the example URL below with the address of the pictures you want to backup
base_url = 'http://andiday.fotopic.net/c1343336.html'
 
f = urllib.urlopen(base_url + '/list_collections.php')
result = f.read()
f.close()
collections_soup.feed(result)
for collection in collections_soup('a'):
    print '>>>' + base_url + collection['href']
    f = urllib.urlopen(base_url + collection['href'])
    result = f.read()
    f.close()
    collection_soup = BeautifulSoup()
    collection_soup.feed(result)
    for thumb in collection_soup('td', {'class' : 'thumbs'}):
        for image in thumb('a'):
            if string.find(image['href'], 'javascript') == -1 and string.find(image['href'], 'title') == -1:
                f = urllib.urlopen(base_url + image['href'])
                result = f.read()
                f.close()
                image_soup = BeautifulSoup()
                image_soup.feed(result)
                title = image_soup.first('title').contents[0]
                filename = string.split(title.string, '.JPG')[0]
                print filename
                for photo_div in image_soup('div', {'class' : 'photo-image'}):
                    for img in photo_div('img'):
                        print img
                        print filename
                        f = urllib.urlopen(img['src'])
                        result = f.read()
                        f.close()
 
            # Replace /tmp/ below with the path to a folder on your hard drive
                        img = open('C:\Downloads' + filename + '.JPG', 'wb+')
                        img.write(result)
                        img.close()
 

The script is designed to scrape the url (in this case http://andiday.fotopic.net/c1343336.html) and download all the .jpg files from it to a folder on the hard disk (in this case, C:\Downloads)

[bartonc]

The script is designed to scrape the url (in this case http://andiday.fotopic.net/c1343336.html) and download all the .jpg files from it to a folder on the hard disk (in this case, C:\Downloads)

When debugging/troubleshooting, alway start at the source.
I'm not too internet savvy, but I'm pretty sure that this says something about "couldn't find the file":

>>> import urllib
>>> f = urllib.urlopen('http://andiday.fotopic.net/c1343336.html/list_collections.php')
>>> f.read()
'\n\n<!-- /export/fotopic.net/userland/www/css/18102.css -->\n\n<link rel="stylesheet" href="http://media.fotopic.net/virtualv1/25/style.css" type="text/css">\n<body>\n\n<table border=0 cellpadding=4 cellspacing=2 width=100%>\n<tr><td class="content">\n<center><h2><div class="photo">404: Page Not found</h2></center>\n<div class="photo">We\'re sorry but we couldn\'t find the file you requested:\n<ul>\n<strong><div class="photo">http://andiday.fotopic.net/c1343336.html/list_collections.php</strong>\n</ul>\n<div class="photo">So either it doesn\'t exist, or it\'s been moved.\n<p>\n\n<div class="photo">If you\'re looking for a particular person\'s gallery, you could try looking at<br/>\nour <a href="http://fotopic.net/community/">Community</a> section, or\nalternatively take a look at <a href="http://fotopic.net/">the main Fotopic\nsite</a>.\n\n<p>\n\n</td></tr>\n</table>\n\n</body>\n'
>>> f.close()
>>> del f
>>> del urllib
>>> 

[treblex]

When debugging/troubleshooting, alway start at the source.
I'm not too internet savvy, but I'm pretty sure that this says something about "couldn't find the file":

>>> import urllib
>>> f = urllib.urlopen('http://andiday.fotopic.net/c1343336.html/list_collections.php')
>>> f.read()
'\n\n<!-- /export/fotopic.net/userland/www/css/18102.css -->\n\n<link rel="stylesheet" href="http://media.fotopic.net/virtualv1/25/style.css" type="text/css">\n<body>\n\n<table border=0 cellpadding=4 cellspacing=2 width=100%>\n<tr><td class="content">\n<center><h2><div class="photo">404: Page Not found</h2></center>\n<div class="photo">We\'re sorry but we couldn\'t find the file you requested:\n<ul>\n<strong><div class="photo">http://andiday.fotopic.net/c1343336.html/list_collections.php</strong>\n</ul>\n<div class="photo">So either it doesn\'t exist, or it\'s been moved.\n<p>\n\n<div class="photo">If you\'re looking for a particular person\'s gallery, you could try looking at<br/>\nour <a href="http://fotopic.net/community/">Community</a> section, or\nalternatively take a look at <a href="http://fotopic.net/">the main Fotopic\nsite</a>.\n\n<p>\n\n</td></tr>\n</table>\n\n</body>\n'
>>> f.close()
>>> del f
>>> del urllib
>>> 

What should I do with this code?

[bartonc]

What should I do with this code?

Find the address of a valid list_collections.php.

[treblex]

I don't understand :(

Sorry for being so noobish! lol

[bartonc]

The script is designed to scrape the url (in this case http://andiday.fotopic.net/c1343336.html) and download all the .jpg files from it to a folder on the hard disk (in this case, C:\Downloads)

The script will do what you want, but the message from f.read() is telling you that the address that you are using is not valid. It looks like there is information in that message that may help you find a valid address. Sorry to be so vague, but, as I've said, I'm not a web-scraping kind of developer.