wget -p does not load my images

petr pilsl

sorry - no idea where to post my question, so I crossposted to a linux
and a html-authoring-group. Both groups might be familiar with wget.
wget -p http://www.goldfisch.at

does not load the images embedded in this website. I wonder why?
according to the man-page :

-p
--page-requisites
This option causes Wget to download all the files that are
necessary to properly display a given HTML page. This includes such
things as inlined images, sounds, and referenced stylesheets.
and the index-file contains images like:

<div id="logo"><a href="/goldfisch"><img
src="/lib/tpl/goldfisch/images/logo.gif"/></a></div>
thnx for any idea.
peter

Oct 25 '06 #1

Subscribe Reply

9483

Ben C

On 2006-10-25, petr pilsl <pi***@goldfisc h.atwrote:

>
sorry - no idea where to post my question, so I crossposted to a linux
and a html-authoring-group. Both groups might be familiar with wget.
wget -p http://www.goldfisch.at

does not load the images embedded in this website. I wonder why?
according to the man-page :

It does get the images, if you look at the files it actually downloads.
But you need -k as well to convert the links so it all works when you
open the page in a browser.

Oct 25 '06 #2

noi

On Wed, 25 Oct 2006 17:52:43 +0200, petr pilsl wrote this:

>
sorry - no idea where to post my question, so I crossposted to a linux and
a html-authoring-group. Both groups might be familiar with wget.
wget -p http://www.goldfisch.at

does not load the images embedded in this website. I wonder why? according
to the man-page :

-p
--page-requisites
This option causes Wget to download all the files that are
necessary to properly display a given HTML page. This includes such
things as inlined images, sounds, and referenced stylesheets.
and the index-file contains images like:

<div id="logo"><a href="/goldfisch"><img
src="/lib/tpl/goldfisch/images/logo.gif"/></a></div>
thnx for any idea.
peter

Read the man again

wget -m http://www.goldfisch.at # to mirror a site
wget -E -H -k -K -p http://<site>/<document>

# to download and all requisite links for <document>

Oct 25 '06 #3

petr pilsl

noi wrote:

>
Read the man again
wget -E -H -k -K -p http://<site>/<document>

# to download and all requisite links for <document>

but it does not !!
# wget -E -H -k -K -p www.goldfisch.at 2>&1 | grep saved
10:55:06 (1.44 MB/s) - `www.goldfisch. at/index.html' saved [10577]
10:55:06 (14.67 MB/s) - `www.goldfisch. at/lib/scripts/script.js' saved
[15381/15381]
10:55:07 (3.70 MB/s) - `www.goldfisch. at/lib/scripts/tw-sack.js' saved
[3881/3881]
10:55:07 (1.57 MB/s) - `www.goldfisch. at/lib/scripts/ajax.js' saved
[1647/1647]
10:55:07 (15.17 MB/s) - `www.goldfisch. at/lib/scripts/domLib.js' saved
[15903/15903]
10:55:07 (26.69 MB/s) - `www.goldfisch. at/lib/scripts/domTT.js' saved
[27990/27990]
10:55:07 (3.05 MB/s) -
`www.goldfisch. at/lib/plugins/searchindex/script.js' saved [3197/3197]
10:55:07 (17.25 MB/s) - `www.goldfisch. at/files/urchin.js' saved
[18093/18093]
as you can see, it does not download any image-files here.

thnx
peter

Oct 26 '06 #4

petr pilsl

It does get the images, if you look at the files it actually downloads.
But you need -k as well to convert the links so it all works when you
open the page in a browser.

No - it does not get the images. It does not download them as one can
see in the wget-output and by looking at the files that were downloaded.
Thats my problem:

# wget -p www.goldfisch.at 2>&1 | grep saved
10:56:24 (10.09 MB/s) - `www.goldfisch. at/index.html' saved [10577]
10:56:24 (14.67 MB/s) - `www.goldfisch. at/lib/scripts/script.js' saved
[15381/15381]
10:56:24 (3.70 MB/s) - `www.goldfisch. at/lib/scripts/tw-sack.js' saved
[3881/3881]
10:56:24 (1.57 MB/s) - `www.goldfisch. at/lib/scripts/ajax.js' saved
[1647/1647]
10:56:24 (15.17 MB/s) - `www.goldfisch. at/lib/scripts/domLib.js' saved
[15903/15903]
10:56:24 (26.69 MB/s) - `www.goldfisch. at/lib/scripts/domTT.js' saved
[27990/27990]
10:56:24 (3.05 MB/s) -
`www.goldfisch. at/lib/plugins/searchindex/script.js' saved [3197/3197]
10:56:24 (17.25 MB/s) - `www.goldfisch. at/files/urchin.js' saved
[18093/18093]

thnx,
peter

Oct 26 '06 #5

Ben C

On 2006-10-26, petr pilsl <pi***@goldfisc h.atwrote:

>>
It does get the images, if you look at the files it actually downloads.
But you need -k as well to convert the links so it all works when you
open the page in a browser.

No - it does not get the images. It does not download them as one can
see in the wget-output and by looking at the files that were downloaded.
Thats my problem:

# wget -p www.goldfisch.at 2>&1 | grep saved
10:56:24 (10.09 MB/s) - `www.goldfisch. at/index.html' saved [10577]
10:56:24 (14.67 MB/s) - `www.goldfisch. at/lib/scripts/script.js' saved
[15381/15381]
10:56:24 (3.70 MB/s) - `www.goldfisch. at/lib/scripts/tw-sack.js' saved
[3881/3881]
10:56:24 (1.57 MB/s) - `www.goldfisch. at/lib/scripts/ajax.js' saved
[1647/1647]
10:56:24 (15.17 MB/s) - `www.goldfisch. at/lib/scripts/domLib.js' saved
[15903/15903]
10:56:24 (26.69 MB/s) - `www.goldfisch. at/lib/scripts/domTT.js' saved
[27990/27990]
10:56:24 (3.05 MB/s) -
`www.goldfisch. at/lib/plugins/searchindex/script.js' saved [3197/3197]
10:56:24 (17.25 MB/s) - `www.goldfisch. at/files/urchin.js' saved
[18093/18093]

Odd. I tried exactly your command and got this output, you can see
logo.gif etc. down at the bottom.

I'm using GNU Wget 1.10.1, maybe it's something to do with version.

10:07:33 (74.93 KB/s) - `www.goldfisch. at/index.html' saved [10577]
10:07:33 (52.63 MB/s) - `www.goldfisch. at/lib/styles/style.css' saved [1214/1214]
10:07:33 (71.65 KB/s) - `www.goldfisch. at/lib/scripts/script.js' saved [15381/15381]
10:07:33 (368.47 KB/s) - `www.goldfisch. at/lib/scripts/tw-sack.js' saved [3881/3881]
10:07:33 (78.54 MB/s) - `www.goldfisch. at/lib/scripts/ajax.js' saved [1647/1647]
10:07:34 (102.29 KB/s) - `www.goldfisch. at/lib/scripts/domLib.js' saved [15903/15903]
10:07:34 (129.36 KB/s) - `www.goldfisch. at/lib/scripts/domTT.js' saved [27990/27990]
10:07:34 (581.09 KB/s) - `www.goldfisch. at/lib/plugins/plugin/style.css' saved [2326/2326]
10:07:34 (13.35 MB/s) - `www.goldfisch. at/lib/plugins/searchindex/style.css' saved [196/196]
10:07:34 (423.50 KB/s) - `www.goldfisch. at/lib/plugins/searchindex/script.js' saved [3197/3197]
10:07:34 (5.79 MB/s) - `www.goldfisch. at/lib/plugins/include/style.css' saved [91/91]
10:07:34 (314.97 KB/s) - `www.goldfisch. at/lib/tpl/goldfisch/layout.css' saved [6427/6427]
10:07:35 (143.69 KB/s) - `www.goldfisch. at/lib/tpl/goldfisch/design.css' saved [9831/9831]
10:07:35 (15.02 MB/s) - `www.goldfisch. at/lib/tpl/goldfisch/plugins.css' saved [252/252]
10:07:35 (396.88 KB/s) - `www.goldfisch. at/lib/tpl/goldfisch/print.css' saved [3543/3543]
10:07:35 (417.19 KB/s) - `www.goldfisch. at/lib/tpl/goldfisch/images/logo.gif' saved [3154/3154]
10:07:35 (17.80 MB/s) - `www.goldfisch. at/lib/tpl/goldfisch/images/button-rss.png' saved [280/280]
10:07:35 (17.23 MB/s) - `www.goldfisch. at/lib/tpl/goldfisch/images/button-raw.png' saved [271/271]
10:07:35 (27.15 MB/s) - `www.goldfisch. at/lib/tpl/goldfisch/images/button-dw.png' saved [427/427]
10:07:35 (2.86 MB/s) - `www.goldfisch. at/lib/exe/indexer.php?id= goldfisch&11618 53728' saved [42/42]
10:07:35 (113.66 KB/s) - `www.goldfisch. at/files/urchin.js' saved [18093/18093]

Oct 26 '06 #6

noi

On Thu, 26 Oct 2006 10:55:49 +0200, petr pilsl wrote this:

noi wrote:
>>
Read the man again
wget -E -H -k -K -p http://<site>/<document>

# to download and all requisite links for <document>

but it does not !!
# wget -E -H -k -K -p www.goldfisch.at 2>&1 | grep saved 10:55:06 (1.44
MB/s) - `www.goldfisch. at/index.html' saved [10577] 10:55:06 (14.67 MB/s)
- `www.goldfisch. at/lib/scripts/script.js' saved [15381/15381]
10:55:07 (3.70 MB/s) - `www.goldfisch. at/lib/scripts/tw-sack.js' saved
[3881/3881]
10:55:07 (1.57 MB/s) - `www.goldfisch. at/lib/scripts/ajax.js' saved
[1647/1647]
10:55:07 (15.17 MB/s) - `www.goldfisch. at/lib/scripts/domLib.js' saved
[15903/15903]
10:55:07 (26.69 MB/s) - `www.goldfisch. at/lib/scripts/domTT.js' saved
[27990/27990]
10:55:07 (3.05 MB/s) -
`www.goldfisch. at/lib/plugins/searchindex/script.js' saved [3197/3197]
10:55:07 (17.25 MB/s) - `www.goldfisch. at/files/urchin.js' saved
[18093/18093]
as you can see, it does not download any image-files here.

thnx
peter

Interesting when I used that command I got everything, url links, png
images and .js files. My downloaded version looks like online version.

12:57:31 (331.65 KB/s) - `www.goldfisch. at/lib/tpl/goldfisch/images/logo.gif' saved [3154/3154]

--12:57:31-- http://www.goldfisch.at/lib/tpl/gold...button-rss.png
=`www.goldfisch .at/lib/tpl/goldfisch/images/button-rss.png'
Reusing existing connection to www.goldfisch.at:80.
HTTP request sent, awaiting response... 200 OK
Length: 280 [image/png]

100%[=============== =============== =============== =============== ========>] 280 --.--K/s

12:57:31 (17.80 MB/s) - `www.goldfisch. at/lib/tpl/goldfisch/images/button-rss.png' saved [280/280]

--12:57:31-- http://www.goldfisch.at/lib/tpl/gold...button-raw.png
=`www.goldfisch .at/lib/tpl/goldfisch/images/button-raw.png'
Reusing existing connection to www.goldfisch.at:80.
HTTP request sent, awaiting response... 200 OK
Length: 271 [image/png]

Oct 26 '06 #7

s. keeling

["Followup-To:" header set to comp.os.linux.m isc.]
petr pilsl <pi***@goldfisc h.at>:

noi wrote:

Read the man again
wget -E -H -k -K -p http://<site>/<document>

Now, compare that to this:

# wget -E -H -k -K -p www.goldfisch.at 2>&1 | grep saved

One of the two mentions "http://".

--
Any technology distinguishable from magic is insufficiently advanced.
(*) http://www.spots.ab.ca/~keeling Linux Counter #80292
- - http://www.faqs.org/rfcs/rfc1855.html Please, don't Cc: me.
Spammers! http://www.spots.ab.ca/~keeling/emails.html

Oct 27 '06 #8

Similar topics

8167

Lynx and wget - redirect problems for PHP scripts

by: Martin | last post by:

I have a PHP script that should be run a few times a day. Currently I run this script manually as I haven't been able to set up Lynx or wget to run it as a cronjob. Or to be more specific: the script works, but both wget and Lynx fail after 10 or 20 redirects, then it warns: wget: 20 redirections exceeded. Lynx: Alert!: Redirection limit of 10 URL's reached. What the scripts does is download various HTML pages (allowed by the owners)...

PHP

3967

calling a wget to run in background?

by: LRW | last post by:

In a PHP script I have the following two lines: $thumbproc = escapeshellcmd("wget -q -T 2000 http://(A URL)/pa-thumbs/createthumbs.php?dir=".$order_po." &"); exec("$thumbproc 2>&1", $output); Works perfectly...except, it always waits until it finished with the wget before it continues in the script. Normally this wouldn't be a problem, except this wget is calling a page that's doing some image manipulation that can take up to two

PHP

7716

wget

by: Ken | last post by:

How do I call c:\wget\wget.exe from a php or html file? so I can use php variables to define the file names to download. I want to set up wget to download several files from a server to my hard drive so they can be used internally. Ken

PHP

1944

looking for wget-like module for getching software

by: Robert P. J. Day | last post by:

just getting started with python, and i'm designing a program for fetching software from the net, given the package name, version number and/or date stamp, download method (tarball, CVS, etc.) and so on. i've already got a shell script doing this, but python would certainly clean up the code a lot. first question -- does such a utility/module (or something like it) already exist? that is, with the ability to say, "go get me gcc,...

Python

4768

PHP 4.2 Needs To Call Wget

by: Google Mike | last post by:

I have an RH9 Linux PHP 4.2.2 web page that I need to call a Bash file under the context of root and do the wget command to download a file, clobbering the previous download of this same filename. It's bombing without leaving any trace. I tried introducing all manner of chmod, chown, sudo, and sticky bit, but this fails. The only thing I see in the syslog is failed sudo authenticaiton for user Apache. What's the technique to get this...

PHP

7814

Popen and wget, problems

by: Jesse | last post by:

Hi all, I have a problem using wget and Popen. I hope someone can help. -- Problem -- I want to use the command: wget -nv -O "dir/cpan.txt" "http://search.cpan.org" and capture all it's stdout+stderr. (Note that option -O requires 'dir' to be existing before wget is executed) Popen doesn't work, while os.system and shell do. Popen will give the error:

Python

3546

PHP and WGET generate 0 byte files

by: Don69 | last post by:

I have a problem with PHP where wget generates 0 byte files. Below is the code that I use. // ******************** $savedir = "/webroot/vifs/app/webroot/static/1234567890"; $url = "http://www.google.com"; $test = mkdir( $savedir, 0777);

PHP

2908

Problem with subprocess.Popen wget within a thread

by: Mathieu Prevot | last post by:

Hi it seems the script (A) finishes before the downloading ends, and the (B) version doesn't (wanted behavior) ... this is unexpected. What happens ? (A) ============================================ class vid(threading.Thread): def __init__(self):

Python

13344

trouble with tinyMCE images

by: matheussousuke | last post by:

Hello, I'm using tiny MCE plugin on my oscommerce and it is inserting my website URL when I use insert image function in the emails. The goal is: Make it send the email with the URL http://mghospedagem.com/images/controlpanel.jpg instead of http://mghospedagem.comhttp://mghospedagem.com/images/controlpanel.jpg As u see, there's the website URL before the image URL.

Javascript

8199

What is ONU?

by: marktang | last post by:

ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...

General

8145

Changing the language in Windows 10

by: Hystou | last post by:

Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...

Windows Server

8294

The easy way to turn off automatic updates for Windows 10/11

by: Hystou | last post by:

Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...

Windows Server

8448

Discussion: How does Zigbee compare with other wireless protocols in smart home applications?

by: tracyyun | last post by:

Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...

General

7118

AI Job Threat for Devs

by: agi2029 | last post by:

Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...

Career Advice

6097

Access Europe - Using VBA to create a class based on a table - Wed 1 May

by: isladogs | last post by:

The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...

Microsoft Access / VBA

4060

Trying to create a lan-to-lan vpn between two differents networks

by: TSSRALBI | last post by:

Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...

Networking - Hardware / Configuration

4140

Windows Forms - .Net 8.0

by: adsilva | last post by:

A Windows Forms form does not have the event Unload, like VB6. What one acts like?

Visual Basic .NET

2576

transfer the data from one system to another through ip address

by: 6302768590 | last post by:

Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system

C# / C Sharp