List all links from a webpage

[Robertico]

Hi,

I'd like to list all links (url's, not interested in email adresses) from a
web page (htm, html, asp, php ...).
I'am not sure if this can be done using php. So please some advice or maybe
an example.

Thanks in advance,
Robertico

[Toby Inkster]

Robertico wrote:

I'd like to list all links (url's, not interested in email adresses) from a
web page (htm, html, asp, php ...).

<?php
$url = 'http://tobyinkster.co.uk';
$n = 12 + strlen(`lynx -dump -number_links -nolist '$url'`);
$list = substr(`lynx -dump -number_links '$url'`, $n);
print "<pre>$list</pre>";
?>

Magic.

--
Toby A Inkster BSc (Hons) ARCS
Contact Me ~ http://tobyinkster.co.uk/contact

[Robertico]

Thanks,

<?php
$url = 'http://tobyinkster.co.uk';
$n = 12 + strlen(`lynx -dump -number_links -nolist '$url'`);
$list = substr(`lynx -dump -number_links '$url'`, $n);
print "<pre>$list</pre>";
?>

Great solution using Lynx. My first impression is that it works great !

Robertico

[Robertico]

> <?php

$url = 'http://tobyinkster.co.uk';
$n = 12 + strlen(`lynx -dump -number_links -nolist '$url'`);
$list = substr(`lynx -dump -number_links '$url'`, $n);
print "<pre>$list</pre>";
?>

I tried to remove the numbers (removed -number_links) but it doesn't work.
I 'd like to store the results in a database.
Can you explain why adding 12 to the string length ?

Robertico

[Toby Inkster]

Robertico wrote:

I tried to remove the numbers (removed -number_links) but it doesn't work.
Use a regular expression:

$list = preg_replace('/\[[0-9]+\]/', $list);
Can you explain why adding 12 to the string length ?

Try it without the +12 and see.

--
Toby A Inkster BSc (Hons) ARCS
Contact Me ~ http://tobyinkster.co.uk/contact

[Robertico]

> Use a regular expression:

$list = preg_replace('/\[[0-9]+\]/', $list);
Ok, thats correct, but is there a reason why is doesn't work
without -number_links.
I always want to know why. I'd like to understand what i'am doing. :-))
Try it without the +12 and see.

I already did, but why exactly 12.

Hope i don't tease you to much
Robertico

[Toby Inkster]

Robertico wrote:

Ok, thats correct, but is there a reason why is doesn't work
without -number_links.
I always want to know why. I'd like to understand what i'am doing. :-))

ISTR that I couldn't get the two lynx dumps to "line up" without using
"-number_links" for both.

Try it without the +12 and see.

I already did, but why exactly 12.

if (strlen("References\n\n")==12)
{
echo "That's why!\n";
/* Again, IIRC */
}

--
Toby A Inkster BSc (Hons) ARCS
Contact Me ~ http://tobyinkster.co.uk/contact

[Robertico]

Thanx !!

Robertico