Aaron,
Apologies for the ping but, your the only one I can think of offhand that
will know what I'm looking for.

Basically, to cut a long story short, I run an sURL service (surl.co.uk)
that allows one to convert long URL's to short etc, and am looking to have a
search facility on it that will allow one to locate an sURL for a specific
subject.

Now, the problem I'm running into is, I'd like to have some sort of spider
that will go to each site in the database, and grab the title, keywords, and
description from the meta tags, As I've never written a spider in my life,
and have been unsuccessful in locating info on how to go about doing so, I
was hoping you could point me in the right direction?

--

Regards

Steven Burn
Ur I.T. Mate Group
www.it-mate.co.uk

Keeping it FREE!

One way is to use ServerXMLHTTP (see http://www.aspfaq.com/2173). Once you
have the response text back, you can parse it for <title> and </title>, etc.

--
http://www.aspfaq.com/
(Reverse address to reply.)




"Steven Burn" <pvt@noyb.com> wrote in message
news:u51cCRCTEHA.3012@tk2msftngp13.phx.gbl...[color=blue]
> Aaron,
> Apologies for the ping but, your the only one I can think of offhand that
> will know what I'm looking for.
>
> Basically, to cut a long story short, I run an sURL service (surl.co.uk)
> that allows one to convert long URL's to short etc, and am looking to have[/color]
a[color=blue]
> search facility on it that will allow one to locate an sURL for a specific
> subject.
>
> Now, the problem I'm running into is, I'd like to have some sort of spider
> that will go to each site in the database, and grab the title, keywords,[/color]
and[color=blue]
> description from the meta tags, As I've never written a spider in my life,
> and have been unsuccessful in locating info on how to go about doing so, I
> was hoping you could point me in the right direction?
>
> --
>
> Regards
>
> Steven Burn
> Ur I.T. Mate Group
> www.it-mate.co.uk
>
> Keeping it FREE!
>
>
>
>[/color]

Cheers Aaron..... I had a feeling that was going to be the response (I've
got a page on my site that uses it (checks whether a site is online or not),
but it's terribly slow for some reason)

--

Regards

Steven Burn
Ur I.T. Mate Group
www.it-mate.co.uk

Keeping it FREE!


"Aaron [SQL Server MVP]" <ten.xoc@dnartreb.noraa> wrote in message
news:e6tmN8ETEHA.3548@TK2MSFTNGP09.phx.gbl...[color=blue]
> One way is to use ServerXMLHTTP (see http://www.aspfaq.com/2173). Once[/color]
you[color=blue]
> have the response text back, you can parse it for <title> and </title>,[/color]
etc.[color=blue]
>
> --
> http://www.aspfaq.com/
> (Reverse address to reply.)
>
>
>
>
> "Steven Burn" <pvt@noyb.com> wrote in message
> news:u51cCRCTEHA.3012@tk2msftngp13.phx.gbl...[color=green]
> > Aaron,
> > Apologies for the ping but, your the only one I can think of offhand[/color][/color]
that[color=blue][color=green]
> > will know what I'm looking for.
> >
> > Basically, to cut a long story short, I run an sURL service (surl.co.uk)
> > that allows one to convert long URL's to short etc, and am looking to[/color][/color]
have[color=blue]
> a[color=green]
> > search facility on it that will allow one to locate an sURL for a[/color][/color]
specific[color=blue][color=green]
> > subject.
> >
> > Now, the problem I'm running into is, I'd like to have some sort of[/color][/color]
spider[color=blue][color=green]
> > that will go to each site in the database, and grab the title, keywords,[/color]
> and[color=green]
> > description from the meta tags, As I've never written a spider in my[/color][/color]
life,[color=blue][color=green]
> > and have been unsuccessful in locating info on how to go about doing so,[/color][/color]
I[color=blue][color=green]
> > was hoping you could point me in the right direction?
> >
> > --
> >
> > Regards
> >
> > Steven Burn
> > Ur I.T. Mate Group
> > www.it-mate.co.uk
> >
> > Keeping it FREE!
> >
> >
> >
> >[/color]
>
>[/color]