On Thu, 18 Sep 2003 13:45:15 GMT,
"RTL" <bl*******************@nospam.techarts.com> wrote:
Actually, we're letting several of our domain names go back into the field.
I believe there must be some industry way to use some HTML element/tag to
get the Spiders to start updating their links to our main site for the
remainder of the domain's life.
Spiders periodically trawl websites, revisiting ones that they know
about, and should remove dead links, eventually.
I have found this meta element/tag, but that doesn't help with what we want
to accomplish:
<meta name="revisit-after" content="5 days">
You need to reconfigure your server to send appropriate HTTP headers. I
think that you'll find that such meta elements are only paid attention
to by a few clients specifically looking for such things.
For Apache, that's easy enough to do. There are "permanently moved"
headers (a 301 error), that redirects to the new location, and should be
understood to replace any previously indexed address with the new one.
And there's a "gone" header (error 410), which means that the resource
is permanently gone, and has no new location.
You'd have to learn the method to apply that to all the addresses that
you want those sort of responses with (e.g. wildcarding for any resource
requested within a particular domain, or for a directory inside one).
--
My "from" address is totally fake. (Hint: If I wanted e-mails from
complete strangers, I'd have put a real one, there.) Reply to usenet
postings in the same place as you read the message you're replying to.