KEYWORDS from a string

[Nel]

Hi all,

Before I re-invent the wheel here, has anyone willing to share a basic
script to extract META keywords from a string. I have a string, let's say
$pageText that contains the dynamic contents of the page.

Ideally, I don't just want to explode the string and remove "and", "or" and
"the" etc. because some the the repeated keywords may be more that one word
long.

Also, it would be good to be able to rank the keywords according to the
frequency.

I have searched google and hotscripts etc. Can only find web sites to
create METAs to copy & paste.

Thanx in advance.

Nel

[Chung Leong]

"Nel" <ne***@ne14.co.NOSPAMuk> wrote in message
news:41***********************@ptn-nntp-reader02.plus.net...

Hi all,

Before I re-invent the wheel here, has anyone willing to share a basic
script to extract META keywords from a string. I have a string, let's say
$pageText that contains the dynamic contents of the page.

Ideally, I don't just want to explode the string and remove "and", "or" and "the" etc. because some the the repeated keywords may be more that one word long.

Also, it would be good to be able to rank the keywords according to the
frequency.

I have searched google and hotscripts etc. Can only find web sites to
create METAs to copy & paste.

Thanx in advance.

Nel

See documentation for get_meta_tags().

[steve]

"Chung Leong" wrote:

"Nel" <ne***@ne14.co.NOSPAMuk> wrote in message
news:41001aae[quote:362d827a4d="Chung Leong"]"Nel" <ne***@ne14.co.NOSPAMuk> wrote in message
news:41***********************@ptn-nntp-reader02.plus.net... Hi all,

Before I re-invent the wheel here, has anyone willing to share a basic script to extract META keywords from a string. I have a string, let’s say $pageText that contains the dynamic contents of the page.

Ideally, I don’t just want to explode the string and remove "and", "or"
and "the" etc. because some the the repeated keywords may be more that one
word long.

Also, it would be good to be able to rank the keywords according to the frequency.

I have searched google and hotscripts etc. Can only find web sites to create METAs to copy & paste.

Thanx in advance.

Nel

See documentation for get_meta_tags().[/quote:362d827a4d]
47**********@ptn-nntp-reader02.plus.net...

Hi all,

Before I re-invent the wheel here, has anyone willing to share a

basic

script to extract META keywords from a string. I have a string,

let’s say

$pageText that contains the dynamic contents of the page.

Ideally, I don’t just want to explode the string and remove

"and", "or"
and

"the" etc. because some the the repeated keywords may be more

that one
word

long.

Also, it would be good to be able to rank the keywords according

to the

frequency.

I have searched google and hotscripts etc. Can only find web

sites to

create METAs to copy & paste.

Thanx in advance.

Nel

See documentation for get_meta_tags().

The reply above answers your question if you are looking for strict
definition of meta tags in html.

If by meta you mean keywords that are important and somewhat unique in
the body of the text, then I suggest that you need to have a
definition for common keywords, and then remove them to arrive at
"meta". The way I do it is to start with mysql stop words (search
on web). Then add words that are common in your domain (e.g. "html"
may be a common word on the web). Now remove all of these words from
the string using regular expressions, and what remains is pretty much
unique words.

--
http://www.dbForumz.com/ This article was posted by author's request
Articles individually checked for conformance to usenet standards
Topic URL: http://www.dbForumz.com/PHP-KEYWORDS...ict132415.html
Visit Topic URL to contact author (reg. req'd). Report abuse: http://www.dbForumz.com/eform.php?p=442256

[steve]

"Chung Leong" wrote:

"Nel" <ne***@ne14.co.NOSPAMuk> wrote in message
news:41001aae[quote:362d827a4d="Chung Leong"]"Nel" <ne***@ne14.co.NOSPAMuk> wrote in message
news:41***********************@ptn-nntp-reader02.plus.net... Hi all,

Before I re-invent the wheel here, has anyone willing to share a basic script to extract META keywords from a string. I have a string, let’s say $pageText that contains the dynamic contents of the page.

Ideally, I don’t just want to explode the string and remove "and", "or"
and "the" etc. because some the the repeated keywords may be more that one
word long.

Also, it would be good to be able to rank the keywords according to the frequency.

I have searched google and hotscripts etc. Can only find web sites to create METAs to copy & paste.

Thanx in advance.

Nel

See documentation for get_meta_tags().[/quote:362d827a4d]
47**********@ptn-nntp-reader02.plus.net...

Hi all,

Before I re-invent the wheel here, has anyone willing to share a

basic

script to extract META keywords from a string. I have a string,

let’s say

$pageText that contains the dynamic contents of the page.

Ideally, I don’t just want to explode the string and remove

"and", "or"
and

"the" etc. because some the the repeated keywords may be more

that one
word

long.

Also, it would be good to be able to rank the keywords according

to the

frequency.

I have searched google and hotscripts etc. Can only find web

sites to

create METAs to copy & paste.

Thanx in advance.

Nel

See documentation for get_meta_tags().

The reply above answers your question if you are looking for strict
definition of meta tags in html.

If by meta you mean keywords that are important and somewhat unique in
the body of the text, then I suggest that you need to have a
definition for common keywords, and then remove them to arrive at
"meta". The way I do it is to start with mysql stop words (search
on web). Then add words that are common in your domain (e.g. "html"
may be a common word on the web). Now remove all of these words from
the string using regular expressions, and what remains is pretty much
unique words.

--
http://www.dbForumz.com/ This article was posted by author's request
Articles individually checked for conformance to usenet standards
Topic URL: http://www.dbForumz.com/PHP-KEYWORDS...ict132415.html
Visit Topic URL to contact author (reg. req'd). Report abuse: http://www.dbForumz.com/eform.php?p=442256

[Nel]

Here is the final script I put together thanks to your help and suggestions.
It will automatically work through a string and remove duplicates, new lines
and punctuation before listing the keywords within a meta tag.

If anyone can offer any improvements I am open to suggestions.

Nel.
_____________________________________________

<?php // metatags.inc.php
// Create keyword META tags from dynamic page content

// test string from BBC News
echo metatags("Tony Blair has nominated long-time ally Peter Mandelson as
Britain's next European commissioner.
The announcement was made after Mr Blair spoke to new European Commission
President Jose Manuel Durao Barroso on Friday morning.

The appointment represents a remarkable comeback for Mr Mandelson, who has
twice resigned from the Cabinet in controversial

circumstances.

It will also trigger a Westminster by-election in his Hartlepool seat.

'Positive response'

In a statement, Mr Mandelson said he was \"delighted\" to have been
nominated for the post by the prime minister, but confirmed that

he had \"agonised\" over whether the job was right for him.");

function metatags($pagetext)
{
// Define variables for this web site
$websitename = "Example's Web Site";
$metadescription = "This web site's description";
$metakeywords = cleankeywords($pagetext);

// Build up META TAGS
$metatags = " <meta name=\"Name\" content=\"$websitename\">\n";
$metatags .= " <meta name=\"Rating\" content=\"General\">\n";
$metatags .= " <meta name=\"Robots\" content=\"Index\">\n";
$metatags .= " <meta name=\"Revisit-After\" content=\"14 days\">\n";
$metatags .= " <meta name=\"DESCRIPTION\"
content=\"$metadescription\">\n";
$metatags .= " <meta name=\"KEYWORDS\"
content=\"$websitename,$metakeywords\">\n";

return $metatags;
}
function cleankeywords($term)
{
//Specify text file containing stop words (one on each line)
$stopwords_file = "stopwords.txt";

//Remove punctuation and \n \r
$pat = array("/\./s","/\,/s","/\"/s","/\'/s","/\n/s","/\r/s");
$term = preg_replace($pat, "", $term);

//load list of common words
$common = file($stopwords_file);
$total = count($common);
for ($x=0; $x<= $total; $x++)
{
$common[$x] = trim(strtolower($common[$x]));
}

//make array of search terms
$_terms = explode(" ", $term);

foreach ($_terms as $line)
{
if (!in_array(strtolower(trim($line)), $common))
{
$cleanterm[$line] = $line;
}
}
$cleanwords = implode(", ", $cleanterm);
return $cleanwords;
}
?>