This there a public program/algorithm that can tell me the key points of a
text?
For example I entered the following text:
Web logs, or blogs, the online personal diaries where big names and no names
expound on everything from pets to presidents, are going mainstream. While
still a relatively small piece of total online activity, blogging has caught
on with affluent young adults. As Forrester Research analysts recently
noted, blogging will become increasingly common as these consumers age.
The program should give me the main keywords such as: blog, online,people...
I know some spam filters does this and Google??
I don't need it to be super accurate, but just to demostrate that this is
possible.
Any help is greatly appreciated,
Aaron 4 1882
"Aaron" <ku*****@yahoo.com> wrote in
news:uM**************@tk2msftngp13.phx.gbl: This there a public program/algorithm that can tell me the key points of a text?
Do you want to know the key points or just evaluate? If you just want to
evaluate you should look at Bayesian algolrithms.
--
Chad Z. Hower (a.k.a. Kudzu) - http://www.hower.org/Kudzu/
"Programming is an art form that fights back"
Empower ASP.NET with IntraWeb http://www.atozed.com/IntraWeb/
key points
If the program were to process this post, it would output keywords like:
programming, internet...
"Chad Z. Hower aka Kudzu" <cp**@hower.org> wrote in message
news:Xn******************@127.0.0.1... "Aaron" <ku*****@yahoo.com> wrote in news:uM**************@tk2msftngp13.phx.gbl: This there a public program/algorithm that can tell me the key points of a text?
Do you want to know the key points or just evaluate? If you just want to evaluate you should look at Bayesian algolrithms. -- Chad Z. Hower (a.k.a. Kudzu) - http://www.hower.org/Kudzu/ "Programming is an art form that fights back"
Empower ASP.NET with IntraWeb http://www.atozed.com/IntraWeb/
Nick ,thanks for the info, I'll keep looking and let you guys know.
The best example I can think of right now is Google's Adsense. It does a
very good job analyzing the webpage and pin pointing the central meaning.
Any idea what method they use?
"Nick Malik [Microsoft]" <ni*******@hotmail.nospam.com> wrote in message
news:vN********************@comcast.com... Hello Aaron,
This there a public program/algorithm that can tell me the key points of a text?
For example I entered the following text:
Web logs, or blogs, the online personal diaries where big names and no names expound on everything from pets to presidents, are going mainstream. While still a relatively small piece of total online activity, blogging has caught on with affluent young adults. As Forrester Research analysts recently noted, blogging will become increasingly common as these consumers age.
The program should give me the main keywords such as: blog, online,people...
Fascinating. Simply keyword counting produces nearly nothing. The only words that occur more than once are "blogging" and "names." The word "people" that you produce in your list of keywords doesn't occur in the paragraph at all.
You would need an algorithm that creates a contextual map through a lexical tree and produces, effectively, an "understanding" of the key concept of the paragraph. Effectively, you are entering the field of Computational Linguistics.
There is some fascinating research on Natural Language Processing that began in the late 80s (and continues today) that addresses many of these ideas. I'm sure that some of the current "search" research has raised interest further. Microsoft Research, IBM Research, and others are very much interested in these areas.
One example would be the Text Mining project at IBM: http://www.trl.ibm.com/projects/textmining/index_e.htm
A good link for coding systems that follow some of these practices is here: http://www.cl.cam.ac.uk/Research/NL/anlt.html
There is WAY too much involved, morphologically, lexically, and linguistically, to demonstrate even the simplest of these algorithms in a newsgroup message. Start at your local college library and/or Google for "Natural Language Processing" Go from there.
-- --- Nick Malik [Microsoft] MCSD, CFPS, Certified Scrummaster http://blogs.msdn.com/nickmalik
Disclaimer: Opinions expressed in this forum are my own, and not representative of my employer. I do not answer questions on behalf of my employer. I'm just a programmer helping programmers. --
Aaron wrote: This there a public program/algorithm that can tell me the key points
of a text?
For example I entered the following text:
Web logs, or blogs, the online personal diaries where big names and
no names expound on everything from pets to presidents, are going mainstream.
While still a relatively small piece of total online activity, blogging has
caught on with affluent young adults. As Forrester Research analysts
recently noted, blogging will become increasingly common as these consumers
age. The program should give me the main keywords such as: blog,
online,people... I know some spam filters does this and Google?? I don't need it to be super accurate, but just to demostrate that
this is possible.
It sounds like you're interested in text mining. Try KDnuggets
( http://www.kdnuggets.com) in the "Software" section.
-Will Dwinnell http://will.dwinnell.com This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics
by: CJ Oxx |
last post by:
I have a problem with browser charset recognition when using PHP 4.1.2
(this is the PHP version which our hosting company provides).
For charset recognition, I use the following meta-tag:
<meta...
|
by: cybit friendly |
last post by:
Hi
I'm stuck due to lack of knowledge.
Problem: I'm scanning through Array1 to find the closest match
to Array2 within Array1. At the moment I'm using a method that can
best be described as...
|
by: BCC |
last post by:
What is the best way to find out how many times a pattern is matched in a
string? For example if I have:
std::string s = "AAAAABBAAAABBAAAABAAABB";
I want to know how many "BB" patterns there...
|
by: Rod |
last post by:
About two weeks ago I had an accident and have broken my left elbow and left
wrist. For doing things like Word or e-mail (I use Outlook for) I have been
using Microsoft's speech recognition and...
|
by: Junior |
last post by:
Hi guys.
I want to incorporate voice recognition in a new .NET application I'm
developing. I would like to recognize among a group of 30-40 words. But I
would also like to avoid using 3dr party...
|
by: Meena |
last post by:
In our company we are trying to add speech recognition to our products.
I downloaded the Speech Recognition engine.
Now there is a component called Microsoft Direct Speech Recognition in
VB.Net...
|
by: Ian Dickinson |
last post by:
Hi
My name is Ian Dickinson and I am a professional software developer working in the UK and reasonably familiar with Python.
However a friend of mine who is a special educational needs teacher...
|
by: kalroche |
last post by:
looking for expertise on a speech recognition project for thesis presentation
My intention is to have speech recognition for product location for a grocery stores. What would be the best database...
|
by: daveftl |
last post by:
Hi to all,
can anyone help me by sharing there knowledge about pattern recognition using VB6...is there a Component or tool that can do the work?...im going to do pattern recognition on an...
|
by: deluxmilkman |
last post by:
Is it possible to integrate Mac`s built in speech recognition feature ()or any other speech recognition software) into flash?
I am trying to make a speech recognition based flash application. It...
|
by: Charles Arthur |
last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
|
by: ryjfgjl |
last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
|
by: emmanuelkatto |
last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud.
Please let me know.
Thanks!
Emmanuel
|
by: nemocccc |
last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
|
by: Sonnysonu |
last post by:
This is the data of csv file
1 2 3
1 2 3
1 2 3
1 2 3
2 3
2 3
3
the lengths should be different i have to store the data by column-wise with in the specific length.
suppose the i have to...
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
|
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers,...
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
|
by: Hystou |
last post by:
Overview:
Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
| |