Two questions related to the topic
1. If I have an empty set of relevant results, then it would be
better
to have no answers from the system at all. But neither precision
nor
recall gives penalties for returning false positives in this case
(0/1=0/2=...=0/100). How people handle with this ? Is there other
measure for this cases ?
2. Let say I have ranking:
1. A
2. B *
3. C
4. D *
5. F
Where relevant answers are: B,D,E, and relevant answers found by
the
system are marked with a star (*).
Then for recall level 1/3 I have precision 1/2,
for recall level 2/3 I have precision 2/4=1/2.
The last position of ranking, false positive, is not counted in
the
precision/recall measure, as in this measure "only positions where
an
increase in recall is produced". I have the system which returns
some
false positives at the end of ranking, but how can I measure/
compare
it with other systems in terms of effectiveness, if precision/
recall
does not take it into account ?
TIA,
Maciej
1  3186 
Maciej Gawinecki wrote:
Two questions related to the topic
WTF has this got to do with SGML or XML?
///Peter
[Followups reset]
1. If I have an empty set of relevant results, then it would be
better to have no answers from the system at all. But neither
precision nor recall gives penalties for returning false positives in
this case (0/1=0/2=...=0/100). How people handle with this ? Is there
other measure for this cases ?
2. Let say I have ranking:
1. A
2. B *
3. C
4. D *
5. F
Where relevant answers are: B,D,E, and relevant answers found by the
system are marked with a star (*).
Then for recall level 1/3 I have precision 1/2,
for recall level 2/3 I have precision 2/4=1/2.
The last position of ranking, false positive, is not counted in the
precision/recall measure, as in this measure "only positions where an
increase in recall is produced". I have the system which returns
some false positives at the end of ranking, but how can I measure/
compare it with other systems in terms of effectiveness, if
precision/ recall does not take it into account ?
TIA,
Maciej
This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics
by: Lilith |
last post by:
Is there a python module somewhere (been searching today, no luck)
which has efficiently coded various graph-handling routines, such as
finding the shortest path through a graph, or the set of all...
|
by: Protoman |
last post by:
Hi!!! Protoman here, I need to write an infinite precision number class
b/c I want to compute pi. Give me some sample code. Also, when I run my
program and it computes pi, will my computer freeze...
|
by: entropy123 |
last post by:
Hey all,
In an effort to solve a sticky - for me - problem I've picked up
Sedgewick's 'Algorithm's in C'. I've tried working through the first
few problems but am a little stumped when he refers...
|
by: Arnaud Delobelle |
last post by:
Hi all,
I want to know the precision (number of significant digits) of a float
in a platform-independent manner. I have scoured through the docs but
I can't find anything about it!
At the...
|
by: mathieu.dutour |
last post by:
Dear all,
I want to do multiprecision floating point, i.e. I want
to go beyond single precision, double precision and have
quadruple precision, octuple precision and the like,
and possibly with...
|
by: sriniwas |
last post by:
Hi Frnd's,
m using prefuse visulation,it's have one display class and this class have one saveImage(outPutStream, String jpg,double size);. now graph is converting ia jpg image properly.now my...
|
by: Man4ish |
last post by:
namespace ve/////////////////ve.h
{
struct VertexProperties
{
std::size_t index;
boost::default_color_type color;
};
}...
|
by: Man4ish |
last post by:
I have created Graph object without vertex and edge property.It is working fine.
#include <boost/config.hpp>
#include <iostream>
#include <vector>
#include <string>
#include...
|
by: Tim |
last post by:
Folks,
Can anyone thow some clarifying light on the following?
I have come across a column with the same name and same data contents
defined on different tables, on some the column is defined...
|
by: Charles Arthur |
last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
|
by: ryjfgjl |
last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
|
by: BarryA |
last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
|
by: nemocccc |
last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
|
by: Sonnysonu |
last post by:
This is the data of csv file
1 2 3
1 2 3
1 2 3
1 2 3
2 3
2 3
3
the lengths should be different i have to store the data by column-wise with in the specific length.
suppose the i have to...
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
|
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
|
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...
| |
