473,395 Members | 1,442 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,395 software developers and data experts.

given source probabilities(0.30,0.25,0.20,0.15,0.10).find source entropy H(X)

my question is:
consider a discrete memoryless source with source probabilities{0.30,0.25,0.20,0.15,0.10}.find the source entropy,H(X)?

please try to answer the question within 2-3 days.actually i am preparing for UGC NET(computer science) so i need help to solve my queries
Jun 4 '10 #1
2 3582
jkmyoung
2,057 Expert 2GB
Disclaimer: Your notes will be a much better source for the formula. This may not even be what you're looking for, since we have no idea what your course material is.

http://en.wikipedia.org/wiki/Entropy...mation_theory)
According to this Shannon Entropy is
H(x) = - sum of p(x) * log(p(x))

- 0.30 * log (0.30) +
- 0.25 * log (0.25) +
...

Answer differs on the base of the log. Guessing it would be e.
Jun 7 '10 #2
@satinderjeetkaur
thanks sir.this information will be helpful for me
Jun 7 '10 #3

Sign in to post your reply or Sign up for a free account.

Similar topics

5
by: Richard Wesley | last post by:
I am using coverage.py to run my unit test suite to check for missing tests. It mostly works, but for some mysterious reason, some of the files can't be found because they are not in the same...
2
by: Middletree | last post by:
This is an ASP-built Intranet app, so I have saved off a static version of the page for reference, and it is located at http://www.middletree.net/err.htm and the page to compare it to is...
3
by: Bruce D | last post by:
I'm new to .NET and I have a error that is coming up but it's not telling me where the error is coming from (no file). Is that because I'm doing something wrong...or is it a type of error that has...
1
by: ~~~ .NET Ed ~~~ | last post by:
I have a couple of websites that I develop locally on WinXP Pro and these have their virtual directories mapped to another local drive (i.e. E:\Websites\*) rather than the default...
1
by: mimenko | last post by:
Hello, I like to play with letters, and I try to find some websites on which I could find source codes of word games, like crossword, scrabble, anagrams, word utilities,... , and other games but...
3
by: TOXiC | last post by:
Hi everyone, First I say that I serched and tryed everything but I cannot figure out how I can do it. I want to open a a file (not necessary a txt) and find and replace a string. I can do it...
0
by: magickarle | last post by:
Hi, I'm trying to do as follow: I got a table Quality with qualityID Grade: 1 0 1 3 1 6 2 0 2 2 2 3 3 ...
3
by: Jens-Oliver Murer | last post by:
Hello, I have a problem with an ASP.Net-application which generates very large source codes which have to be sent to the clients through 'thin' lines. The main problem seems to be a Datagrid...
2
by: Archanak | last post by:
Hi, I am uploading a zipfile and i want to copy the file to some other directory i tried like this. Here is the html code: <html> <body> <form method='POST' enctype='multipart/form-data'...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.