473,388 Members | 1,215 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,388 software developers and data experts.

given source probabilities(0.30,0.25,0.20,0.15,0.10).find source entropy H(X)

my question is:
consider a discrete memoryless source with source probabilities{0.30,0.25,0.20,0.15,0.10}.find the source entropy,H(X)?

please try to answer the question within 2-3 days.actually i am preparing for UGC NET(computer science) so i need help to solve my queries
Jun 4 '10 #1
2 3580
jkmyoung
2,057 Expert 2GB
Disclaimer: Your notes will be a much better source for the formula. This may not even be what you're looking for, since we have no idea what your course material is.

http://en.wikipedia.org/wiki/Entropy...mation_theory)
According to this Shannon Entropy is
H(x) = - sum of p(x) * log(p(x))

- 0.30 * log (0.30) +
- 0.25 * log (0.25) +
...

Answer differs on the base of the log. Guessing it would be e.
Jun 7 '10 #2
@satinderjeetkaur
thanks sir.this information will be helpful for me
Jun 7 '10 #3

Sign in to post your reply or Sign up for a free account.

Similar topics

5
by: Richard Wesley | last post by:
I am using coverage.py to run my unit test suite to check for missing tests. It mostly works, but for some mysterious reason, some of the files can't be found because they are not in the same...
2
by: Middletree | last post by:
This is an ASP-built Intranet app, so I have saved off a static version of the page for reference, and it is located at http://www.middletree.net/err.htm and the page to compare it to is...
3
by: Bruce D | last post by:
I'm new to .NET and I have a error that is coming up but it's not telling me where the error is coming from (no file). Is that because I'm doing something wrong...or is it a type of error that has...
1
by: ~~~ .NET Ed ~~~ | last post by:
I have a couple of websites that I develop locally on WinXP Pro and these have their virtual directories mapped to another local drive (i.e. E:\Websites\*) rather than the default...
1
by: mimenko | last post by:
Hello, I like to play with letters, and I try to find some websites on which I could find source codes of word games, like crossword, scrabble, anagrams, word utilities,... , and other games but...
3
by: TOXiC | last post by:
Hi everyone, First I say that I serched and tryed everything but I cannot figure out how I can do it. I want to open a a file (not necessary a txt) and find and replace a string. I can do it...
0
by: magickarle | last post by:
Hi, I'm trying to do as follow: I got a table Quality with qualityID Grade: 1 0 1 3 1 6 2 0 2 2 2 3 3 ...
3
by: Jens-Oliver Murer | last post by:
Hello, I have a problem with an ASP.Net-application which generates very large source codes which have to be sent to the clients through 'thin' lines. The main problem seems to be a Datagrid...
2
by: Archanak | last post by:
Hi, I am uploading a zipfile and i want to copy the file to some other directory i tried like this. Here is the html code: <html> <body> <form method='POST' enctype='multipart/form-data'...
0
by: taylorcarr | last post by:
A Canon printer is a smart device known for being advanced, efficient, and reliable. It is designed for home, office, and hybrid workspace use and can also be used for a variety of purposes. However,...
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.