469,126 Members | 1,317 Online
Bytes | Developer Community
New Post

Home Posts Topics Members FAQ

Post your question to a community of 469,126 developers. It's quick & easy.

given source probabilities(0.30,0.25,0.20,0.15,0.10).find source entropy H(X)

my question is:
consider a discrete memoryless source with source probabilities{0.30,0.25,0.20,0.15,0.10}.find the source entropy,H(X)?

please try to answer the question within 2-3 days.actually i am preparing for UGC NET(computer science) so i need help to solve my queries
Jun 4 '10 #1
2 2868
jkmyoung
2,057 Expert 2GB
Disclaimer: Your notes will be a much better source for the formula. This may not even be what you're looking for, since we have no idea what your course material is.

http://en.wikipedia.org/wiki/Entropy...mation_theory)
According to this Shannon Entropy is
H(x) = - sum of p(x) * log(p(x))

- 0.30 * log (0.30) +
- 0.25 * log (0.25) +
...

Answer differs on the base of the log. Guessing it would be e.
Jun 7 '10 #2
@satinderjeetkaur
thanks sir.this information will be helpful for me
Jun 7 '10 #3

Post your reply

Sign in to post your reply or Sign up for a free account.

Similar topics

5 posts views Thread by Richard Wesley | last post: by
2 posts views Thread by Middletree | last post: by
3 posts views Thread by Bruce D | last post: by
3 posts views Thread by Jens-Oliver Murer | last post: by
1 post views Thread by CARIGAR | last post: by
reply views Thread by zhoujie | last post: by
By using this site, you agree to our Privacy Policy and Terms of Use.