469,126 Members | 1,317 Online
Bytes | Developer Community
New Post

Home Posts Topics Members FAQ

Post your question to a community of 469,126 developers. It's quick & easy.

given source probabilities(0.30,0.25,0.20,0.15,0.10).find source entropy H(X)

my question is:
consider a discrete memoryless source with source probabilities{0.30,0.25,0.20,0.15,0.10}.find the source entropy,H(X)?

please try to answer the question within 2-3 days.actually i am preparing for UGC NET(computer science) so i need help to solve my queries
Jun 4 '10 #1
2 2868
2,057 Expert 2GB
Disclaimer: Your notes will be a much better source for the formula. This may not even be what you're looking for, since we have no idea what your course material is.

According to this Shannon Entropy is
H(x) = - sum of p(x) * log(p(x))

- 0.30 * log (0.30) +
- 0.25 * log (0.25) +

Answer differs on the base of the log. Guessing it would be e.
Jun 7 '10 #2
thanks sir.this information will be helpful for me
Jun 7 '10 #3

Post your reply

Sign in to post your reply or Sign up for a free account.

Similar topics

5 posts views Thread by Richard Wesley | last post: by
2 posts views Thread by Middletree | last post: by
3 posts views Thread by Bruce D | last post: by
3 posts views Thread by Jens-Oliver Murer | last post: by
1 post views Thread by CARIGAR | last post: by
reply views Thread by zhoujie | last post: by
By using this site, you agree to our Privacy Policy and Terms of Use.