473,804 Members | 4,795 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

given source probabilities(0 .30,0.25,0.20,0 .15,0.10).find source entropy H(X)

3 New Member
my question is:
consider a discrete memoryless source with source probabilities{0 .30,0.25,0.20,0 .15,0.10}.find the source entropy,H(X)?

please try to answer the question within 2-3 days.actually i am preparing for UGC NET(computer science) so i need help to solve my queries
Jun 4 '10 #1
2 3637
jkmyoung
2,057 Recognized Expert Top Contributor
Disclaimer: Your notes will be a much better source for the formula. This may not even be what you're looking for, since we have no idea what your course material is.

http://en.wikipedia.org/wiki/Entropy...mation_theory)
According to this Shannon Entropy is
H(x) = - sum of p(x) * log(p(x))

- 0.30 * log (0.30) +
- 0.25 * log (0.25) +
...

Answer differs on the base of the log. Guessing it would be e.
Jun 7 '10 #2
satinderjeetkaur
3 New Member
@satinderjeetkau r
thanks sir.this information will be helpful for me
Jun 7 '10 #3

Sign in to post your reply or Sign up for a free account.

Similar topics

5
2017
by: Richard Wesley | last post by:
I am using coverage.py to run my unit test suite to check for missing tests. It mostly works, but for some mysterious reason, some of the files can't be found because they are not in the same directory as configure.py and unit_test.py. But only SOME of them. Anyone have any ideas? -- - rmgw
2
2091
by: Middletree | last post by:
This is an ASP-built Intranet app, so I have saved off a static version of the page for reference, and it is located at http://www.middletree.net/err.htm and the page to compare it to is http://www.middletree.net/noerr.htm If you go to the first page, in my case using IE 6/WinXP, you'll see that it shows a js error. More important than just the error is that the menu is gone. On the 2nd page, the error doesn't exist. That second page...
3
1366
by: Bruce D | last post by:
I'm new to .NET and I have a error that is coming up but it's not telling me where the error is coming from (no file). Is that because I'm doing something wrong...or is it a type of error that has nothing to do with my code? P.S. I'm debugging someone else's code. Here's what the screen looks like when I load the page: *************************************************** Input String was not in a correct format Exception Details:...
1
1779
by: ~~~ .NET Ed ~~~ | last post by:
I have a couple of websites that I develop locally on WinXP Pro and these have their virtual directories mapped to another local drive (i.e. E:\Websites\*) rather than the default C:\inetpub\wwwroot\* location. Using VS.NET 2003 I wanted to add my solution to source control (local VSS database as well) but was unable to do it because it complained that the path did not correspond to c:\inetpub\wwwroot or something like that. Does that...
1
2501
by: mimenko | last post by:
Hello, I like to play with letters, and I try to find some websites on which I could find source codes of word games, like crossword, scrabble, anagrams, word utilities,... , and other games but exclusively with words. It's very difficult to find such programs. I need some help to tell me where I could find them, or how I can make my searches. Thanks a lot by advance for your answers.
3
16929
by: TOXiC | last post by:
Hi everyone, First I say that I serched and tryed everything but I cannot figure out how I can do it. I want to open a a file (not necessary a txt) and find and replace a string. I can do it with: import fileinput, string, sys fileQuery = "Text.txt" sourceText = '''SOURCE'''
0
1139
by: magickarle | last post by:
Hi, I'm trying to do as follow: I got a table Quality with qualityID Grade: 1 0 1 3 1 6 2 0 2 2 2 3 3 0
3
1302
by: Jens-Oliver Murer | last post by:
Hello, I have a problem with an ASP.Net-application which generates very large source codes which have to be sent to the clients through 'thin' lines. The main problem seems to be a Datagrid which contains several hundred rows (I'd split them, but our customer wants it this way). I already disabled the ViewState and cut the source by nearly half. I use two datagrids on the page, which can be displayed alternately by setting the...
2
2033
by: Archanak | last post by:
Hi, I am uploading a zipfile and i want to copy the file to some other directory i tried like this. Here is the html code: <html> <body> <form method='POST' enctype='multipart/form-data' action='/cgi-bin/zip.pl'>
0
9579
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
10332
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
1
10320
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
0
6853
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
5521
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
0
5651
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
1
4299
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
2
3820
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
3
2991
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.