md5 from python different then md5 from command line

[ursache.marius]

Hi

I noticed that the md5 computed with md5 module from python is
different then the md5 sum computed with md5sum utility (on slackware
and gentoo).

i.e.
$echo marius|md5sum
0f0f60ac801a9eec2163083a22307deb -

test = md5.new("marius")
print test.hexdigest()

242aa1a97769109065e3b4df359bcfc9
Any idea why? and how to get the same md5 sum for both calls?

Thanks

[Just]

In article <11**********************@j73g2000cwa.googlegroups .com>,
"ur************@gmail.com" <ur************@gmail.com> wrote:

I noticed that the md5 computed with md5 module from python is
different then the md5 sum computed with md5sum utility (on slackware
and gentoo).

i.e.
$echo marius|md5sum
0f0f60ac801a9eec2163083a22307deb -

test = md5.new("marius")
print test.hexdigest() 242aa1a97769109065e3b4df359bcfc9
Any idea why? and how to get the same md5 sum for both calls?

echo adds a newline:

import md5
test = md5.new("marius\n")
print test.hexdigest()

0f0f60ac801a9eec2163083a22307deb

Just

[Dejan Rodiger]

ur************@gmail.com said the following on 07.05.2006 12:07:

Hi

I noticed that the md5 computed with md5 module from python is
different then the md5 sum computed with md5sum utility (on slackware
and gentoo).

i.e.
$echo marius|md5sum
0f0f60ac801a9eec2163083a22307deb -

test = md5.new("marius")
print test.hexdigest()

242aa1a97769109065e3b4df359bcfc9
Any idea why? and how to get the same md5 sum for both calls?

Thanks

try md5sum marius
probably "new line" character is not computed in "echo marius|md5sum"
--
Dejan Rodiger - PGP ID 0xAC8722DC
Delete wirus from e-mail address

[Marius Ursache]

> echo adds a newline:

>>> import md5
>>> test = md5.new("marius\n")
>>> print test.hexdigest()

0f0f60ac801a9eec2163083a22307deb

Just

Thanks, that was it ;)

[Paul Rubin]

"Marius Ursache" <ur************@gmail.com> writes:

>>> import md5
>>> test = md5.new("marius\n")
>>> print test.hexdigest()

0f0f60ac801a9eec2163083a22307deb

Thanks, that was it ;)

Also, the -n option suppresses the newline from echo:

$ echo -n marius | md5sum
242aa1a97769109065e3b4df359bcfc9 -

[John Salerno]

ur************@gmail.com wrote:

Hi

I noticed that the md5 computed with md5 module from python is
different then the md5 sum computed with md5sum utility (on slackware
and gentoo).

i.e.
$echo marius|md5sum
0f0f60ac801a9eec2163083a22307deb -

test = md5.new("marius")
print test.hexdigest()

242aa1a97769109065e3b4df359bcfc9
Any idea why? and how to get the same md5 sum for both calls?

Thanks

Just a quick md5-related follow-up question: I was experimenting with it
and making md5 sums for strings, but how do you use the md5 module to
create a sum for an actual file, such as an .exe file?

Thanks.

[Paul Rubin]

John Salerno <jo******@NOSPAMgmail.com> writes:

Just a quick md5-related follow-up question: I was experimenting with
it and making md5 sums for strings, but how do you use the md5 module
to create a sum for an actual file, such as an .exe file?

m = md5.new()
f = file('foo.exe', 'b') # open in binary mode
while True:
t = f.read(1024)
if len(t) == 0: break # end of file
m.update(t)
print m.hexdigest()

[John Salerno]

Paul Rubin wrote:

John Salerno <jo******@NOSPAMgmail.com> writes:

Just a quick md5-related follow-up question: I was experimenting with
it and making md5 sums for strings, but how do you use the md5 module
to create a sum for an actual file, such as an .exe file?

m = md5.new()
f = file('foo.exe', 'b') # open in binary mode
while True:
t = f.read(1024)
if len(t) == 0: break # end of file
m.update(t)
print m.hexdigest()

Any reason you can't just read the whole file at once and update m?

Also, doesn't the parameter for update have to be a string? If you're
reading the file in binary mode, would t still be a string?

Thanks.

[Paul Rubin]

John Salerno <jo******@NOSPAMgmail.com> writes:

Any reason you can't just read the whole file at once and update m?
Yes, you could say

print md5.new(file('foo.exe').read()).hexdigest()
but that means reading the whole file into memory at once. If the
file is very large, that could thrash or fail.
Also, doesn't the parameter for update have to be a string? If you're
reading the file in binary mode, would t still be a string?

Yes, t would still be a string. You can have NUL bytes and so forth
in Python strings:

len('ab\0cd') ==> 5

[John Salerno]

Paul Rubin wrote:

John Salerno <jo******@NOSPAMgmail.com> writes:

Any reason you can't just read the whole file at once and update m?

Yes, you could say

print md5.new(file('foo.exe').read()).hexdigest()
but that means reading the whole file into memory at once. If the
file is very large, that could thrash or fail.

Also, doesn't the parameter for update have to be a string? If you're
reading the file in binary mode, would t still be a string?

Yes, t would still be a string. You can have NUL bytes and so forth
in Python strings:

len('ab\0cd') ==> 5

Thanks! I didn't expect it to be so easy. :)