Best way to compare the contents of two directories

[Robin Siebler]

I have two directory trees that I want to compare and I'm trying to
figure out what the best way of doing this would be. I am using walk
to get a list of all of the files in each directory.

I am using this code to compare the file lists:

def compare_files(f irst_list, second_list, first_dir, second_dir):
missing = in_first_only(f irst_list, second_list)
for item in missing:
index = first_list.inde x(item)
print first_list[index] + ' does not exist in ' +
second_dir[index]
first_list.pop( index); first_dir.pop(i ndex)
return first_list, second_list, first_dir, second_dir

However, before I actually compare the files, I want to compare the
directories and if a directory is mising in either set, I want to
report it:

dir_list_a = ['d:\\results\\f oldera\\','d:\\ results\\folder b\\','d:\\resul ts\\folderc\\']
dir_list_b = ['c:\\results\\f oldera\\','c:\\ results\\folder b\\']

output:
'folderc' exists in d:\results but not in c:\results
I am using splitall (from the Python Cookbook) to split the paths into
there parts and appending this to a list, but I can't figure out the
best way to compare the contents of the resulting 2 lists and I think
I am starting to make things *too* complicated:

def splitall(path):
"""
Source: Python Cookbook
Credit: Trent Mick

Split a path into all of its parts.
"""
allparts = []
while 1:
parts = os.path.split(p ath)
if parts[0] == path:
allparts.insert (0, parts[0])
break
elif parts[1] == path:
allparts.insert (0, parts[1])
break
else:
path = parts[0]
allparts.insert (0, parts[1])
return allparts

After using this, I end up with this:

dir_list_a = [['d:\\', 'results', 'foldera', 'd:\\', 'results',
'folderb', 'd:\\', 'results', 'folderc']]
dir_list_b =
[['d:\\', 'results', 'foldera', 'd:\\', 'results', 'folderb']]

[Dan Dang Griffith]

ro***********@p almsource.com (Robin Siebler) wrote in message news:<95******* *************** ****@posting.go ogle.com>...

I have two directory trees that I want to compare and I'm trying to
figure out what the best way of doing this would be. I am using walk
to get a list of all of the files in each directory.

Once you have the two lists, look into difflib. E.g.,

import difflib
for i in difflib.ndiff(l ist1, list2):
print i

Dan Gass has recently contributed some code that can produce
a side-by-side difference in HTML format. I believe it is in the 2.4
release, but you can also get it from
"""https://sourceforge.net/tracker/?func=detail&at id=305470&aid=9 14575&group_id= 5470"""

import difflib
tbl = difflib.HtmlDif f().make_file(l ist1, list2)
f = open("diffs.htm l", "w")
f.write(tbl)
f.close()

--dang

[Raymond Hettinger]

[Robin Siebler]

However, before I actually compare the files, I want to compare the
directories and if a directory is mising in either set, I want to
report it:

The operative word is "set".

Try using sets.py:
one_only = Set(dirlistone) - Set(dirlisttwo)
two_only = Set(dirlisttwo) - Set(dirlistone)
Raymond Hettinger

[Robin Siebler]

"Raymond Hettinger" <vz******@veriz on.net> wrote in message news:<Zxc1d.412 $W73.185@trndny 03>...

[Robin Siebler]

However, before I actually compare the files, I want to compare the
directories and if a directory is mising in either set, I want to
report it:

The operative word is "set".

Try using sets.py:
one_only = Set(dirlistone) - Set(dirlisttwo)
two_only = Set(dirlisttwo) - Set(dirlistone)
Raymond Hettinger

I get the following error:

NameError: name 'Set' is not defined

I'm using ActivePython 2.2.3. Is this something that has been added
to a later version of Python?

[Cliff Wells]

On Mon, 2004-09-13 at 11:37 -0700, Robin Siebler wrote:

"Raymond Hettinger" <vz******@veriz on.net> wrote in message news:<Zxc1d.412 $W73.185@trndny 03>...

[Robin Siebler]

However, before I actually compare the files, I want to compare the
directories and if a directory is mising in either set, I want to
report it:

The operative word is "set".

Try using sets.py:
one_only = Set(dirlistone) - Set(dirlisttwo)
two_only = Set(dirlisttwo) - Set(dirlistone)
Raymond Hettinger

I get the following error:

NameError: name 'Set' is not defined

I'm using ActivePython 2.2.3. Is this something that has been added
to a later version of Python?

I think sets were added in 2.3, but either way you must still 'from sets
import Set' before using them.

Regards,
Cliff

--
Cliff Wells <cl************ @comcast.net>

[Steven Bethard]

Cliff Wells <clifford.wel ls <at> comcast.net> writes:

I think sets were added in 2.3, but either way you must still 'from sets
import Set' before using them.

It also might be good to get in the habit of writing this as:

from sets import Set as set

so that when you move to Python 2.4, where set() is a builtin, all you have to
do is remove the import.

Python 2.4a3 (#56, Sep 2 2004, 20:50:21) [MSC v.1310 32 bit (Intel)] on win32
Type "help", "copyright" , "credits" or "license" for more information.

set(abs(2*i - 6) for i in range(10))

set([0, 2, 4, 6, 8, 10, 12])

Steve

[Raymond Hettinger]

> > I'm using ActivePython 2.2.3. Is this something that has been added

to a later version of Python?

I think sets were added in 2.3, but either way you must still 'from sets
import Set' before using them.

Right.

Also, sets.py is now Py2.2 compatibility, so you can take the current module off
of CVS and use it directly.
Raymond Hettinger