Connecting Tech Pros Worldwide Forums | Help | Site Map

Parsing Log Files

sicarie's Avatar
Moderator
 
Join Date: Nov 2006
Location: USA
Posts: 3,929
#1: Nov 5 '06
I just started a position where I am supposed to parse log files, and automate that as much as possible. I was wondering what good tools there were for Windows to accomplish that.

I know there is a Perl module that will access those logfiles, but I am looking for a bit more functionality(such as a language with a more advanced data structure), and was wondering if there was a better tool.

Thanks!

bartonc's Avatar
Moderator
 
Join Date: Sep 2006
Location: Minden, Nevada, USA
Posts: 6,400
#2: Nov 12 '06

re: Parsing Log Files


Quote:

Originally Posted by sicarie

I just started a position where I am supposed to parse log files, and automate that as much as possible. I was wondering what good tools there were for Windows to accomplish that.

I know there is a Perl module that will access those logfiles, but I am looking for a bit more functionality(such as a language with a more advanced data structure), and was wondering if there was a better tool.

Thanks!

Python has highly advanced data structures and there are many available modules out there. What is the producer of these logs, BTW?
Barton
sicarie's Avatar
Moderator
 
Join Date: Nov 2006
Location: USA
Posts: 3,929
#3: Nov 13 '06

re: Parsing Log Files


At the moment, I'm working on LDAP, though I believe I have that figured out, and next up is AD. We're doing statistical trending of user logon times and failure attempts, so I need to be able to get into the Windows event logs and parse through them for user, time, and message, though category would probably suffice (I'm still testing my LDAP program, so I haven't had too much time to look into LDAP).

This is in an organization that has several hundred remote users connecting at all different times, so I need something lightweight enough to hold all of the users while going through the logfiles, but that still has some of the more advanced data structures (I started in PERL, but that didn't work too well...).
bartonc's Avatar
Moderator
 
Join Date: Sep 2006
Location: Minden, Nevada, USA
Posts: 6,400
#4: Nov 14 '06

re: Parsing Log Files


The install is quite small. It can install it and check it out. PythonWin has lots of useful access to the win32 api. I found some example code for eventlog in the PythonWin docs, but I'm having a terrible time pasting to this post. PM me w/ emial for text or an attachment.
Reply


Similar Microsoft Windows / Vista / XP / ME / 95 & 98 bytes