473,396 Members | 2,033 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,396 software developers and data experts.

Parsing Log Files

sicarie
4,677 Expert Mod 4TB
I just started a position where I am supposed to parse log files, and automate that as much as possible. I was wondering what good tools there were for Windows to accomplish that.

I know there is a Perl module that will access those logfiles, but I am looking for a bit more functionality(such as a language with a more advanced data structure), and was wondering if there was a better tool.

Thanks!
Nov 5 '06 #1
3 3202
bartonc
6,596 Expert 4TB
I just started a position where I am supposed to parse log files, and automate that as much as possible. I was wondering what good tools there were for Windows to accomplish that.

I know there is a Perl module that will access those logfiles, but I am looking for a bit more functionality(such as a language with a more advanced data structure), and was wondering if there was a better tool.

Thanks!
Python has highly advanced data structures and there are many available modules out there. What is the producer of these logs, BTW?
Barton
Nov 12 '06 #2
sicarie
4,677 Expert Mod 4TB
At the moment, I'm working on LDAP, though I believe I have that figured out, and next up is AD. We're doing statistical trending of user logon times and failure attempts, so I need to be able to get into the Windows event logs and parse through them for user, time, and message, though category would probably suffice (I'm still testing my LDAP program, so I haven't had too much time to look into LDAP).

This is in an organization that has several hundred remote users connecting at all different times, so I need something lightweight enough to hold all of the users while going through the logfiles, but that still has some of the more advanced data structures (I started in PERL, but that didn't work too well...).
Nov 13 '06 #3
bartonc
6,596 Expert 4TB
The install is quite small. It can install it and check it out. PythonWin has lots of useful access to the win32 api. I found some example code for eventlog in the PythonWin docs, but I'm having a terrible time pasting to this post. PM me w/ emial for text or an attachment.
Nov 14 '06 #4

Sign in to post your reply or Sign up for a free account.

Similar topics

8
by: Gerrit Holl | last post by:
Posted with permission from the author. I have some comments on this PEP, see the (coming) followup to this message. PEP: 321 Title: Date/Time Parsing and Formatting Version: $Revision: 1.3 $...
4
by: Marian Jancar | last post by:
Hi, Is there a module for parsing spec files available? Marian -- -- Best Regards,
0
by: rick_muller | last post by:
I'm interested in parsing a (simple) Makefile using Python. I need to write a packager for a program I'm supporting, and would like to read the list of files in the makefile so that I only have to...
2
by: Cigdem | last post by:
Hello, I am trying to parse the XML files that the user selects(XML files are on anoher OS400 system called "wkdis3"). But i am permenantly getting that error: Directory0: \\wkdis3\ROOT\home...
3
by: Girish | last post by:
Hi All, I have written a component(ATL COM) that wraps Xerces C++ parser. I am firing necessary events for each of the notifications that I have handled for the Content and Error handler. The...
9
by: PedroX | last post by:
Hello: I need to parse some large XML files, and save the data in an Access DB. I was using MSXML 2 and ASP, but it turns out to be extremely slow when then XML documents are like 10 mb in...
35
by: .:mmac:. | last post by:
I have a bunch of files (Playlist files for media player) and I am trying to create an automatically generated web page that includes the last 20 or 30 of these files. The files are created every...
1
by: Christoph Bisping | last post by:
Hello! Maybe someone is able to give me a little hint on this: I've written a vb.net app which is mainly an interpreter for specialized CAD/CAM files. These files mainly contain simple movement...
3
by: toton | last post by:
Hi, I have some ascii files, which are having some formatted text. I want to read some section only from the total file. For that what I am doing is indexing the sections (denoted by .START in...
3
by: GazK | last post by:
I have been using an xml parsing script to parse a number of rss feeds and return relevant results to a database. The script has worked well for a couple of years, despite having very crude...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.