Trouble with Perl script

[joeferns79]

I am trying to modify a script that's supposed to extract data from a log file.

The script is as under ..

use strict;
####################################################################
# genreport
####################################################################
sub genreport {
   my ($logfile, $reportfile) = @_;
   my ($line, @message, @summary, $count, $match, $n);
 
   open(LOGFILE, "<$logfile")
      or die "Can't open $logfile: $!";
 
   open (REPORTFILE, ">$reportfile")
      or die "Can't open $reportfile: $!";
 
   $count = $match = 0;
   while ($line = <LOGFILE>) {
      chomp $line;
      if (length $line) {
         push @message, $line;
      } else {
         if ($message[0] =~ /^\[ERROR](.*)\administrator.$/) {
            #foreach $n (0..$#message) {
        #  if ($message[$n] =~ /^infrastructure:ID_UNHANDLED:.*/) {
             $match = 1;
        #   }
           if (($message[$n] =~ /^nested exception is:.*/) && ($match == 1)) {
           push @summary, $message[$n + 1];
           }           
       # }
        if ($match == 1) {
              foreach $line (@message) {
                  printf REPORTFILE "%s\n", $line;
           }
               printf REPORTFILE "\n";
               $count++;
           $match = 0;
            }
         } 
    else {
            die "parse error: missing date";
         }
         @message = ();
      }
   }
 
   if ($count > 0) {
      printf "There were %s un-handled server exceptions:\n\n", $count;
      foreach $line (@summary) {
         printf "   ***> %s\n", $line
      }
      printf "\n";
   } else {
      printf "There were no un-handled server exceptions for this reporting period.\n\n";
   }
}
 
####################################################################
# main
####################################################################
 
if (@ARGV != 2) {
   die "usage: UAESummary.pl <logfile> <reportfile>";
}
 
my ($logfile, $reportfile) = @ARGV;
 
genreport($logfile, $reportfile);
 
exit 0;
 
############
 

The log file is as under ...

[ERROR] [09 Sep 2008 13:58:59] [Trace] [WebContainer : 88] - infrastructure:ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.
nested exception is:
infrastructure:RUN_ID_RUNTIME: A runtime exception occurred: javax.transaction.RollbackException.
at curam.util.transaction.ResourcesJTA.Ô00000(Resourc esJTA.java(Compiled Code))
at curam.util.transaction.TransactionInfo.commit(Tran sactionInfo.java(Compiled Code))
at curam.util.internal.CuramSessionBean.invoke(CuramS essionBean.java(Compiled Code))
at curam.util.internal.CuramSessionBean.invoke(CuramS essionBean.java(Inlined Compiled Code))
at curam.util.invoke.EJSRemoteStatelessEJBMethod_51fe 6ae7.invoke(EJSRemoteStatelessEJBMethod_51fe6ae7.j ava(Compiled Code))
at sun.reflect.GeneratedMethodAccessor120.invoke(Unkn own Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(De legatingMethodAccessorImpl.java(Compiled Code))
at java.lang.reflect.Method.invoke(Method.java(Compil ed Code))
at com.ibm.rmi.util.ProxyUtil$2.run(ProxyUtil.java(Co mpiled Code))
at java.security.AccessController.doPrivileged1(Nativ e Method)
at java.security.AccessController.doPrivileged(Access Controller.java(Compiled Code))
at com.ibm.rmi.util.ProxyUtil.invokeWithPrivilege(Pro xyUtil.java(Compiled Code))
at com.ibm.CORBA.iiop.ClientDelegate.invoke(ClientDel egate.java(Compiled Code))


#####

When I try running it though, it returns ...

C:\PerlScripts>UAESummary.bat CuramApp.log Report.log
There were no un-handled server exceptions for this reporting period.

Even though there is clearly a string that matches the regular expression in the script, unless I am missing something.

Please help.

[numberwhun]

Well, if I am reading this code right, then your code is doing exactly what you have told it to do. On line 16 you do an if test on "length $line". I assume this is returning true and going into that part of the if. The regex's and the $count variable are all inside of the "else" part of the if statement. The if test would have to fail for your code to work.

I think you need to re-work this code. (assuming I have read it correctly).

Also, please use code tags around your code. I have added them here for you. Simply edit your original post to see how to use them.

Regards,

Jeff

[joeferns79]

Thanks for the quick response, Jeff.

I removed that part from the code, as can be seen below...

use strict;
 
 
####################################################################
# genreport
####################################################################
  sub genreport {
   my ($logfile, $reportfile) = @_;
   my ($line, @message, @summary, $count, $match, $n);
 
   open(LOGFILE, "<$logfile")
      or die "Can't open $logfile: $!";
 
   open (REPORTFILE, ">$reportfile")
      or die "Can't open $reportfile: $!";
 
   $count = $match = 0;
   while ($line = <LOGFILE>) {
      chomp $line;
          if ($message[0] =~ /^\[ERROR](.*)\administrator.$/) {
            #foreach $n (0..$#message) {
        #  if ($message[$n] =~ /^infrastructure:ID_UNHANDLED:.*/) {
             $match = 1;
        #   }
           if (($message[$n] =~ /^nested exception is:.*/) && ($match == 1)) {
          push @summary, $message[$n + 1];
           }           
       # }
        if ($match == 1) {
             foreach $line (@message) {
                  printf REPORTFILE "%s\n", $line;
           }
               printf REPORTFILE "\n";
               $count++;
           $match = 0;
            }
         } 
    #else {
    #        die "parse error: missing date";
    #     }
         @message = ();
 
   }
 
   if ($count > 0) {
      printf "There were %s un-handled server exceptions:\n\n", $count;
      foreach $line (@summary) {
         printf "   ***> %s\n", $line
      }
      printf "\n";
   } else {
      printf "There were no un-handled server exceptions for this reporting period.\n\n";
   }
}

I am still getting the same message though ...

C:\PerlScripts>UAESummary.bat CuramApp.log Report.log
There were no un-handled server exceptions for this reporting period.


I am just wondering if the reg exp is right since the code doesn't seem to be adding to the count and is printing the stmt ..

"There were no un-handled server exceptions for this reporting period.\n\n"

[eWish]

Is that a copy of that actual data you are using that you listed in the first post?

--Kevin

[joeferns79]

Yes it is. I made it work actually, but now I wanted to extract the part from the stack that says "nested exception" and was having trouble with that.

The code is as below ...

 while ($line = <LOGFILE>) {
      chomp $line;
  if (length $line) {
         push @message, $line;
          if ($message[0] =~ /^\[ERROR](.*)\infrastructure:ID_UNHANDLED:.*$/) {
            foreach $n (0..$#message) {
        #  if ($message[$n] =~ /^infrastructure:ID_UNHANDLED:.*/) {
             $match = 1;
        #   }
           if (($message[$n] =~ /^nested exception is:(.*)/) && ($match == 1)) {
          push @summary, $message[$n + 1];
           }           
        }
        if ($match == 1) {
             foreach $line (@message) {
                  printf REPORTFILE "%s\n", $line;
           }
               printf REPORTFILE "\n";
               $count++;
           $match = 0;
            }
         } 

The report I get is as below ...

[ERROR] [09 Sep 2008 12:36:56] [Trace] [WebContainer : 78] - infrastructure:ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.

[ERROR] [09 Sep 2008 12:55:23] [Trace] [WebContainer : 83] - infrastructure:ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.

[ERROR] [09 Sep 2008 12:55:36] [Trace] [WebContainer : 80] - infrastructure:ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.

[ERROR] [09 Sep 2008 12:57:54] [Trace] [WebContainer : 77] - infrastructure:ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.


This is part of the input log(in addition to the 1st line that's captured above, I want the part below the "nested exception is:" string to be displayed too ...

[ERROR] [10 Sep 2008 10:13:17] [Trace] [WebContainer : 144] - infrastructure:ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.
at curam.util.internal.HandleException.getRemoteExcep tion(HandleException.java(Compiled Code))
at curam.util.internal.HandleException.getRemoteExcep tion(HandleException.java(Compiled Code))
at curam.util.internal.CuramSessionBean.o00000(CuramS essionBean.java(Compiled Code))
at curam.util.internal.CuramSessionBean.invoke(CuramS essionBean.java(Compiled Code))
at curam.util.internal.CuramSessionBean.invoke(CuramS essionBean.java(Inlined Compiled Code))
at curam.util.invoke.EJSRemoteStatelessEJBMethod_51fe 6ae7.invoke(EJSRemoteStatelessEJBMethod_51fe6ae7.j ava(Compiled Code))
at sun.reflect.GeneratedMethodAccessor120.invoke(Unkn own Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(De legatingMethodAccessorImpl.java(Compiled Code))
at java.lang.reflect.Method.invoke(Method.java(Compil ed Code))
at com.ibm.rmi.util.ProxyUtil$2.run(ProxyUtil.java(Co mpiled Code))
nested exception is:
infrastructure:RUN_ID_RECORD_NOT_FOUND: Record not found.
at curam.util.dataaccess.DatabaseCall.o00000(Database Call.java(Compiled Code))
at curam.util.dataaccess.DatabaseCall.o00000(Database Call.java(Compiled Code))
at curam.util.dataaccess.DatabaseCall.execute(Databas eCall.java(Compiled Code))
at curam.fem.entity.base.EMChecklist.read(EMChecklist .java(Compiled Code))
at curam.fem.facade.impl.EMChecklist.doNothing(EMChec klist.java(Compiled Code))
at sun.reflect.GeneratedMethodAccessor874.invoke(Unkn own Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(De legatingMethodAccessorImpl.java(Compiled Code))
at java.lang.reflect.Method.invoke(Method.java(Compil ed Code))
at curam.util.internal.CuramSessionBean.invoke(CuramS essionBean.java(Compiled Code))
at curam.util.internal.CuramSessionBean.invoke(CuramS essionBean.java(Inlined Compiled Code))
at curam.util.invoke.EJSRemoteStatelessEJBMethod_51fe 6ae7.invoke(EJSRemoteStatelessEJBMethod_51fe6ae7.j ava(Compiled Code))
at sun.reflect.GeneratedMethodAccessor120.invoke(Unkn own Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(De legatingMethodAccessorImpl.java(Compiled Code))
at java.lang.reflect.Method.invoke(Method.java(Compil ed Code))

[KevinADC]

I am really not clear on what you are trying to parse out of the log file, but see if this helps:

while ($line = <DATA>) {
   if ($line =~ /^\[ERROR\](.*?)infrastructure:ID_UNHANDLED:.*$/) {
      push @message, $line;
      $match = 1;
      next;
   }
   if ($match && ($line =~ /^nested exception is:/)) {
       $line = <DATA>;
       push @message, $line;
       $match = 0;
       next;
   }
}
for (@message) {
   print;
}
__DATA__
[ERROR] [09 Sep 2008 13:58:59] [Trace] [WebContainer : 88] - infrastructure:ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.
nested exception is:
infrastructure:RUN_ID_RUNTIME: A runtime exception occurred: javax.transaction.RollbackException.
at curam.util.transaction.ResourcesJTA.Ô00000(Resourc esJTA.java(Compiled Code))
at curam.util.transaction.TransactionInfo.commit(Tran sactionInfo.java(Compiled Code))
at curam.util.internal.CuramSessionBean.invoke(CuramS essionBean.java(Compiled Code))
at curam.util.internal.CuramSessionBean.invoke(CuramS essionBean.java(Inlined Compiled Code))
at curam.util.invoke.EJSRemoteStatelessEJBMethod_51fe 6ae7.invoke(EJSRemoteStatelessEJBMethod_51fe6ae7.j ava(Compiled Code))
at sun.reflect.GeneratedMethodAccessor120.invoke(Unkn own Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(De legatingMethodAccessorImpl.java(Compiled Code))
at java.lang.reflect.Method.invoke(Method.java(Compil ed Code))
at com.ibm.rmi.util.ProxyUtil$2.run(ProxyUtil.java(Co mpiled Code))
at java.security.AccessController.doPrivileged1(Nativ e Method)
at java.security.AccessController.doPrivileged(Access Controller.java(Compiled Code))
at com.ibm.rmi.util.ProxyUtil.invokeWithPrivilege(Pro xyUtil.java(Compiled Code))
at com.ibm.CORBA.iiop.ClientDelegate.invoke(ClientDel egate.java(Compiled Code))
 

[joeferns79]

Thanks, this helped.