Trouble with Perl script

[joeferns79]

I am trying to modify a script that's supposed to extract data from a log file.

The script is as under ..

use strict;
####################################################################
# genreport
####################################################################
sub genreport {
   my ($logfile, $reportfile) = @_;
   my ($line, @message, @summary, $count, $match, $n);
 
   open(LOGFILE, "<$logfile")
      or die "Can't open $logfile: $!";
 
   open (REPORTFILE, ">$reportfile")
      or die "Can't open $reportfile: $!";
 
   $count = $match = 0;
   while ($line = <LOGFILE>) {
      chomp $line;
      if (length $line) {
         push @message, $line;
      } else {
         if ($message[0] =~ /^\[ERROR](.*)\administrator.$/) {
            #foreach $n (0..$#message) {
        #  if ($message[$n] =~ /^infrastructure:ID_UNHANDLED:.*/) {
             $match = 1;
        #   }
           if (($message[$n] =~ /^nested exception is:.*/) && ($match == 1)) {
           push @summary, $message[$n + 1];
           }           
       # }
        if ($match == 1) {
              foreach $line (@message) {
                  printf REPORTFILE "%s\n", $line;
           }
               printf REPORTFILE "\n";
               $count++;
           $match = 0;
            }
         } 
    else {
            die "parse error: missing date";
         }
         @message = ();
      }
   }
 
   if ($count > 0) {
      printf "There were %s un-handled server exceptions:\n\n", $count;
      foreach $line (@summary) {
         printf "   ***> %s\n", $line
      }
      printf "\n";
   } else {
      printf "There were no un-handled server exceptions for this reporting period.\n\n";
   }
}
 
####################################################################
# main
####################################################################
 
if (@ARGV != 2) {
   die "usage: UAESummary.pl <logfile> <reportfile>";
}
 
my ($logfile, $reportfile) = @ARGV;
 
genreport($logfile, $reportfile);
 
exit 0;
 
############
 

The log file is as under ...

[ERROR] [09 Sep 2008 13:58:59] [Trace] [WebContainer : 88] - infrastructure: ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.
nested exception is:
infrastructure: RUN_ID_RUNTIME: A runtime exception occurred: javax.transacti on.RollbackExce ption.
at curam.util.tran saction.Resourc esJTA.Ô00000(Re sourcesJTA.java (Compiled Code))
at curam.util.tran saction.Transac tionInfo.commit (TransactionInf o.java(Compiled Code))
at curam.util.inte rnal.CuramSessi onBean.invoke(C uramSessionBean .java(Compiled Code))
at curam.util.inte rnal.CuramSessi onBean.invoke(C uramSessionBean .java(Inlined Compiled Code))
at curam.util.invo ke.EJSRemoteSta telessEJBMethod _51fe6ae7.invok e(EJSRemoteStat elessEJBMethod_ 51fe6ae7.java(C ompiled Code))
at sun.reflect.Gen eratedMethodAcc essor120.invoke (Unknown Source)
at sun.reflect.Del egatingMethodAc cessorImpl.invo ke(DelegatingMe thodAccessorImp l.java(Compiled Code))
at java.lang.refle ct.Method.invok e(Method.java(C ompiled Code))
at com.ibm.rmi.uti l.ProxyUtil$2.r un(ProxyUtil.ja va(Compiled Code))
at java.security.A ccessController .doPrivileged1( Native Method)
at java.security.A ccessController .doPrivileged(A ccessController .java(Compiled Code))
at com.ibm.rmi.uti l.ProxyUtil.inv okeWithPrivileg e(ProxyUtil.jav a(Compiled Code))
at com.ibm.CORBA.i iop.ClientDeleg ate.invoke(Clie ntDelegate.java (Compiled Code))


#####

When I try running it though, it returns ...

C:\PerlScripts> UAESummary.bat CuramApp.log Report.log
There were no un-handled server exceptions for this reporting period.

Even though there is clearly a string that matches the regular expression in the script, unless I am missing something.

Please help.

[numberwhun]

Well, if I am reading this code right, then your code is doing exactly what you have told it to do. On line 16 you do an if test on "length $line". I assume this is returning true and going into that part of the if. The regex's and the $count variable are all inside of the "else" part of the if statement. The if test would have to fail for your code to work.

I think you need to re-work this code. (assuming I have read it correctly).

Also, please use code tags around your code. I have added them here for you. Simply edit your original post to see how to use them.

Regards,

Jeff

[joeferns79]

Thanks for the quick response, Jeff.

I removed that part from the code, as can be seen below...

use strict;
 
 
####################################################################
# genreport
####################################################################
  sub genreport {
   my ($logfile, $reportfile) = @_;
   my ($line, @message, @summary, $count, $match, $n);
 
   open(LOGFILE, "<$logfile")
      or die "Can't open $logfile: $!";
 
   open (REPORTFILE, ">$reportfile")
      or die "Can't open $reportfile: $!";
 
   $count = $match = 0;
   while ($line = <LOGFILE>) {
      chomp $line;
          if ($message[0] =~ /^\[ERROR](.*)\administrator.$/) {
            #foreach $n (0..$#message) {
        #  if ($message[$n] =~ /^infrastructure:ID_UNHANDLED:.*/) {
             $match = 1;
        #   }
           if (($message[$n] =~ /^nested exception is:.*/) && ($match == 1)) {
          push @summary, $message[$n + 1];
           }           
       # }
        if ($match == 1) {
             foreach $line (@message) {
                  printf REPORTFILE "%s\n", $line;
           }
               printf REPORTFILE "\n";
               $count++;
           $match = 0;
            }
         } 
    #else {
    #        die "parse error: missing date";
    #     }
         @message = ();
 
   }
 
   if ($count > 0) {
      printf "There were %s un-handled server exceptions:\n\n", $count;
      foreach $line (@summary) {
         printf "   ***> %s\n", $line
      }
      printf "\n";
   } else {
      printf "There were no un-handled server exceptions for this reporting period.\n\n";
   }
}

I am still getting the same message though ...

C:\PerlScripts> UAESummary.bat CuramApp.log Report.log
There were no un-handled server exceptions for this reporting period.


I am just wondering if the reg exp is right since the code doesn't seem to be adding to the count and is printing the stmt ..

"There were no un-handled server exceptions for this reporting period.\n\n"

[eWish]

Is that a copy of that actual data you are using that you listed in the first post?

--Kevin

[joeferns79]

Yes it is. I made it work actually, but now I wanted to extract the part from the stack that says "nested exception" and was having trouble with that.

The code is as below ...

 while ($line = <LOGFILE>) {
      chomp $line;
  if (length $line) {
         push @message, $line;
          if ($message[0] =~ /^\[ERROR](.*)\infrastructure:ID_UNHANDLED:.*$/) {
            foreach $n (0..$#message) {
        #  if ($message[$n] =~ /^infrastructure:ID_UNHANDLED:.*/) {
             $match = 1;
        #   }
           if (($message[$n] =~ /^nested exception is:(.*)/) && ($match == 1)) {
          push @summary, $message[$n + 1];
           }           
        }
        if ($match == 1) {
             foreach $line (@message) {
                  printf REPORTFILE "%s\n", $line;
           }
               printf REPORTFILE "\n";
               $count++;
           $match = 0;
            }
         } 

The report I get is as below ...

[ERROR] [09 Sep 2008 12:36:56] [Trace] [WebContainer : 78] - infrastructure: ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.

[ERROR] [09 Sep 2008 12:55:23] [Trace] [WebContainer : 83] - infrastructure: ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.

[ERROR] [09 Sep 2008 12:55:36] [Trace] [WebContainer : 80] - infrastructure: ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.

[ERROR] [09 Sep 2008 12:57:54] [Trace] [WebContainer : 77] - infrastructure: ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.


This is part of the input log(in addition to the 1st line that's captured above, I want the part below the "nested exception is:" string to be displayed too ...

[ERROR] [10 Sep 2008 10:13:17] [Trace] [WebContainer : 144] - infrastructure: ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.
at curam.util.inte rnal.HandleExce ption.getRemote Exception(Handl eException.java (Compiled Code))
at curam.util.inte rnal.HandleExce ption.getRemote Exception(Handl eException.java (Compiled Code))
at curam.util.inte rnal.CuramSessi onBean.o00000(C uramSessionBean .java(Compiled Code))
at curam.util.inte rnal.CuramSessi onBean.invoke(C uramSessionBean .java(Compiled Code))
at curam.util.inte rnal.CuramSessi onBean.invoke(C uramSessionBean .java(Inlined Compiled Code))
at curam.util.invo ke.EJSRemoteSta telessEJBMethod _51fe6ae7.invok e(EJSRemoteStat elessEJBMethod_ 51fe6ae7.java(C ompiled Code))
at sun.reflect.Gen eratedMethodAcc essor120.invoke (Unknown Source)
at sun.reflect.Del egatingMethodAc cessorImpl.invo ke(DelegatingMe thodAccessorImp l.java(Compiled Code))
at java.lang.refle ct.Method.invok e(Method.java(C ompiled Code))
at com.ibm.rmi.uti l.ProxyUtil$2.r un(ProxyUtil.ja va(Compiled Code))
nested exception is:
infrastructure: RUN_ID_RECORD_N OT_FOUND: Record not found.
at curam.util.data access.Database Call.o00000(Dat abaseCall.java( Compiled Code))
at curam.util.data access.Database Call.o00000(Dat abaseCall.java( Compiled Code))
at curam.util.data access.Database Call.execute(Da tabaseCall.java (Compiled Code))
at curam.fem.entit y.base.EMCheckl ist.read(EMChec klist.java(Comp iled Code))
at curam.fem.facad e.impl.EMCheckl ist.doNothing(E MChecklist.java (Compiled Code))
at sun.reflect.Gen eratedMethodAcc essor874.invoke (Unknown Source)
at sun.reflect.Del egatingMethodAc cessorImpl.invo ke(DelegatingMe thodAccessorImp l.java(Compiled Code))
at java.lang.refle ct.Method.invok e(Method.java(C ompiled Code))
at curam.util.inte rnal.CuramSessi onBean.invoke(C uramSessionBean .java(Compiled Code))
at curam.util.inte rnal.CuramSessi onBean.invoke(C uramSessionBean .java(Inlined Compiled Code))
at curam.util.invo ke.EJSRemoteSta telessEJBMethod _51fe6ae7.invok e(EJSRemoteStat elessEJBMethod_ 51fe6ae7.java(C ompiled Code))
at sun.reflect.Gen eratedMethodAcc essor120.invoke (Unknown Source)
at sun.reflect.Del egatingMethodAc cessorImpl.invo ke(DelegatingMe thodAccessorImp l.java(Compiled Code))
at java.lang.refle ct.Method.invok e(Method.java(C ompiled Code))

[KevinADC]

I am really not clear on what you are trying to parse out of the log file, but see if this helps:

while ($line = <DATA>) {
   if ($line =~ /^\[ERROR\](.*?)infrastructure:ID_UNHANDLED:.*$/) {
      push @message, $line;
      $match = 1;
      next;
   }
   if ($match && ($line =~ /^nested exception is:/)) {
       $line = <DATA>;
       push @message, $line;
       $match = 0;
       next;
   }
}
for (@message) {
   print;
}
__DATA__
[ERROR] [09 Sep 2008 13:58:59] [Trace] [WebContainer : 88] - infrastructure:ID_UNHANDLED: An un-handled server exception occurred. Please contact your administrator.
nested exception is:
infrastructure:RUN_ID_RUNTIME: A runtime exception occurred: javax.transaction.RollbackException.
at curam.util.transaction.ResourcesJTA.Ô00000(Resourc esJTA.java(Compiled Code))
at curam.util.transaction.TransactionInfo.commit(Tran sactionInfo.java(Compiled Code))
at curam.util.internal.CuramSessionBean.invoke(CuramS essionBean.java(Compiled Code))
at curam.util.internal.CuramSessionBean.invoke(CuramS essionBean.java(Inlined Compiled Code))
at curam.util.invoke.EJSRemoteStatelessEJBMethod_51fe 6ae7.invoke(EJSRemoteStatelessEJBMethod_51fe6ae7.j ava(Compiled Code))
at sun.reflect.GeneratedMethodAccessor120.invoke(Unkn own Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(De legatingMethodAccessorImpl.java(Compiled Code))
at java.lang.reflect.Method.invoke(Method.java(Compil ed Code))
at com.ibm.rmi.util.ProxyUtil$2.run(ProxyUtil.java(Co mpiled Code))
at java.security.AccessController.doPrivileged1(Nativ e Method)
at java.security.AccessController.doPrivileged(Access Controller.java(Compiled Code))
at com.ibm.rmi.util.ProxyUtil.invokeWithPrivilege(Pro xyUtil.java(Compiled Code))
at com.ibm.CORBA.iiop.ClientDelegate.invoke(ClientDel egate.java(Compiled Code))
 

[joeferns79]

Thanks, this helped.