Parsing a Log File

[drushof]

hello im new with perl
i must do parse log file from networker

with format look like this :

Start time: 2-16-07 11:27a
Recovering files of client 'blablabla' from server 'bliblibli'.
Recover: Total estimated disk space needed for recover is 3 MB.
Recovering 5 files within D:\X\Y\ into E:\restore
Requesting 5 file(s), this may take a while...
E:\restore\blabla\blablabla.bla
E:\restore\blabla\blablabla.bli
E:\restore\blabla\blablabla.blu
E:\restore\blabla\blablabla.ble
E:\restore\blabla\blablabla.blo
Received 5 file(s) from NSR server 'blablabla'
Recover completion time: Fri Feb 16 11:30:52 2007

and the data,i need:
start time,completion time,client name,server name,total file,and disk space

i have problem with regex,grep,split..is anyone can help me?
thx before =)

[KevinADC]

What have you tried so far?

[drushof]

What have you tried so far?

Start time: 2-16-07 11:27a
Recovering files of client 'blablabla' from server 'bliblibli'.
Recover: Total estimated disk space needed for recover is 3 MB.
Recovering 5 files within D:\X\Y\ into E:\restore
----> this is oke..


and then how can i go to the last line to get the completion date,
because every file has different amount of files to recover.(in this example 5 files)
i dont have idea to make the loop

[KevinADC]

Lets see the perl code you have written so far.

[drushof]

Lets see the perl code you have written so far.

o yea i forgot to tell that i just make the prosedur for each line, not a whole file..

[KevinADC]

Please post your code here in this thread.

[drushof]

i've done this :

use strict;
use warnings;

open (LOGFILE, "Restoremarble.log") || die "couldn't open the file!";
my @line = <LOGFILE>;

#line 1
my $list = $line[0];
my @list_t = split(/ /,$list);

my @grepNames = grep(/^\d/, @list_t);
my $el1 = $grepNames[0];
my $el2 = $grepNames[1];

my @list_date = split('-',$el1);
my @list_time = split(':',$el2);

print "-----------------\n";
print "day :$list_date[0]\n";
print "month :$list_date[1]\n";
print "year : $list_date[2]\n";
print "time : $list_time[0]-$list_time[1]\n";

#line 2
my $list2 = $line[1];
my @list_t2 = split(/ /,$list2);

my @grepNames2 = grep(//,@list_t2);
my $el1a = $grepNames2[4]; #client
my $el2a = $grepNames2[7]; #server


print "-----------------\n";
print "client : $el1a\n";
print "server : $el2a\n";

#line 3
my $list3 = $line[2];
my @list_t3 = split(/ /,$list3);

my @grepNames3 = grep(/^\d/,@list_t3);
print "--------------\n";
print "Total disk : $grepNames3[0]\n";

#2 last line
my $list4 = $line[-2];
my @list_t4 = split(/ /,$list4);

my @grepNames4 = grep(/^\d/,@list_t4);
print "-----------------\n";
print "Total files : $grepNames4[0]\n";

#last line
my $list5 = $line[-1];
my @list_t5 = split(/ /,$list5);

print "---------------------\n";
print "day : $list_t5[5]\n"; #day
print "month : $list_t5[4]\n"; #month
print "year : $list_t5[7]"; #year
print "time : $list_t5[6]\n"; #time

close(LOGFILE);
exit 0;

is it correct?

[KevinADC]

It's not the way I would do it and the results look incomplete based on the data you posted. When I run your script with the sample data this is the output:

-----------------
day :2
month :16
year : 07
time : 11-27a

-----------------
client : 'blablabla'
server : 'bliblibli'.

--------------
Total disk : 3
-----------------
Total files :
---------------------
day :
month :
year : time :

so while your code could be improved and does not return all the data you wanted, completion time and total file are missing, at least it runs. It uses "strict" and "warnings" (very good), and does produce most of the output you want. Is this school work or some sort of learning excersize?

[drushof]

so what i supossed to do?
this is school work =(

[drushof]

i've improved it :

use strict;
use warnings;

open (LOGFILE, "bla.log") || die "couldn't open the file!";
my @line = <LOGFILE>;

#line 1
my $list = $line[0];
my @list_t = split(/ /,$list);

my @grepNames = grep(/^\d/, @list_t);
my $el1 = $grepNames[0];
my $el2 = $grepNames[1];

my @list_date = split('-',$el1);
my @list_time = split(':',$el2);

print "-----------------\n";
print "day :$list_date[1]\n";
print "month :$list_date[0]\n";
print "year : $list_date[2]\n";
print "time : $list_time[0]-$list_time[1]\n";

#line 2
my $list2 = $line[1];
my @list_t2 = split(/ /,$list2);

my @grepNames2 = grep(//,@list_t2);
my $el1a = $grepNames2[4]; #client
my $el2a = $grepNames2[7]; #server


print "-----------------\n";
print "client : $el1a\n";
print "server : $el2a\n";

#line 3
my $list3 = $line[2];
my @list_t3 = split(/ /,$list3);

print "-------------------\n";
print "Total size : $list_t3[9] $list_t3[10]\n";

# my @grepNames3 = grep(/^\d/,@list_t3);
# print "--------------\n";
# print "Total disk : $grepNames3[1]\n";

#2 last line
my $list4 = $line[-2];
my @list_t4 = split(/ /,$list4);

my @grepNames4 = grep(/^\d/,@list_t4);
print "-----------------\n";
print "Total files : $grepNames4[0]\n";

#last line
my $list5 = $line[-1];
my @list_t5 = split(/ /,$list5);

print "---------------------\n";
print "day : $list_t5[5]\n"; #day
print "month : $list_t5[4]\n"; #month
print "year : $list_t5[7]"; #year
print "time : $list_t5[6]\n"; #time

close(LOGFILE);
exit 0;

content of bla.log is same with the first post

[KevinADC]

You need a way to skip the lines that don't interest you and find the ones that do. You can use a regexp to do that. Since this is school work I leave that up to you to figure out.

[drushof]

You need a way to skip the lines that don't interest you and find the ones that do. You can use a regexp to do that. Since this is school work I leave that up to you to figure out.

skip the line??
sorry i dont get it

yea im gonna figure it out..do i have the right step?

[KevinADC]

Your entire approach is really quite awkward but I have no idea how far along you are in your perl studies. If you have already covered regular expressions you should be using them to find the lines you want to parse data out of. But maybe the assignment dictates what functions you have to use to get the output.

As far as skipping goes, these lines do not seem to interest you:

E:\restore\blabla\blablabla.bla
E:\restore\blabla\blablabla.bli
E:\restore\blabla\blablabla.blu
E:\restore\blabla\blablabla.ble
E:\restore\blabla\blablabla.blo

so you would skip them (move on to the next line) until you find a line that does interest you.

[drushof]

im sorry..but im new in perl..
any advise for my code?
thx

[KevinADC]

any advise for my code?

Yes, use regular expressions to parse the data to get the results you want.

[drushof]

use regular expressions to parse the data to get the results you want.

mmh oke..but is my code wrong?
or regular expression make it easier?

[KevinADC]

mmh oke..but is my code wrong?
or regular expression make it easier?

There is no way for me to know if your code is wrong. That depends on how much perl you have learned already and how much you are expected to know at this point in your studies.

Technically, if the code runs and poduces the correct results, it's good code. It may not be efficient code, but it's good. Your code is close to producing the results you want.

Using regular expressions should make the job easier.

[drushof]

thx so much
another question,can you help me

Recovering 10 files within C:\ABC\DEF\ into F:\XYZ\PQR\

data i need C:\ABC\DEF\ and F:\XYZ\PQR\
how regular expression solve this thing?

[KevinADC]

OK you beat some code out of me, but since this is your school work don't expect anymore code. This is one possible way to match the pattern you are interested in:

$line = 'Recovering 5 files within D:\X\Y\ into E:\restore';
if ($line =~ /^Recovering \d+ files within (\S+) into (\S+)/ ) {
   print "$1 $2";
}

here are a couple of regexp tutorials:

# perlrequick - Perl regular expressions quick start
# perlretut - Perl regular expressions tutorial

you can find them here:

http://perldoc.perl.org/index-tutorials.html

[drushof]

thx so much..
im gonna try it =)

[drushof]

$line = 'Recovering 5 files within D:\X\Y\ into E:\restore';
if ($line =~ /^Recovering \d+ files within (\S+) into (\S+)/ ) {
   print "$1 $2";
}

sorry but in other case like 'Recovering 10 files within D:\X Y's\Z into E:\restore'
the code didnt work
what should i supposed to do to avoid the space and '

thx

[KevinADC]

You're going to have to read the tutorials I linked you to (or read whatever perl resource material you have). You will find the answers to your questions in those tutorials.