Connecting Tech Pros Worldwide Forums | Help | Site Map

Perl script to create a separte log file that includes required info.

Newbie
 
Join Date: Sep 2008
Posts: 5
#1: Sep 26 '08
I want to create a separate log that includes an I (logIN) , userid, and date/timestamp from a detailed log. This type of data compresses very well so I can store years of it. I need script to create an separate log files that can saved on each server. Since I dont know much about perl scripting. Your help will be appreciated.

Thanx

Val

numberwhun's Avatar
Site Moderator
 
Join Date: May 2007
Location: New Hampshire
Posts: 2,571
#2: Sep 26 '08

re: Perl script to create a separte log file that includes required info.


And what have you tried to do this? Why not try to do it if you haven't and post your code here if you get stuck.

Regards,

Jeff
Newbie
 
Join Date: Sep 2008
Posts: 5
#3: Oct 3 '08

re: Perl script to create a separte log file that includes required info.


Quote:

Originally Posted by numberwhun

And what have you tried to do this? Why not try to do it if you haven't and post your code here if you get stuck.

Regards,

Jeff


I tried by using chomp and split function..but I am not able to do.
following is my code...
Expand|Select|Wrap|Line Numbers
  1. #!/usr/bin/perl -w
  2. $open_FILE="filename";
  3. $output_file="newfile";
  4. open (FH, "<$open_FILE");
  5. @content=<FH>;
  6. close(FH);
  7. open(FD, "> $output_file");
  8. @params=$_;
  9. foreach $line (@content)
  10. {
  11. chomp ($line);
  12. $params = split(/ /, $line); 
  13.  
  14. }
  15.  
i am totally new to perl script..

I m not getting any output from my code...please do help me ..its urgent.
KevinADC's Avatar
Expert
 
Join Date: Jan 2007
Location: Southern California USA
Posts: 4,091
#4: Oct 3 '08

re: Perl script to create a separte log file that includes required info.


Expand|Select|Wrap|Line Numbers
  1. foreach $line (@content)
  2. {
  3. chomp ($line);
  4. @params = split(/ /, $line);
  5. print FD "@params\n";
  6. }
  7.  
See if that helps at least get some data into the file. You can worry about formatting after you get this working.

Use code tags otherwise Jeff is going to give you a well deserved tongue lashing ;)
eWish's Avatar
Moderator
 
Join Date: Jul 2007
Location: Arkansas
Posts: 900
#5: Oct 3 '08

re: Perl script to create a separte log file that includes required info.


@Vallabh, Please do use the tags when posting code samples. Thanks.

Quote:

Originally Posted by KevinADC

Use code tags otherwise Jeff is going to give you a well deserved tongue lashing ;)

Jeff must need more fiber in his diet either that or he is trying to get to 2000 posts. :) I better run quick before he sees me here.


--Kevin
Newbie
 
Join Date: Oct 2008
Location: Cochin
Posts: 4
#6: Oct 6 '08

re: Perl script to create a separte log file that includes required info.


Post the sample of logs/data that is there in "filename".
Here you are merely splitting the files on a space.
Newbie
 
Join Date: Sep 2008
Posts: 5
#7: Oct 6 '08

re: Perl script to create a separte log file that includes required info.


Quote:

Originally Posted by maestria

Post the sample of logs/data that is there in "filename".
Here you are merely splitting the files on a space.



Hello friends,

I first of all i did grep in unix and append the to a new file <newlog.log>. Then in perl i created a code..as follow

Expand|Select|Wrap|Line Numbers
  1. $LOGFILE = "/opt/app/siteminder/log/newlog1.log";
  2. open(LOGFILE) or die("Could not open log file.");
  3. foreach $line (<LOGFILE>) {
  4.     $w = "(.+?)";
  5.     $line =~ m/^$w $w \[$w:$w $w\] " $w"/;
  6.  
  7.     $Event     = $1;
  8.     $servername  = $2;
  9.     $date = $3;
  10.     $time     = $4;
  11.     $gmt     = $5;
  12.     $uid      = $6;
  13. print ("\t","\n","\t", $Event, $date, $time, $uid);
  14.  
  15.     # do line-by-line processing.
  16. }
  17. close(LOGFILE);
and also I am getting O/p

but problem is that I did grep and created new file manually... now I want to do through perl....since we have 8 servers and also there many log previously created on each server. so please help me further.......
KevinADC's Avatar
Expert
 
Join Date: Jan 2007
Location: Southern California USA
Posts: 4,091
#8: Oct 6 '08

re: Perl script to create a separte log file that includes required info.


Quote:

Originally Posted by Vallabh

Hello friends,

I first of all i did grep in unix and append the to a new file <newlog.log>. Then in perl i created a code..as follow


$LOGFILE = "/opt/app/siteminder/log/newlog1.log";
open(LOGFILE) or die("Could not open log file.");
foreach $line (<LOGFILE>) {
$w = "(.+?)";
$line =~ m/^$w $w \[$w:$w $w\] " $w"/;

$Event = $1;
$servername = $2;
$date = $3;
$time = $4;
$gmt = $5;
$uid = $6;
print ("\t","\n","\t", $Event, $date, $time, $uid);

# do line-by-line processing.
}
close(LOGFILE);

and also I am getting O/p

but problem is that I did grep and created new file manually... now I want to do through perl....since we have 8 servers and also there many log previously created on each server. so please help me further.......

Help you with what? You have not asked a question anyone can help you with. Why didn't you post a sample of the file like you were asked to?
Newbie
 
Join Date: Sep 2008
Posts: 5
#9: Oct 7 '08

re: Perl script to create a separte log file that includes required info.


Quote:

Originally Posted by KevinADC

Help you with what? You have not asked a question anyone can help you with. Why didn't you post a sample of the file like you were asked to?

I want my log file to be look like this.

Event timestamp UserID
I 27/Aug/200823:06:23 uid=PTL1002

I if auth is accepted
Oif rejected.


I m getting the output but I did grep function manually in UNIX. I want to do grep function is perl so that all process can be automatic
numberwhun's Avatar
Site Moderator
 
Join Date: May 2007
Location: New Hampshire
Posts: 2,571
#10: Oct 7 '08

re: Perl script to create a separte log file that includes required info.


Quote:

Originally Posted by Vallabh

I want my log file to be look like this.

Event timestamp UserID
I 27/Aug/200823:06:23 uid=PTL1002

I if auth is accepted
Oif rejected.


I m getting the output but I did grep function manually in UNIX. I want to do grep function is perl so that all process can be automatic

Ok, then you can either initiate the same grep function using either backtics or the system() function, or, see if Perl's grep function will work for you.

Regards,

Jeff
KevinADC's Avatar
Expert
 
Join Date: Jan 2007
Location: Southern California USA
Posts: 4,091
#11: Oct 7 '08

re: Perl script to create a separte log file that includes required info.


Quote:

Originally Posted by Vallabh

I want my log file to be look like this.

Event timestamp UserID
I 27/Aug/200823:06:23 uid=PTL1002

I if auth is accepted
Oif rejected.


I m getting the output but I did grep function manually in UNIX. I want to do grep function is perl so that all process can be automatic

What does the input file look like?

Maybe English is not your first language, but your English grammar and spellling is not good and is making it difficult to understand you. Try to use good spelling and grammar as much as you can.
Newbie
 
Join Date: Sep 2008
Posts: 5
#12: Oct 8 '08

re: Perl script to create a separte log file that includes required info.


Quote:

Originally Posted by KevinADC

What does the input file look like?

Maybe English is not your first language, but your English grammar and spellling is not good and is making it difficult to understand you. Try to use good spelling and grammar as much as you can.

thanx for help kevin....but I dont know why you are not getting my point.....anyways Input looks like this
AuthAccept bos54637 [01/Oct/2008:22:46:15 -0500] "90.168.25.34 cn=region2,ou=Accounts,o=wireless.com" "leasereplacement GET /XNGALL
" [idletime=3600;maxtime=7200;authlevel=5;] [0] [] []

If you need more tell me...
KevinADC's Avatar
Expert
 
Join Date: Jan 2007
Location: Southern California USA
Posts: 4,091
#13: Oct 8 '08

re: Perl script to create a separte log file that includes required info.


Quote:

Originally Posted by Vallabh

thanx for help kevin....but I dont know why you are not getting my point.....anyways Input looks like this
AuthAccept bos54637 [01/Oct/2008:22:46:15 -0500] "90.168.25.34 cn=region2,ou=Accounts,o=wireless.com" "leasereplacement GET /XNGALL
" [idletime=3600;maxtime=7200;authlevel=5;] [0] [] []

If you need more tell me...

OK, now earlier you posted this:

Expand|Select|Wrap|Line Numbers
  1. $Event = $1;
  2. $servername = $2;
  3. $date = $3;
  4. $time = $4;
  5. $gmt = $5;
  6. $uid = $6;
  7.  
Now show me from the line you posted what each of those should be from the line you posted:

Expand|Select|Wrap|Line Numbers
  1. $Event = AuthAccept
  2. $servername = bos54637
  3. $date = 01/Oct/2008
  4. $time = 22:46:15
  5. $gmt = -0500
  6. $uid = ????
  7.  
Reply