HTTP::Request for www.thescripts.com

[samthemist]

#/usr/bin/perl -w
use LWP::UserAgent;
use Time::HiRes qw(gettimeofday);
#use Crypt::SSLeay;
 
use strict;
 
print "Enter URL to Time GET request for...  ";
my $host=<STDIN>;
chomp $host;
 
my $before=gettimeofday;
my $ua = LWP::UserAgent->new(); 
my $request = HTTP::Request->new('GET', "$host");
my $response = $ua->request($request);
my $elapsed=gettimeofday-$before;
print "ERROR: Bad URL\n" if($response->is_error);
my @content=split/\n/,$response->content;
print "Request took $elapsed seconds.\n";
my @title=grep /(?:title|TITLE)/, @content;
print "TITLE LINE: @title \n";
 

I'm using this script to see how fast it can get different pages.
I put www.thescripts.com as my page,

www.thescripts.com
Enter URL to Time GET request for... ERROR: Bad URL
Request took 0.00800490379333496 seconds.

Why would it be a bad url?

[miller]

www.thescripts.com is not a fully qualified url. You must specify the protocol:

http://www.thescripts.com

- Miller

[samthemist]

Thanks for helping, but it still didn't work:

http://www.thescripts.com
Enter URL to Time GET request for... ERROR: Bad URL
Request took 0.00843501091003418 seconds.
>Exit code: 0

[miller]

Read this:

cpan lwptut

Namely the second section "The Basics of the LWP Class Model" will show you a better way to formatting you request. And much more importantly, it will show you how to get meaningful error messages.

- Miller

[KevinADC]

Well, you have told the script to print "Bad URL" regardless of what the real error is. The script works fine for me, but do have to shutdown my firewall first because I never figured out how to get a command line perl program to be allowed internet access while the firewall is turned on.

[samthemist]

I don't need to turn my firewall off for it to work.

However, it turns out it requested pages at roughly 1500-2000ms.

I'm still finding it hard to believe, that perl requests pages slower than VB6?!?!

[KevinADC]

perl is really good at processing text, anything else it is not going to be the fastest solution for doing something. I am not a VB6 coder so I have no way to know why it is faster than perl in this specific situation. Perl does have to be compiled, so that right there will add time to the over all speed of execution.

[samthemist]

I've made another thread - i think that's why. Go take a look!