By using this site, you agree to our updated Privacy Policy and our Terms of Use. Manage your Cookies Settings.
438,664 Members | 1,669 Online
Bytes IT Community
+ Ask a Question
Need help? Post your question and get tips & solutions from a community of 438,664 IT Pros & Developers. It's quick & easy.

Reading remote files

P: n/a
I'm attempting to read a remote file and parse it for data. The problem I'm
having is that the file seems to be generated by Perl
(http://alert.dot.pima.gov/scripts/1brpssd.pl) and when I read it the
script-generated data is not displayed. When I view the page with a browser
the data is displayed just fine. I've tried using the built-in PHP commands
to read the file (file, fget) as well as the all of the Snoopy "fetch"
classes (http://snoopy.sourceforge.net). Any ideas?

Thanks.

M
Jul 16 '05 #1
Share this Question
Share on Google+
7 Replies


P: n/a
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<_C******************@newsread1.prod.itd.eart hlink.net>...

I'm attempting to read a remote file and parse it for data. The problem
I'm having is that the file seems to be generated by Perl
(http://alert.dot.pima.gov/scripts/1brpssd.pl) and when I read it the
script-generated data is not displayed. When I view the page with a browser
the data is displayed just fine. I've tried using the built-in PHP commands
to read the file (file, fget) as well as the all of the Snoopy "fetch"
classes (http://snoopy.sourceforge.net). Any ideas?


Try this:

$host = 'alert.dot.pima.gov';
$path = '/scripts/1brpssd.pl';
$fp = fsockopen ($host, '80');
if ($fp) {
fputs ($fp, 'GET '.$path." HTTP/1.0\r\nHost: ".$host."\r\n\r\n");
while (!feof($fp)) {
echo fgets ($fp, 10240);
}
} else {
echo "Oops... Didn't work... ";
}

Cheers,
NC
Jul 16 '05 #2

P: n/a
Is there anyway to get the script to not display the header/get information?
ie: HTTP/1.1 200 OK Date: Tue, 12 Aug 2003 03:31:17 GMT Server:
Apache/2.0.40 (Red Hat Linux) Accept-Ranges: bytes X-Powered-By: PHP/4.2.2
Content-Length: 111 Connection: close Content-Type: text/html;
charset=ISO-8859-1

And just display the content of the page?
Your script works perfect for my application, I would just like to figure
out how to remove the http information.

Thanks-

"Nikolai Chuvakhin" <nc@iname.com> wrote in message
news:32**************************@posting.google.c om...
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<_C******************@newsread1.prod.itd.eart hlink.net>...

I'm attempting to read a remote file and parse it for data. The problem
I'm having is that the file seems to be generated by Perl
(http://alert.dot.pima.gov/scripts/1brpssd.pl) and when I read it the
script-generated data is not displayed. When I view the page with a browser the data is displayed just fine. I've tried using the built-in PHP commands to read the file (file, fget) as well as the all of the Snoopy "fetch"
classes (http://snoopy.sourceforge.net). Any ideas?


Try this:

$host = 'alert.dot.pima.gov';
$path = '/scripts/1brpssd.pl';
$fp = fsockopen ($host, '80');
if ($fp) {
fputs ($fp, 'GET '.$path." HTTP/1.0\r\nHost: ".$host."\r\n\r\n");
while (!feof($fp)) {
echo fgets ($fp, 10240);
}
} else {
echo "Oops... Didn't work... ";
}

Cheers,
NC

Jul 16 '05 #3

P: n/a
Thanks for the script. I've tried it and it works great with other web
pages, but still doesn't seem to work with the particular page that I need.
When I run the script this is the output that I get. I need the missing data
within the <textarea> tags:

HTTP/1.1 200 OK Server: Microsoft-IIS/5.0 Date: Tue, 12 Aug 2003 04:24:15
GMT Content-Type: text/html <html> <head> <title>Map 1 Upper Cañada del Oro
sensors</title> </head> <body> <body background=/DWGraphics/DWBG.jpg> <div
align=Center><font size=+2
color=#551a8b><big><big><big><big><big><big><big>< big><big><big><big><big><b
ig><big><big> Map 1 Upper Cañada del Oro
Sensors</big></big></big></big></big></big></big></big></big></big></big></b
ig></big></big></big></font><br> </div> &nbsp &nbsp <div align=Center><font
size=5 color=#551a8b> Hourly Rainfall for 0 Periods For Sensors In Map 1
Upper Cañada del Oro </font><br> </dev> <td> <FORM METHOD=POST> <TEXTAREA
NAME=Data ROWS=25 COLS=100 WRAP=OFF READONLY> </TEXTAREA> </FORM> </body>
<center> <a href=Pima.pl><b><font size=4>Main Map</font></b></a> &nbsp &nbsp
&nbsp <a href=2brpssd.pl><b><font size=4>Map 2</font></b></a> &nbsp &nbsp
&nbsp <a href=3brpssd.pl><b><font size=4>Map 3</font></b></a> &nbsp &nbsp
&nbsp <a href=4brpssd.pl><b><font size=4>Map 4</font></b></a> &nbsp &nbsp
&nbsp <a href=5brpssd.pl><b><font size=4>Map 5</font></b></a> </center>
</html>

Thanks.

M

"Nikolai Chuvakhin" <nc@iname.com> wrote in message
news:32**************************@posting.google.c om...
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<_C******************@newsread1.prod.itd.eart hlink.net>...

I'm attempting to read a remote file and parse it for data. The problem
I'm having is that the file seems to be generated by Perl
(http://alert.dot.pima.gov/scripts/1brpssd.pl) and when I read it the
script-generated data is not displayed. When I view the page with a browser the data is displayed just fine. I've tried using the built-in PHP commands to read the file (file, fget) as well as the all of the Snoopy "fetch"
classes (http://snoopy.sourceforge.net). Any ideas?


Try this:

$host = 'alert.dot.pima.gov';
$path = '/scripts/1brpssd.pl';
$fp = fsockopen ($host, '80');
if ($fp) {
fputs ($fp, 'GET '.$path." HTTP/1.0\r\nHost: ".$host."\r\n\r\n");
while (!feof($fp)) {
echo fgets ($fp, 10240);
}
} else {
echo "Oops... Didn't work... ";
}

Cheers,
NC

Jul 16 '05 #4

P: n/a
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<C%******************@newsread1.prod.itd.eart hlink.net>...

Thanks for the script. I've tried it and it works great with other web
pages, but still doesn't seem to work with the particular page that I need.
When I run the script this is the output that I get. I need the missing data
within the <textarea> tags:


I just opened the URL you are trying to retrieve in browser and reloaded
it several times. There is no data in <textarea>...

Cheers,
NC
Jul 16 '05 #5

P: n/a
You're right. When you go directly to the page there is no data, but if you
go in through the main page and navigate to it the data is there. Is there a
way to check the headers to see if it's passing session variables? Or is it
another issue?

Thanks.

M

"Nikolai Chuvakhin" <nc@iname.com> wrote in message
news:32*************************@posting.google.co m...
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<C%******************@newsread1.prod.itd.eart hlink.net>...

Thanks for the script. I've tried it and it works great with other web
pages, but still doesn't seem to work with the particular page that I need. When I run the script this is the output that I get. I need the missing data within the <textarea> tags:


I just opened the URL you are trying to retrieve in browser and reloaded
it several times. There is no data in <textarea>...

Cheers,
NC

Jul 16 '05 #6

P: n/a
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<%I******************@newsread1.prod.itd.eart hlink.net>...
When I run the script this is the output that I get. I need
the missing data within the <textarea> tags:


I just opened the URL you are trying to retrieve in browser and reloaded
it several times. There is no data in <textarea>...


You're right. When you go directly to the page there is no data, but if you
go in through the main page and navigate to it the data is there. Is there a
way to check the headers to see if it's passing session variables? Or is it
another issue?


Most likely (just by the looks of it), the Perl scripts set cookies.
You can deal with this system using cURL, but you will have to program
cURL to more or less precisely imitate the sequence of page loads you
accomplish with your browser.

Cheers,
NC
Jul 16 '05 #7

P: n/a
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<jx******************@newsread1.prod.itd.eart hlink.net>...

I've figured it out. The HTML headers need to read as follows:

GET /scripts/1brpssd.pl HTTP/1.1 Host: alert.dot.pima.gov
Cookie: pimafile=-Inetpub-Scripts-DWTemp-config1060728166.txt

It looks to me like they're using a cookie to activate a script
of some kind.


I don't think so. Rather, the cookie contains a reference to a data
file, which the script retrieves and displays.

Cheers,
NC
Jul 16 '05 #8

This discussion thread is closed

Replies have been disabled for this discussion.