473,322 Members | 1,287 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,322 software developers and data experts.

Reading remote files

I'm attempting to read a remote file and parse it for data. The problem I'm
having is that the file seems to be generated by Perl
(http://alert.dot.pima.gov/scripts/1brpssd.pl) and when I read it the
script-generated data is not displayed. When I view the page with a browser
the data is displayed just fine. I've tried using the built-in PHP commands
to read the file (file, fget) as well as the all of the Snoopy "fetch"
classes (http://snoopy.sourceforge.net). Any ideas?

Thanks.

M
Jul 16 '05 #1
7 8416
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<_C******************@newsread1.prod.itd.eart hlink.net>...

I'm attempting to read a remote file and parse it for data. The problem
I'm having is that the file seems to be generated by Perl
(http://alert.dot.pima.gov/scripts/1brpssd.pl) and when I read it the
script-generated data is not displayed. When I view the page with a browser
the data is displayed just fine. I've tried using the built-in PHP commands
to read the file (file, fget) as well as the all of the Snoopy "fetch"
classes (http://snoopy.sourceforge.net). Any ideas?


Try this:

$host = 'alert.dot.pima.gov';
$path = '/scripts/1brpssd.pl';
$fp = fsockopen ($host, '80');
if ($fp) {
fputs ($fp, 'GET '.$path." HTTP/1.0\r\nHost: ".$host."\r\n\r\n");
while (!feof($fp)) {
echo fgets ($fp, 10240);
}
} else {
echo "Oops... Didn't work... ";
}

Cheers,
NC
Jul 16 '05 #2
Is there anyway to get the script to not display the header/get information?
ie: HTTP/1.1 200 OK Date: Tue, 12 Aug 2003 03:31:17 GMT Server:
Apache/2.0.40 (Red Hat Linux) Accept-Ranges: bytes X-Powered-By: PHP/4.2.2
Content-Length: 111 Connection: close Content-Type: text/html;
charset=ISO-8859-1

And just display the content of the page?
Your script works perfect for my application, I would just like to figure
out how to remove the http information.

Thanks-

"Nikolai Chuvakhin" <nc@iname.com> wrote in message
news:32**************************@posting.google.c om...
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<_C******************@newsread1.prod.itd.eart hlink.net>...

I'm attempting to read a remote file and parse it for data. The problem
I'm having is that the file seems to be generated by Perl
(http://alert.dot.pima.gov/scripts/1brpssd.pl) and when I read it the
script-generated data is not displayed. When I view the page with a browser the data is displayed just fine. I've tried using the built-in PHP commands to read the file (file, fget) as well as the all of the Snoopy "fetch"
classes (http://snoopy.sourceforge.net). Any ideas?


Try this:

$host = 'alert.dot.pima.gov';
$path = '/scripts/1brpssd.pl';
$fp = fsockopen ($host, '80');
if ($fp) {
fputs ($fp, 'GET '.$path." HTTP/1.0\r\nHost: ".$host."\r\n\r\n");
while (!feof($fp)) {
echo fgets ($fp, 10240);
}
} else {
echo "Oops... Didn't work... ";
}

Cheers,
NC

Jul 16 '05 #3
Thanks for the script. I've tried it and it works great with other web
pages, but still doesn't seem to work with the particular page that I need.
When I run the script this is the output that I get. I need the missing data
within the <textarea> tags:

HTTP/1.1 200 OK Server: Microsoft-IIS/5.0 Date: Tue, 12 Aug 2003 04:24:15
GMT Content-Type: text/html <html> <head> <title>Map 1 Upper Cañada del Oro
sensors</title> </head> <body> <body background=/DWGraphics/DWBG.jpg> <div
align=Center><font size=+2
color=#551a8b><big><big><big><big><big><big><big>< big><big><big><big><big><b
ig><big><big> Map 1 Upper Cañada del Oro
Sensors</big></big></big></big></big></big></big></big></big></big></big></b
ig></big></big></big></font><br> </div> &nbsp &nbsp <div align=Center><font
size=5 color=#551a8b> Hourly Rainfall for 0 Periods For Sensors In Map 1
Upper Cañada del Oro </font><br> </dev> <td> <FORM METHOD=POST> <TEXTAREA
NAME=Data ROWS=25 COLS=100 WRAP=OFF READONLY> </TEXTAREA> </FORM> </body>
<center> <a href=Pima.pl><b><font size=4>Main Map</font></b></a> &nbsp &nbsp
&nbsp <a href=2brpssd.pl><b><font size=4>Map 2</font></b></a> &nbsp &nbsp
&nbsp <a href=3brpssd.pl><b><font size=4>Map 3</font></b></a> &nbsp &nbsp
&nbsp <a href=4brpssd.pl><b><font size=4>Map 4</font></b></a> &nbsp &nbsp
&nbsp <a href=5brpssd.pl><b><font size=4>Map 5</font></b></a> </center>
</html>

Thanks.

M

"Nikolai Chuvakhin" <nc@iname.com> wrote in message
news:32**************************@posting.google.c om...
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<_C******************@newsread1.prod.itd.eart hlink.net>...

I'm attempting to read a remote file and parse it for data. The problem
I'm having is that the file seems to be generated by Perl
(http://alert.dot.pima.gov/scripts/1brpssd.pl) and when I read it the
script-generated data is not displayed. When I view the page with a browser the data is displayed just fine. I've tried using the built-in PHP commands to read the file (file, fget) as well as the all of the Snoopy "fetch"
classes (http://snoopy.sourceforge.net). Any ideas?


Try this:

$host = 'alert.dot.pima.gov';
$path = '/scripts/1brpssd.pl';
$fp = fsockopen ($host, '80');
if ($fp) {
fputs ($fp, 'GET '.$path." HTTP/1.0\r\nHost: ".$host."\r\n\r\n");
while (!feof($fp)) {
echo fgets ($fp, 10240);
}
} else {
echo "Oops... Didn't work... ";
}

Cheers,
NC

Jul 16 '05 #4
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<C%******************@newsread1.prod.itd.eart hlink.net>...

Thanks for the script. I've tried it and it works great with other web
pages, but still doesn't seem to work with the particular page that I need.
When I run the script this is the output that I get. I need the missing data
within the <textarea> tags:


I just opened the URL you are trying to retrieve in browser and reloaded
it several times. There is no data in <textarea>...

Cheers,
NC
Jul 16 '05 #5
You're right. When you go directly to the page there is no data, but if you
go in through the main page and navigate to it the data is there. Is there a
way to check the headers to see if it's passing session variables? Or is it
another issue?

Thanks.

M

"Nikolai Chuvakhin" <nc@iname.com> wrote in message
news:32*************************@posting.google.co m...
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<C%******************@newsread1.prod.itd.eart hlink.net>...

Thanks for the script. I've tried it and it works great with other web
pages, but still doesn't seem to work with the particular page that I need. When I run the script this is the output that I get. I need the missing data within the <textarea> tags:


I just opened the URL you are trying to retrieve in browser and reloaded
it several times. There is no data in <textarea>...

Cheers,
NC

Jul 16 '05 #6
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<%I******************@newsread1.prod.itd.eart hlink.net>...
When I run the script this is the output that I get. I need
the missing data within the <textarea> tags:


I just opened the URL you are trying to retrieve in browser and reloaded
it several times. There is no data in <textarea>...


You're right. When you go directly to the page there is no data, but if you
go in through the main page and navigate to it the data is there. Is there a
way to check the headers to see if it's passing session variables? Or is it
another issue?


Most likely (just by the looks of it), the Perl scripts set cookies.
You can deal with this system using cURL, but you will have to program
cURL to more or less precisely imitate the sequence of page loads you
accomplish with your browser.

Cheers,
NC
Jul 16 '05 #7
"Matt Daleo" <az*****@yahoo.com> wrote in message
news:<jx******************@newsread1.prod.itd.eart hlink.net>...

I've figured it out. The HTML headers need to read as follows:

GET /scripts/1brpssd.pl HTTP/1.1 Host: alert.dot.pima.gov
Cookie: pimafile=-Inetpub-Scripts-DWTemp-config1060728166.txt

It looks to me like they're using a cookie to activate a script
of some kind.


I don't think so. Rather, the cookie contains a reference to a data
file, which the script retrieves and displays.

Cheers,
NC
Jul 16 '05 #8

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

3
by: Nick Bunton | last post by:
I have setup remote debugging on an NT4 workstation for testing. I then build from the debug config on my machine and copy all the files from the /bin/debug folder including the .PDB files. I then...
4
by: JoelWhitehouse | last post by:
Hi! I want to write a script that will read a .php file on a remote server and print to the current page a portion of the text contained in the remote file. I am just wondering what the best...
0
by: bettervssremoting | last post by:
To view the full article, please visit http://www.BetterVssRemoting.com Better VSS Remote Access Tool including SourceOffSite, SourceAnyWhere and VSS Remoting This article makes a detailed...
4
by: Michael C | last post by:
Hi all, I'm trying to get a full directory listing from a remote machine. Anyone know how? Also, is it possible to read a file from a remote machine, like a ..TXT file or a .XML file in a...
2
by: Adrian | last post by:
Hi I have some local pages (on PC harddisk) that act as a user interface and a set of JS files that controls it all. I now want to be able to access a remote web server to read a txt file and use...
7
by: John Pote | last post by:
Hello, help/advice appreciated. Background: I am writing some web scripts in python to receive small amounts of data from remote sensors and store the data in a file. 50 to 100 bytes every 5 or...
4
by: John Pote | last post by:
Hello, help/advice appreciated. Background: I am writing some web scripts in python to receive small amounts of data from remote sensors and store the data in a file. 50 to 100 bytes every 5 or...
29
by: Jerim79 | last post by:
I did try to find the answer to this before posting, so this isn't a knee jerk reaction. What I am trying to accomplish is to have a script that opens a cookie, reads a value, and then use a...
1
by: barneymc | last post by:
Im wondering if anyone has come across a way of reading EventLogs using WMI. The event logs files are restored from another server. Below is the C# class that executes the query. NOTE : The...
4
by: Prof. William Battersea | last post by:
Hello, Suppose I have a Vista machine called VISTA and an XP machine called XP in a workgroup named WORKGROUP. Physically they're connected to a router and I can see lists of public and shared...
0
by: ryjfgjl | last post by:
ExcelToDatabase: batch import excel into database automatically...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
1
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: Vimpel783 | last post by:
Hello! Guys, I found this code on the Internet, but I need to modify it a little. It works well, the problem is this: Data is sent from only one cell, in this case B5, but it is necessary that data...
1
by: PapaRatzi | last post by:
Hello, I am teaching myself MS Access forms design and Visual Basic. I've created a table to capture a list of Top 30 singles and forms to capture new entries. The final step is a form (unbound)...
1
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
1
by: Shællîpôpï 09 | last post by:
If u are using a keypad phone, how do u turn on JavaScript, to access features like WhatsApp, Facebook, Instagram....
0
by: af34tf | last post by:
Hi Guys, I have a domain whose name is BytesLimited.com, and I want to sell it. Does anyone know about platforms that allow me to list my domain in auction for free. Thank you
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 3 Apr 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome former...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.