473,396 Members | 1,877 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,396 software developers and data experts.

How to scrap content from a remote dynamic url

Hello,

I am looking at ways I can scrap the content of a remote url and make
that available as a javascrpt string to a program running under
another domain.

I am able to easily scap contents of local files. But unable to parse
a URL. Is it that Javascript do not support such code?

I am fairly new to JavaScript and is more familiar with server side
scripting/prohgramming languages.

I am trying to write an application that will read data which can be
made available as dynamically generates XML files of similar schemas.
And then the same data be made available to serveral web sites running
on PHP/ASP/ASP.net across many servers. I know that it is possible to
do the same using server side technologies, but a common set of client
side scripts that are platform independent make sense.

Any advice/help is most appreciated

Ramdas

Nov 11 '07 #1
1 3042
Ramdas S said the following on 11/11/2007 1:40 PM:
Hello,

I am looking at ways I can scrap the content of a remote url and make
that available as a javascrpt string to a program running under
another domain.
You can't. It is a cross-domain security issue.
I am able to easily scap contents of local files. But unable to parse
a URL. Is it that Javascript do not support such code?
It doesn't support cross-domain scripting such as you are trying to do.
I am fairly new to JavaScript and is more familiar with server side
scripting/prohgramming languages.
Server side scripting is your best alternative.
I am trying to write an application that will read data which can be
made available as dynamically generates XML files of similar schemas.
And then the same data be made available to serveral web sites running
on PHP/ASP/ASP.net across many servers. I know that it is possible to
do the same using server side technologies, but a common set of client
side scripts that are platform independent make sense.
Have a page on your server, call it "readTheFiles.php", then have
readTheFiles.php read the remote files, generate the XML files, and then
the "several web sites" can refer to that file. Give it a parameter that
is the URL to the remote file to read.

--
Randy
Chance Favors The Prepared Mind
comp.lang.javascript FAQ - http://jibbering.com/faq/index.html
Javascript Best Practices - http://www.JavascriptToolbox.com/bestpractices/
Nov 11 '07 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

3
by: Jacob | last post by:
Hello All, I am trying to serve out some content via IIS that is hosted on a remote fileserver, and am unable to get the delegation working correctly. Our setup is as follows: Local LAN...
0
by: Charley | last post by:
Hi, My local procedure needs to call a remote stored procedure which dblink name is built at the run time depending on the input parameter to the local procedure. Therefore depending on the...
4
by: mkadlec99 | last post by:
Got a remoting question I was hoping someone could solve. I have an object (UpdateFlifo) that has two constructors, one empty, and one with arguments. I want to expose this object remotely,...
1
by: Marco Firenze | last post by:
Hi to everyone this is my problem : I have a dynamic SELECT code like this <select name="risposta1" id="risposta1" > <% Set file1 = CreateObject("Scripting.FileSystemObject")
13
by: =?Utf-8?B?S2VzdGZpZWxk?= | last post by:
Hi Our company has a .Net web service that, when called via asp.net web pages across our network works 100%! The problem is that when we try and call the web service from a remote machine, one...
9
by: pbd22 | last post by:
Hi. This is just a disaster management question. I am using XMLHTTP for the dynamic loading of content in a very crucial area of my web site. Same as an IFrame, but using XMLHTTP and a DIV. I...
1
by: Macneed | last post by:
I want to write a code to determine the homepage content was change, but if the homepage is write by asp or something else, (e.g. livescore.com here) i can't get the real homepage content by the...
3
by: Rick | last post by:
We have a web site that was built as an ASP.Net Web Site, I am unable to remote debug, when build ing the web site there is not a dll or PDB file generated. I can debug on my local machine but...
2
by: Razzbar | last post by:
I was wondering if anyone has experience with snap.com's service, where you put a reference to a remote script on your page. The script causes a small snapshot of a web page to appear wherever the...
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.