Hey guys,
Currently designing a web crawler of sorts to download some XML feeds and
parse the data, was hoping to get it working in shared hosting
environments. Because it only scans slowly and is designed to use limited
resources, it shouldn't cause any problems or raise flags. The one issue
I am running up against is script max execution time.
Is there any way to spawn another instance of the script and close the
initial one, daisy chaining execution every few minutes to stay under the
limits? I'm unclear whether options like popen() a) work in shared
environments and b) allow the process which spawns another to be shut
down.
If anyone has any expertise here I'd absolutely love some direction!
Thanks.
1  1470 
On Wed, 14 Nov 2007 20:34:27 +0000, kiretose wrote:
Hey guys,
Currently designing a web crawler of sorts to download some XML feeds
and parse the data, was hoping to get it working in shared hosting
environments. Because it only scans slowly and is designed to use
limited resources, it shouldn't cause any problems or raise flags. The
one issue I am running up against is script max execution time.
Is there any way to spawn another instance of the script and close the
initial one, daisy chaining execution every few minutes to stay under
the limits? I'm unclear whether options like popen() a) work in shared
environments and b) allow the process which spawns another to be shut
down.
If anyone has any expertise here I'd absolutely love some direction!
Thanks.
for those following:
exec("php -f /var/www* filename here /dev/null &", $array);
spawns it as a background process (on linux at least) and the script that
spawned it is closed. This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics | |
by: MikeT |
last post by:
I need to start a lengthy file copy process going on our intranet
server from a .asp page. Since the .asp cannot wait for this to
complete - it might take anything up to half an hour - I've been
trying to use wshShell.Run to start a .wsf script running on the
server itself:
ignore = wshShell.Run("%comspec% /c ""cscript " & scriptpath & " " &
arguments & """", 1, false)
This starts the script OK, and will log what it is doing to a...
|
by: kewl |
last post by:
Hi All,
We have an ASP.NET 2.0 (C#) intranet application that needs to spawn multiple browsers using RegisterClientScriptBlock. Here's what we got so far:
// Go thru each datarow in the datatable
foreach (System.Data.DataRow drReportGroupsDetails in tableReportGroupsDetails.Rows)
{
// Get the needed values from the datatable
string reportName = (string)drReportGroupsDetails;
string reportPath = (string)drReportGroupsDetails;
|
by: VB Programmer |
last post by:
I used Photoshop/Image Ready to create rollover buttons (for a nav menu).
They work great.
But, when I take the html, including the javascript and put it in a
MasterPage, when I view the page (based on the Master) the rollovers don't
occur. Any ideas why? Is the Javascript supposed to work even when in a
Master Page?
Here's the partial HTML for the master... The javascript was created
automatically in Image Ready, so not to much of...
|
by: ivanpais |
last post by:
Hi,
I have a Web User Control, Lets say "Foo.ascx", that contains a button
"btnFoo".
I have a Master Page "Bar.master", that has a label "lblBar". This
label is exposed by a public property BarLabelText.
I now have a contentpage "FooBar.aspx", where "Bar.master" is the
master page and in the content section has the control "Foo.ascx".
|
by: Rob R. Ainscough |
last post by:
Again another simple concept that appears NOT to be intuitive or I'm just
stupid. I've read the WROX book and the example doesn't actually show how
the .master page links in the other content pages? Kinda sorta a critical
point no?
Am I missing something?
Rob.
P.S. the day I find a book that actually is useful rather than just a
| | |
by: Larry Rebich |
last post by:
I'm using some Java Script I found that supports a 'back' button on my
ASP.Net page. The Asp.Net page uses a Master page. I thought I'd put the
Java Script in a Java Script file . The thought was that I could use
this script in other pages. So I put a reference to the script file in the
<head tag of the Master page. But that does not work because the <head tag
of the Master page also contains a 'runat=server' statement. And only one
<head...
|
by: sudip2008 |
last post by:
When using the Calendar Popup in a content page of a masterpage the strForName is always set to aspnetForm
This breaks this line from working properly
window.opener.document.forms......
How can I fix this and display the date into textbox after selecting the date from Calendar.aspx? This Very Urgent ..........................
If any body help me out
I have given the following Code
******************************
|
by: gfergadis |
last post by:
Hello,
I have a couple problems which I think they need attention from someone a bit more experienced in web developpement than I am.
I want to change the text of an ASP:Label (Server Side), every time the user hovers the mouse on a client-side object.
I manage to make that work with the script I attach below, however the problems raise when I try to make my code a bit more efficient.
Ideally, I'd like to parse the "S" variable to the...
|
by: shapper |
last post by:
Hello,
I am working on a web site where I have a master page.
Most web site pages use this master page as base.
Some scripts are used in all pages ... other just in a few pages.
Should I load all scripts in master page ... I think they are cached
right?
Or should I load the common scripts to all pages in my master page and
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look !
Part I. Meaning of...
|
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed.
This is as boiled down as I can make it.
Here is my compilation command:
g++-12 -std=c++20 -Wnarrowing bit_field.cpp
Here is the code in...
| | |
by: Hystou |
last post by:
Overview:
Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
|
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
|
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own....
Now, this would greatly impact the work of software developers. The idea...
|
by: isladogs |
last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM).
In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules.
He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms.
Adolph will...
|
by: TSSRALBI |
last post by:
Hello
I'm a network technician in training and I need your help.
I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs.
The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols.
I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
|
by: muto222 |
last post by:
How can i add a mobile payment intergratation into php mysql website.
| | |
by: bsmnconsultancy |
last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...
| |
