473,406 Members | 2,390 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,406 software developers and data experts.

Spawning sub php scripts in a master script

Hey guys,

Currently designing a web crawler of sorts to download some XML feeds and
parse the data, was hoping to get it working in shared hosting
environments. Because it only scans slowly and is designed to use limited
resources, it shouldn't cause any problems or raise flags. The one issue
I am running up against is script max execution time.

Is there any way to spawn another instance of the script and close the
initial one, daisy chaining execution every few minutes to stay under the
limits? I'm unclear whether options like popen() a) work in shared
environments and b) allow the process which spawns another to be shut
down.

If anyone has any expertise here I'd absolutely love some direction!

Thanks.

Nov 14 '07 #1
1 1461
On Wed, 14 Nov 2007 20:34:27 +0000, kiretose wrote:
Hey guys,

Currently designing a web crawler of sorts to download some XML feeds
and parse the data, was hoping to get it working in shared hosting
environments. Because it only scans slowly and is designed to use
limited resources, it shouldn't cause any problems or raise flags. The
one issue I am running up against is script max execution time.

Is there any way to spawn another instance of the script and close the
initial one, daisy chaining execution every few minutes to stay under
the limits? I'm unclear whether options like popen() a) work in shared
environments and b) allow the process which spawns another to be shut
down.

If anyone has any expertise here I'd absolutely love some direction!

Thanks.
for those following:

exec("php -f /var/www* filename here /dev/null &", $array);
spawns it as a background process (on linux at least) and the script that
spawned it is closed.

Nov 14 '07 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

5
by: MikeT | last post by:
I need to start a lengthy file copy process going on our intranet server from a .asp page. Since the .asp cannot wait for this to complete - it might take anything up to half an hour - I've been...
2
by: kewl | last post by:
Hi All, We have an ASP.NET 2.0 (C#) intranet application that needs to spawn multiple browsers using RegisterClientScriptBlock. Here's what we got so far: // Go thru each datarow in the...
0
by: VB Programmer | last post by:
I used Photoshop/Image Ready to create rollover buttons (for a nav menu). They work great. But, when I take the html, including the javascript and put it in a MasterPage, when I view the page...
3
by: ivanpais | last post by:
Hi, I have a Web User Control, Lets say "Foo.ascx", that contains a button "btnFoo". I have a Master Page "Bar.master", that has a label "lblBar". This label is exposed by a public property...
17
by: Rob R. Ainscough | last post by:
Again another simple concept that appears NOT to be intuitive or I'm just stupid. I've read the WROX book and the example doesn't actually show how the .master page links in the other content...
1
by: Larry Rebich | last post by:
I'm using some Java Script I found that supports a 'back' button on my ASP.Net page. The Asp.Net page uses a Master page. I thought I'd put the Java Script in a Java Script file . The thought was...
1
by: sudip2008 | last post by:
When using the Calendar Popup in a content page of a masterpage the strForName is always set to aspnetForm This breaks this line from working properly window.opener.document.forms...... How can...
0
by: gfergadis | last post by:
Hello, I have a couple problems which I think they need attention from someone a bit more experienced in web developpement than I am. I want to change the text of an ASP:Label (Server Side),...
5
by: shapper | last post by:
Hello, I am working on a web site where I have a master page. Most web site pages use this master page as base. Some scripts are used in all pages ... other just in a few pages. Should I load...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.