Connecting Tech Pros Worldwide Help | Site Map

Retrieving many RSS feeds fast?

Duke of Hazard
Guest
 
Posts: n/a
#1: Mar 30 '08
I have a simple scripts using magpie to retrieve upto 200 RSS feeds.
Unfortunately it takes forever as the script has to sequentially get
each feeds, wait for the response, then move on. Is it possible to
retrieve them all at once or do them in parrallel?
George Maicovschi
Guest
 
Posts: n/a
#2: Mar 30 '08

re: Retrieving many RSS feeds fast?


OK, me again, sorry for not being more specific earlier.

You should create a script (lets say parse_rss_ext.php) that parses
the RSS and outputs the result.
Then create another script (lets say parse_rss_core) that makes calls
to the parse_rss_ext.php script providing the RSS to be parsed and
receiving the response, then doing whatever needs to be done to the
response.

The code that emulates multi-threading in PHP is the following:

$rss_list is an array containing all the RSS feeds;

[code start]
$threads=array();
foreach ($rss_list as $rss)
$threads[$rss]=fopen('http://localhost/path/to/file/
parse_rss_ext.php?rss={$rss}','r');

foreach ($threads as $thread_rss=>thread)
if ($thread)
{
while (!feof($thread))
$responses[$thread_rss].=fgets($thread);
fclose($thread);
}
[code end]

Hope this helps you. Cheers!
Closed Thread