470,849 Members | 1,127 Online
Bytes | Developer Community
New Post

Home Posts Topics Members FAQ

Post your question to a community of 470,849 developers. It's quick & easy.

How do i avoid newsreaders and get at the rss myself?

I was using http://feeds.feedburner.com/reuters/worldNews/ to obtain
the rss feed of world news from Reuters. I was running a vb.net app
that would grab the file every 15 minutes, do some manipulation and
then thump the data into mysql. Now feedburner have blocked direct
access to the feed and advise me to download a newsreader. I've briefly
played around with newsreaders in the past but couldn't see the use for
them from a developers point of view. Is there a solution where i can
run a newsreader on my server and that dumps the rss to a local source
where my existing application can pick it up and run with it?

Jun 1 '06 #1
3 977

digger440uk wrote:
I was using http://feeds.feedburner.com/reuters/worldNews/ to obtain
the rss feed of world news from Reuters. I was running a vb.net app
that would grab the file every 15 minutes, do some manipulation and
then thump the data into mysql. Now feedburner have blocked direct
access to the feed and advise me to download a newsreader.
http://feeds.feedburner.com/reuters/worldNews/
is still returning the raw RSS to me (Firefox). They've also stuck a
client-side stylesheet on top of it, so that your browser's default
presentation of it will be in HTML, not as raw RSS. However I still
have just as much programmatic "access" to the RSS content as ever.
Is there a solution where i can run a newsreader on my server and that dumps the rss


Try playing with different user-agent strings in your feed reader
client, ones that don't look like well-known web browsers.

Jun 2 '06 #2
thanks andy

doh. i suddenly feel quite stupid. i should have looked at the source
before posting.

i suppose it's off topic now, but is there a newsreader out there that
does a scheduled rss grab then dumps to a local file?

Andy Dingley <di*****@codesmiths.com> wrote:
digger440uk wrote:
I was using http://feeds.feedburner.com/reuters/worldNews/ to obtain
the rss feed of world news from Reuters. I was running a vb.net app
that would grab the file every 15 minutes, do some manipulation and
then thump the data into mysql. Now feedburner have blocked direct
access to the feed and advise me to download a newsreader.


http://feeds.feedburner.com/reuters/worldNews/
is still returning the raw RSS to me (Firefox). They've also stuck a
client-side stylesheet on top of it, so that your browser's default
presentation of it will be in HTML, not as raw RSS. However I still
have just as much programmatic "access" to the RSS content as ever.
Is there a solution where i can run a newsreader on my server and that dumps the rss


Try playing with different user-agent strings in your feed reader
client, ones that don't look like well-known web browsers.


Jun 2 '06 #3
digger440uk wrote:
thanks andy

doh. i suddenly feel quite stupid. i should have looked at the source
before posting.

i suppose it's off topic now, but is there a newsreader out there that
does a scheduled rss grab then dumps to a local file?


Add this to your crontab:

5 0,6,12,18 * * * wget -O ~/file.xml http://some.rss.uri >>/tmp/wget.log

Adjust the minutes (here, 5 past the hour) and hours (here, four times a
day) and the file, URI, and log to your requirements.

///Peter
--
XML FAQ: http://xml.silmaril.ie/
Jun 2 '06 #4

This discussion thread is closed

Replies have been disabled for this discussion.

Similar topics

30 posts views Thread by seesaw | last post: by
20 posts views Thread by Dean Stevens | last post: by
7 posts views Thread by Nick Wedd | last post: by
8 posts views Thread by Cord-Heinrich Pahlmann | last post: by
6 posts views Thread by howa | last post: by
16 posts views Thread by mike3 | last post: by
By using this site, you agree to our Privacy Policy and Terms of Use.