By using this site, you agree to our updated Privacy Policy and our Terms of Use. Manage your Cookies Settings.
443,983 Members | 1,597 Online
Bytes IT Community
+ Ask a Question
Need help? Post your question and get tips & solutions from a community of 443,983 IT Pros & Developers. It's quick & easy.

C++ Crawlers

P: n/a
Hi
Does anyone here have a good recommendation for an open source crawler
that I could get my hands on? It doesn't have to be C++ based. I am
interested in learning how crawling works. I think python based
crawlers will ensure a high degree of flexibility but at the same time
I am also torn between looking for open source crawlers in python vs C
++ because the latter is much more efficient(or so I heard. I will be
crawling on very cheap hardware.)

I am definitely open to suggestions. Please suggest some names if you
could.

Thx
Jul 5 '08 #1
Share this Question
Share on Google+
2 Replies


P: n/a
di***********@gmail.com wrote:
Hi
Does anyone here have a good recommendation for an open source crawler
that I could get my hands on?
That depends on what "an open source crawler" is. However, your question is
off-topic here, since this newsgroup deals with questions about the C++
language itself. So if you have a specific problem with the language while
implementing or compiling "open source crawler", this would be the right
newsgroup.

Jul 5 '08 #2

P: n/a
di***********@gmail.com wrote:
[redacted]
>
I am definitely open to suggestions. Please suggest some names if you
could.
Here's a suggestion -- ask where it's on topic.

C++ as defined by ISO/IEC 14882:2003 doesn't discuss "crawlers"
(whatever the heck they are). The very fact that your post said that
Python-based is acceptable indicates that it's OT here.
Jul 5 '08 #3

This discussion thread is closed

Replies have been disabled for this discussion.