By using this site, you agree to our updated Privacy Policy and our Terms of Use. Manage your Cookies Settings.
424,661 Members | 1,311 Online
Bytes IT Community
+ Ask a Question
Need help? Post your question and get tips & solutions from a community of 424,661 IT Pros & Developers. It's quick & easy.

Python for search engine development

P: n/a
hi everybody,
i planinng develop a search engine and i think using the python. Python
performance is enough this project?

Best Regards

Oct 2 '05 #1
Share this Question
Share on Google+
4 Replies


P: n/a
Well, Google applies some Python in their implementation, see
http://www-db.stanford.edu/~backrub/google.html

Oct 2 '05 #2

P: n/a
"corebump" <m.******@gmail.com> writes:
hi everybody,
i planinng develop a search engine and i think using the python. Python
performance is enough this project?


If you're going to do the heavy lifting in Python, maybe. It depends
on what you're going to search, and the performance requirements for a
search.

On the other hand, if you use a Python wrapper around a full-text
search facility, so that python finds documents, takes queries and
formats results for the user, it should be just fine.

<mike
--
Mike Meyer <mw*@mired.org> http://www.mired.org/home/mwm/
Independent WWW/Perforce/FreeBSD/Unix consultant, email for more information.
Oct 2 '05 #3

P: n/a
http://groups.google.com/group/comp....36d0b3466e262a

Mike Meyer wrote:
"corebump" <m.******@gmail.com> writes:
hi everybody,
i planinng develop a search engine and i think using the python. Python
performance is enough this project?


If you're going to do the heavy lifting in Python, maybe. It depends
on what you're going to search, and the performance requirements for a
search.

On the other hand, if you use a Python wrapper around a full-text
search facility, so that python finds documents, takes queries and
formats results for the user, it should be just fine.

<mike
--
Mike Meyer <mw*@mired.org> http://www.mired.org/home/mwm/
Independent WWW/Perforce/FreeBSD/Unix consultant, email for more information.


Oct 3 '05 #4

P: n/a
wi******@hotmail.com <ma**********@gmail.com> wrote:
Well, Google applies some Python in their implementation, see
http://www-db.stanford.edu/~backrub/google.html


"Some" is correct. As for writing a search engine in Python _only_,
hmmm -- I honestly don't know. You could surely develop a working
implementation, but then, to make it perform well, you'd most likely
want to profile it and retune some CPU-intensive parts using pyrex, or
C.

So, if during your program development process you can find good
open-source C or C++ libraries offering a fast implementation of some of
the CPU-bound stuff you know you'll need, you would probably be better
off by wrapping those libraries (again using pyrex, or maybe SWIG, or
Boost Python for C++, ...) rather than redoing them from scratch in
Python (and probably later having to do some tuning on those parts).
One notably strong point of Python is that it "plays well with others",
and I would advise you to leverage this fact.
Alex
Oct 8 '05 #5

This discussion thread is closed

Replies have been disabled for this discussion.