By using this site, you agree to our updated Privacy Policy and our Terms of Use. Manage your Cookies Settings.
438,814 Members | 2,183 Online
Bytes IT Community
+ Ask a Question
Need help? Post your question and get tips & solutions from a community of 438,814 IT Pros & Developers. It's quick & easy.

real time sort results fetched from different sites

P: n/a
I run a web site that searches for data on other web sites and displays
the results for the user onscreen.

Currently, it uses perl to fetch the data, sort it and display it. It
can take quite a few seconds.

Is there a way to fetch the data and have it displayed as it comes in,
but also to sort it each time a new entry comes in?

I can display results as they come in real time using perl / html, but
there is no way for me to insert html before something that was already
sent.

any idea how to do this?

Oct 14 '05 #1
Share this Question
Share on Google+
2 Replies


P: n/a
none wrote:
I run a web site that searches for data on other web sites and displays
the results for the user onscreen.

Currently, it uses perl to fetch the data, sort it and display it. It
can take quite a few seconds.

Is there a way to fetch the data and have it displayed as it comes in,
but also to sort it each time a new entry comes in?

I can display results as they come in real time using perl / html, but
there is no way for me to insert html before something that was already
sent.

any idea how to do this?

Well, I figure that instead of a blank screen , you could start out
the response cycle with some sort of display for the user to stare at
for a few seconds. As long as the moment the user presses something they
see a reaction start, most are willing to wait a little longer to see
the result without having felt like the wait you get from a blank screen.

Another thing you might do is split the parsing into a connection for
each web site your parsing, then something is usre to pop sooner than
waiting for all the servers to respond in a single process. This can be
done with XMLHTTP.

Also try not to use big table constructs as it prevents some browsers
from rendering anything untill the whole table and contents arrive.

THere are more things that could be done like incremental caching
so that if you can qualify the requests enough , then after the first
user makes that request , the next user gets a cached copy (depending on
staleness) and the new parse starts AFTER they have already received the
cached version. ( more complex , but very speedy for the user)


--
--.
--=<> Dr. Clue (A.K.A. Ian A. Storms) <>=-- C++,HTML, CSS,Javascript
--=<> Internet Programming since 1994 <>=-- DHTML NSAPI TCP/IP
--=<> http://resume.drclue.net <>=-- AJAX, SOAP, XML, HTTP
--=<> http://www.drclue.net <>=-- SERVLETS,TCP/IP, SQL
--.
Oct 14 '05 #2

P: n/a
Hi!

Thankyou for your reply, but I have already implemented all of those
things.

I want to improve the speed by sorting the results as more are fed in.
Isn't there a way to do this using javascript?

Oct 16 '05 #3

This discussion thread is closed

Replies have been disabled for this discussion.