473,326 Members | 2,655 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,326 software developers and data experts.

Large amounts of data in javascript

1
Hi there,

For an internship I'm currently doing I need to be able to process large amounts of data in javascript. It's sort of a cash register system on which it's possible to see the current stock in real time for example. There can be as many as 6000 items in the stock. So performance is quite an issue. The original idea was to load a list with all of the items in it and then shrink the list based on searchterms entered. We've tried using XML and it seems to be impossible to get acceptable performance this way. Would it be possible to achieve this with JSON or plain text for example? Or should we limit the system to only send a limited amount of data based on what's entered (so if nothing is entered either show only the first ~500 items or nothing at all)?
Sep 8 '06 #1
2 3439
acoder
16,027 Expert Mod 8TB
Unless you're using Ajax, this data should not be stored on the client-side.

If using Ajax, only display a limited data set as you've suggested. JSON is a good alternative to XML.
May 6 '08 #2
gits
5,390 Expert Mod 4TB
yes ... JSON is much better to handle such amounts of data. the problem with chunks of data is of course that you cannot sort/filter the entire dataset without a new server-request since you need all data for that but i don't think there is a good recommendation for the trade-off so here are just some of my experiences ... we used to process similar and greater amounts of data here for us but in some cases we even decided to make a new call to request the filtered data ... this happend after a kind of 'trial'-period ... when the initial loading time gets too long we often decide to get the data later on ... even when we know that the data has to be loaded in any case ... because for the user (or better to say our! users) it seems to be better to have a quite fast responding application even when it loads and they accept some loading-times during the applications lifecycle ... instead of waiting a long time to start to work in it. so i just could recommend to test it out ... and don't forget different scenarios (bandwidth, client-machines etc.) ...

kind regards
May 6 '08 #3

Sign in to post your reply or Sign up for a free account.

Similar topics

1
by: michaaal | last post by:
If I use a form to pass data (say, for example, through a textbox) the data seems to be limited to somewhat smaller amounts. What should I do if I want to pass a large amount of data? For example...
10
by: Digety | last post by:
We are looking to store a large amount of user data that will be changed and accessed daily by a large number of people. We expect around 6-8 million subscribers to our service with each record...
4
by: oshanahan | last post by:
Does anyone have ideas on the best way to move large amounts of data between tables? I am doing several simple insert/select statements from a staging table to several holding tables, but because...
3
by: Wayne Marsh | last post by:
Hi all. I am working on an audio application which needs reasonably fast access to large amounts of data. For example, the program may load a 120 second stereo sound sample stored at 4bytes per...
2
by: Dennis C. Drumm | last post by:
What is the best way to add several pages of text to a readonly TextBox? The text does not change and was created in a Word rtf document but could as easly be put in a ASCII text file. Can this be...
1
by: Bart | last post by:
Dear all, I would like to encrypt a large amount of data by using public/private keys, but I read on MSDN: "Symmetric encryption is performed on streams and is therefore useful to encrypt large...
7
by: =?Utf-8?B?TW9iaWxlTWFu?= | last post by:
Hello everyone: I am looking for everyone's thoughts on moving large amounts (actually, not very large, but large enough that I'm throwing exceptions using the default configurations). We're...
4
by: bcomeara | last post by:
I am writing a program which needs to include a large amount of data. Basically, the data are p values for different possible outcomes from trials with different number of observations (the p...
1
by: Marshal Anderson | last post by:
I'm working on an application that requires a lot of internal data - short texts, numbers, switches etc. At the moment the only way I have of loading these is long lines of Array=The Data. In the...
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
1
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: ArrayDB | last post by:
The error message I've encountered is; ERROR:root:Error generating model response: exception: access violation writing 0x0000000000005140, which seems to be indicative of an access violation...
1
by: PapaRatzi | last post by:
Hello, I am teaching myself MS Access forms design and Visual Basic. I've created a table to capture a list of Top 30 singles and forms to capture new entries. The final step is a form (unbound)...
1
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
1
by: Defcon1945 | last post by:
I'm trying to learn Python using Pycharm but import shutil doesn't work
1
by: Shællîpôpï 09 | last post by:
If u are using a keypad phone, how do u turn on JavaScript, to access features like WhatsApp, Facebook, Instagram....
0
by: af34tf | last post by:
Hi Guys, I have a domain whose name is BytesLimited.com, and I want to sell it. Does anyone know about platforms that allow me to list my domain in auction for free. Thank you

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.