473,412 Members | 2,092 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,412 software developers and data experts.

Dataset search performance question

Am relatively new to .NET and am trying to use it to create a usage
billing system that can process a million or two records each day. Am
currently using a simple system written in C that uses hash tables to
look up all the information necessary to bill each record.

My question is, If I use a DataSet to maintain all the various lookup
tables involved in billing each record (some are small, some have
100,000 records), can accessing records out of these tables be as fast
as using simple hash tables in memory? Are indexes in the datasource
migrated and used in the DataSet?

Are there other less obvious tips/tricks for getting the fastest
possible search access out of DataSets?

Thanks for your advice.

Jeff
Jul 21 '05 #1
1 1607
No. (I don't think datatables will be as fast as hashtables, plus the
memory overhead is going to be huge) Although even a hashtable is not
too good, you can consider using a BST for your lookup table.

http://msdn.microsoft.com/library/de...res_guide4.asp

No., indexes are not copied from the datasource.

Sijin Joseph
http://www.indiangeek.net
http://weblogs.asp.net/sjoseph

Jeff Wilson wrote:
Am relatively new to .NET and am trying to use it to create a usage
billing system that can process a million or two records each day. Am
currently using a simple system written in C that uses hash tables to
look up all the information necessary to bill each record.

My question is, If I use a DataSet to maintain all the various lookup
tables involved in billing each record (some are small, some have
100,000 records), can accessing records out of these tables be as fast
as using simple hash tables in memory? Are indexes in the datasource
migrated and used in the DataSet?

Are there other less obvious tips/tricks for getting the fastest
possible search access out of DataSets?

Thanks for your advice.

Jeff

Jul 21 '05 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

28
by: joshc | last post by:
If I have an array of data that I know to be sorted in increasing order, and the array is less than 50 elements, and I want to find the first element greater than a certain value, is a simple...
4
by: Oscar Thornell | last post by:
Hi, I have a relativley large/complex typed dataset that contains 7-8 tables and some supporting relational tables (lookups) for many-to-many relations. A good exampel would be a dataset that...
4
by: Bas Hamer | last post by:
I guess I don't know how to word it better than that. Our company has machines that generate log file in our own proprietary language. A while back I wrote a class that took one of these files...
2
by: Carl Summers | last post by:
I have a table in an Access database that has no sort applied in Access. When I fill a dataset with data from that table (the entire one dimensional table) my dataset is sorted differently than...
0
by: Jeff Wilson | last post by:
Am relatively new to .NET and am trying to use it to create a usage billing system that can process a million or two records each day. Am currently using a simple system written in C that uses...
1
by: # Cyrille37 # | last post by:
Hello, I'm learning .Net's Dataset and TableAdaptor. They store data locally and only propagate change to the SQL Server. That's a unconnected data access. By this way, a question comes to me...
4
by: =?Utf-8?B?V2lsc29uIEMuSy4gTmc=?= | last post by:
Hi Experts, I am doing a prototype of providing data access (read, write & search) through Web Service. We observed that the data storing in SQL Server 2005, the memory size is always within...
6
by: Kbalz | last post by:
Trying to run a simple query on my dataset the SQL statement looks like this: select * from person where id in (@p) When using more than one id in the "in statement", I get...
3
by: Ken Fine | last post by:
This is a question that someone familiar with ASP.NET and ADO.NET DataSets and DataTables should be able to answer fairly easily. The basic question is how I can efficiently match data from one...
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new...
0
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.