Data Loading Issue - C# / C Sharp

Sunny

Hi,
I am using Databases in my applications, i have a table with an average of 3.5 million records, i am trying to show the search results in a DataGrid from that table, but the results take a very long time to load, it is a very simple search and there are no constraints on the table nor is it a select query from multiple tables.
I am using a Datacommand to read data into a DataAdapter and then filling a DataSet which is used to populate a DataGrid,
Does anyone know a better way to show records in a Datagrid (a little faster), this thing is driving my nuts !

With Regards
Sunny

Nov 15 '05 #1

Subscribe Reply

2110

Richard

Some thoughts:

-- Find out what is taking so long.

Are you really trying to look at 3.5 million rows in the
grid? If so then you are going to wait a loonnngg time
while .NET copies 3.5 million rows to the DataSet.

However if your search result should be returning a few
hundred rows and it's still taking a long time to load
then you have to determine if the database query is taking
a long time or if the transfer of data from database to
DataSet is taking a long time.

Sooo, figure out where the bottleneck is...

-- If you DO want to look at 3.5 million rows in the grid
then you have issues --> chief among your issues is that
someone is nuts enough to want to look at 3.5 million rows
in a grid...

So if you find yourself in the nutcase scenario then you
have two options:

1) TRY a DataReader, they are faster, but I doubt this
will help with 3.5 million rows...

2) Thread the data grid load. If done properly you will
have a grid that behaves like MS Word or Excel when
opening a large document; the scrollbar will grow while
the load finishes and simultaneously the user will be able
to manipulate the grid. This, however, is not easy to do
since in .NET the DataSet is the unit of synchronization
not the DataTable.

In any event have fun...

--Richard

-----Original Message-----
Hi,
I am using Databases in my applications, i have a table with an average of 3.5 million records, i am trying to
show the search results in a DataGrid from that table, but
the results take a very long time to load, it is a very
simple search and there are no constraints on the table
nor is it a select query from multiple tables.I am using a Datacommand to read data into a DataAdapter and then filling a DataSet which is used to populate a
DataGrid,Does anyone know a better way to show records in a Datagrid (a little faster), this thing is driving my nuts !
With Regards
Sunny

.

Nov 15 '05 #2

Similar topics

2045

Data retrival time and combo load

by: kk | last post by:

Have 2 problems, any help is appreciated. Tab with Grids -------------- BL - fetching data from DB ( 5 secs - 10 rows) Grid Laod - 20 secs Grid Paint on tab change - 20 secs Problem: The data fetch only takes 5 secs, why does paint and load take 40 secs in total.

.NET Framework

1704

ADO.net: 3 Data Set Questions (Issues)

by: Mr. B | last post by:

I'm updating my current VB.et application. I currently reads about 6 tables from an MS Data base. I've created a new MDB file which combines the 6 tables into 1 table. I'm doing this because I know I'll speed up my application loading time by more than 10 seconds (out of about 20). I've run across three situations in which I'm stuck at: Issue One: If my largest Column has (say) 200 lines, other columns will have less data

.NET Framework

8235

load data with embeded New Line character

by: Prince Kumar | last post by:

What is the best way of loading data which has ENTER/new line (ie, ^M) character as the part of the data? say I have data as follows for table TAB1 (cust#, datetime, memo, child) 7579, "2001-09-14 15:06:26", "sample memo with ^M New Line^M ",1234

DB2 Database

2904

Design Question - Buisiness Objects and Data Layer

by: Matthias S. | last post by:

Hi, I have to write an application which extensively uses an SQL Database. For a simple example say I have the following tables with the appropriate fields. 1. Company (ID, Name, AddresseInfoID) 2. AddresseInfo (ID, Street, City, Zip) (Those two obviously have a relationship)

C# / C Sharp

2157

Saving Data When ASP.Net Page Unloads

by: Roy Scarisbrick | last post by:

I have a programming issue on an ASP.Net web page. I suspect the issue would apply to any version of ASP though. I have a questionnaire page where a user will answer a bunch of questions with radio buttons and text boxes. At the bottom of the page is a button that he is to click when he's done. The event behind the button will write the data to the database and redirect him to a Thanks page.

ASP.NET

1741

Does using the Data retrieval in webservices slower loading aspx p

by: GP | last post by:

We are connecting to sql server database in the webservices & retrieve the data as dataset from the webservices and load it to the aspx pages ,But we find loading of the aspx pages takes longer time than the pages that retrieve data directly using cs files.Is it good practise to use the data retrieval in web services. Can some help me in this issue. Thanks GP

.NET Framework

4542

Loading data of a excel sheet or excel sheet format in Rich TextBox Control

by: natrajsr | last post by:

Hi, I want to load the data of a excel sheet or in the exact excel sheet format into a Rich TextBox control. I have already worked with loading WORD into a Rich TextBox. It is working fine.; But it is taking long time for our need. So we thoguht, we can find another better solution rather than that. Can anyone help me to find out how to load a excel sheet or in the

C# / C Sharp

4531

Please help explain what an "application instance" really is in terms of static data

by: Dave | last post by:

I have a global.asax file with Application_Start defined and create some static data there and in another module used in the asp.net application and I realize that static data is shared amongst child apps of an IIS application and can be used by multiple users during the application life cycle and for multiple page loads for the same or different page under a root application. What I don't understand and need to know is whether that...

ASP.NET

1007

SqlDataAdepter vs Manual Data binding - Performance question.

by: Aykut Canturk | last post by:

As all we know there are 2 ways for binding gridview to sql table. using sqldata adapter and using code. What I want to know is, in large tables, is there a perfomance difference. When using code we don't specify any page size or anything. so all data must be retreived from sql table to web server memory, is that right ? Maybe, only maybe, sql data adapter uses different approach about loading table rows for perfomance issues. in VB6,...

ASP.NET

1262

loading data to a DataGridView control

by: teressa | last post by:

Hi, I am new to Grid view Control. I have a page with many icons on it for different purposes. I want to add a Grid View where I want to load data with different columns. Below is my code(xyz.aspx).Where i need to add the aspx page to my original page.(I tried adding to my HTML page but it returns with an error(We’re sorry, the application is currently unavailable. If you need any assistance, please contact ...)instead of loading data. I...

.NET Framework

9563

What is ONU?

by: marktang | last post by:

ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...

General

9386

Changing the language in Windows 10

by: Hystou | last post by:

Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...

Windows Server

9997

Maximizing Business Potential: The Nexus of Website Design and Digital Marketing

by: jinu1996 | last post by:

In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...

Online Marketing

9937

The easy way to turn off automatic updates for Windows 10/11

by: Hystou | last post by:

Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...

Windows Server

9822

Discussion: How does Zigbee compare with other wireless protocols in smart home applications?

by: tracyyun | last post by:

Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...

General

7366

Access Europe - Using VBA to create a class based on a table - Wed 1 May

by: isladogs | last post by:

The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...

Microsoft Access / VBA

3917

transfer the data from one system to another through ip address

by: 6302768590 | last post by:

Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system

C# / C Sharp

3522

How to add payments to a PHP MySQL app.

by: muto222 | last post by:

How can i add a mobile payment intergratation into php mysql website.

PHP

2793

Comprehensive Guide to Website Development in Toronto: Expert Insights from BSMN Consultancy

by: bsmnconsultancy | last post by:

In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

General