473,758 Members | 2,401 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Memory Handling - DataTable and SQL Database

33 New Member
Hey guys Im having some problem with handling DataTable memory, here's my predicament; Ive got a TableAdapter and Dataset from a SQL Database that I am inserting records to. These records are being inserting directly to schema using a DataRow of the table from the dataset (I cant use the insert query from the tableadapter because there are over 100 columns in the table that its being inserted to.)

My problem is that the datatable seems to be getting stored in memory from the dataset I am using on the form, and I am running out of memory before I finish inserting all the data into SQL (Over 1m records). Is there a way I can just use dataset schema and tableadapter without the datatable being stored in memory, or how am I going about this wrong?

Thanks
Oct 25 '10 #1
1 1412
marcellus7
33 New Member
Ok guys, I think I've got it. I didnt know that when you add a dataset to the form using the Designer, it turns on the Generate Member property, which automatically saved the datatable in memory and declares it, etc. If you change this property to false, you can declare your own instance of the datatable, and dispose it as often as necessary to keep memory usage down. Just an FYI incase anyone else runs into this.

Thanks
Oct 25 '10 #2

Sign in to post your reply or Sign up for a free account.

Similar topics

4
7169
by: Edward Singleton | last post by:
I am currently developing a web app using WSAD 5.1 and DB2 V7.2.8. I understand there is a myriad of database errors related to obtaining valid connections that are mapped directly to com.ibm.websphere.ce.cm.StaleConnectionException. There are apparently two solutions to ensure a valid connection is obtained from a WebSphere dataSource. The first is to catch StaleConnectionExceptions and attempt to execute the transaction again a...
0
912
by: David P. Donahue | last post by:
Does anyone have any experience using MySQL databases with their C# projects? I have a DataList on a webpage that gets its values from a DataSet that's populated from a MySQL database. One of the fields is of type Text. But when the DataList is bound to the data, it gives an "unknown target conversion type" error. I've tried wrapping it in a Convert.ToString() but that didn't change anything. I've definitely narrowed it down to the...
1
1262
by: basha | last post by:
hi can u help me how to write code to handle errors in dabase in asp.net pls,very urgent bye basha
0
1168
by: Lau Lei Cheong | last post by:
Hello, I'm writing a project that involves entering chinese character into MySQL database. Since 1) connection-based coding selection requires an upgrade to version 4.1.1 or above and my company don't want to do that, 2) the web program will run in both big5 and gb2312 so I can't simply set the coding to big5, and 3) my company's backend is written in VB6.0 which is they told me do not support unicode(so I can't change the database's...
4
4691
by: Mike | last post by:
Assume i have a db connection and a datareader for that connection. Now I perform a query that retrieves 100MB of data. I know that the data reader gets 1 row at a time. However, there is a result set out there that is 100MB is size. If I close the dataReader but keep the DB connection open, will the 100MB be freed up after closing the DataReader? Can I continue reusing the same DB connection and creating and destroying datareaders...
17
8485
by: frederic.pica | last post by:
Greets, I've some troubles getting my memory freed by python, how can I force it to release the memory ? I've tried del and gc.collect() with no success. Here is a code sample, parsing an XML file under linux python 2.4 (same problem with windows 2.5, tried with the first example) : #Python interpreter memory usage : 1.1 Mb private, 1.4 Mb shared #Using http://www.pixelbeat.org/scripts/ps_mem.py to get memory information
10
1879
by: Reza2 | last post by:
Hello I am using a subroutine to solve relatively large matrix in C++ but I got an error with this text "The exception unknown software exception (0x0000005) occurred in the application at location 0x0040a97a" I know that this is an error in memory allocation. my computer has 16GB RAM memory. but I dont know how to use it to solve a matrix greater than 10000x10000. right now I can not solve matrices greater than 4000x4000. I appreciate...
4
13135
by: gamaz | last post by:
Hi, I am trying to work on a stored procedure that will work with multiple database. I have a prototype of multiple databases. Those are named as the following: ts2_aldkm_app, ts2_aldkp_app, ts2_aldkt_app. The middle part of the database name corresponds to the site name e.g aldkm corresponds to site aldkm etc. Each database has one table tblCustomer which is scripted as follows: if exists (select * from dbo.sysobjects where id =...
3
1263
by: =?Utf-8?B?RW1tYQ==?= | last post by:
Hello I have a database which I access through the Internet using ASP now my SELECT statement isn't working now that I've changed the text values of Yes/No to boolean values of Yes/No. What can I do to resolve this problem?
2
2482
by: Nabangi | last post by:
Hi, Ive 2 programs at different memory locations. I wish to execute the 2nd program in the 1st by using a function pointer ( int *(funcptr()) in the 1st program by passing the address of the main function in 2nd program by address value rather than by function name. Each time im getting a conversion error. How best can I go about this? How can I also access ALL the contents of disc and input in the stream for displaying on the screen.
0
9299
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
1
9885
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
0
9740
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
0
8744
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
7287
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
6564
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
5175
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
1
3832
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
3
3402
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.