I have a table in a database that has just over 1 million records, each
record about 50-60 characters. I need to transfer this data to another
database. I implemented two options:
1) Read the data record by record and insert into the destination
database, using ODBC. I played with different commit intervals, up to
100,000. This version takes about 12 minutes. Having indexes on the
destination table or removing them made little difference.
2) Dump the data into a flat file, and use bulk copy to read the file
into the destination table. This takes less than a minute.
Are these results within the normal ranges? I am particularly
interested in a way to improve upon the first method.
3  1220 
INSERT SELECT will probably improve on the first method.
When you say having indexes on the destination table made little
difference does that include a primary key and a clustered index? a
heap with no indexes at all should be used for best performance.
Tzvika Barenholz wrote: INSERT SELECT will probably improve on the first method.
When you say having indexes on the destination table made little
difference does that include a primary key and a clustered index? a
heap with no indexes at all should be used for best performance.
I thought that since the original data is in a different SQL Server
instance, I couldn't use the INSERT SELECT statement. Is that correct?
As for the indexes, yes, it is a simple, single-column primary key.
Hi
If the server is a linked server then you can use INSERT... SELECT with
either a 4 part name or using OPENQUERY.
John
<ne**********@y ahoo.com> wrote in message
news:11******** **************@ f14g2000cwb.goo glegroups.com.. . Tzvika Barenholz wrote: INSERT SELECT will probably improve on the first method.
When you say having indexes on the destination table made little
difference does that include a primary key and a clustered index? a
heap with no indexes at all should be used for best performance.
I thought that since the original data is in a different SQL Server
instance, I couldn't use the INSERT SELECT statement. Is that correct?
As for the indexes, yes, it is a simple, single-column primary key. This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics | |
by: Simon |
last post by:
Hi,
I am having a little problem with my PHP - MySQl code, I have two tables
(shown below) and I am trying populate a template page with data from both.
<disclaimer>Now I would like to say my skills, especially with MySQL are
rudimentary</disclaimer> However my code (link below) fails, the nested
database call does not return any data and this has me stumped. Any help
will be much appreciated.
Many thanks in advance
|
by: BijuThomas |
last post by:
Complicated - ASP/Security/data transfer/XML doubt
In our company Head office we are hosting an intranet
server in IIS (Windows 2000) , ASP and Sqlserver back
end.
We are maintaining our branch accounts at various
locations and they are sending monthly reports only. Now
we are planning to have a centralised data store at our
Head Office so that, all details can be accessed from one
place using this intranet.
|
by: Dave |
last post by:
We are trying to migrate a MS SQL server app to DB2 8.1 Linux platform.
Our database has got about 300+tables with total size - 150 GB
We are using MS SQL's BCP utility to extract data from MS SQL's tables
and loading into DB2
using DB2's LOAD utility. There are tons of colums of floating point
types (singe precion & double precision types)
in the database and when extracted using BCP, it generates data only upto
17 digits....
|
by: Fatih BOY |
last post by:
Hi,
I want to send a report from a windows application to a web page like
'report.asp'
Currently i can send it via post method with a context like
local=En&Username=fatih&UserId=45&Firm=none
But the problem occures when i want to send a data with & sign (i.e:
Firm=F&B). I try to solve this problem with using boundary, but i failed.
Any idea!?
|
by: Mark Waser |
last post by:
Hi all,
I'm trying to post multipart/form-data to a web page but seem to have
run into a wall. I'm familiar with RFC 1867 and have done this before (with
AOLServer and Tcl) but just can't seem to get it to work in Visual Basic. I
tried coding it once myself from scratch and then modified a class that I
found on a newsgroup (referenced below). Both seem to be doing the same
thing and neither works (or rather, they seem to work but the...
| | |
by: E.T. Grey |
last post by:
Hi,
I have an interesting problem. I have a (LARGE) set of historical data
that I want to keep on a central server, as several separate files. I
want a client process to be able to request the data in a specific file
by specifying the file name, start date/time and end date/time.
The files are in binary format, to conserve space on the server (as well
as to increase processing time). The data in each file can be quite
large, covering...
|
by: David Veeneman |
last post by:
I am creating a form on the server that I want to POST to a URL that's being
called with Server.Transfer(). What's the simplest way to do that?
A little background: I'm programming buttons that link to PayPal's shopping
cart. PayPal wants an HTML form with data about the product selected
(including price), and they provide sample HTML to create a hidden form to
transmit the data when the 'Add to cart' button is clicked.
It would be...
|
by: Donald Adams |
last post by:
Hi,
I will have both web and win clients and would like to page my data. I
could not find out how the datagrid control does it's paging though I did
find some sample code that says they do it this way, but I can't see these
methods as public.
BookmarksDataSetTableAdapters.BookmarksTableAdapter bookTA = new
BookmarksDataSetTableAdapters.BookmarksTableAdapter();
BookmarkList1.DataSource = bookTA.GetAllBookmarksWrtUser(
|
by: =?Utf-8?B?YzY3NjIyOA==?= |
last post by:
Hi all,
Our asp programs seem to have different behaviors when users use IE and
firefox.
One of most annoying things is the data disappearing problem in IE but not
in firefox.(Note: Sometimes a search program can run much faster in Firefox
than in IE, don't know why)
For example,
I have an internal user interface which they can do different product data
entry,
the program will use Server.Transfer to different asp program for data
|
by: Andrew Jackson |
last post by:
I am writing a newsgroup client. I have the protocol figured out. But I
get slow transfer speeds off any of the network objects read the data from
For example one of the commands for a news client to use is "XOVER
articlenumber-"
This return string after string of all the news articles from article number
on....
Another newsclient, i wont name names, pulls data down just fine. Using a
|
by: Hystou |
last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it.
First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
| | |
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed.
This is as boiled down as I can make it.
Here is my compilation command:
g++-12 -std=c++20 -Wnarrowing bit_field.cpp
Here is the code in...
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth.
The Art of Business Website Design
Your website is...
|
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
|
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own....
Now, this would greatly impact the work of software developers. The idea...
|
by: isladogs |
last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM).
In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules.
He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms.
Adolph will...
|
by: conductexam |
last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one.
At the time of converting from word file to html my equations which are in the word document file was convert into image.
Globals.ThisAddIn.Application.ActiveDocument.Select();...
| | |
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
|
by: muto222 |
last post by:
How can i add a mobile payment intergratation into php mysql website.
| |
