473,403 Members | 2,359 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,403 software developers and data experts.

Exporting data while people are using the site?

I'm exporting a large file from a large Production database (SQL).

Users are currently updating and inserting new records.

Does the export take a snapshot of the data when it starts ? or will
it freeze the database so all udpates/inserts happen after the export
completes?

Also, how do I get the delta of data that wasn't exported, if I want
to get the difference the next day?

Thank yoU!!!
Jul 20 '05 #1
4 1958
"Angel Cat" <ki***********@hotmail.com> wrote in message
news:9b**************************@posting.google.c om...
I'm exporting a large file from a large Production database (SQL).
Users are currently updating and inserting new records.
Is it 24hr updating or is there a break during the night?
Does the export take a snapshot of the data when it starts ? or will
it freeze the database so all udpates/inserts happen after the export
completes?
Snapshot.
Also, how do I get the delta of data that wasn't exported, if I want
to get the difference the next day?


Comparitive reporting on some key field to provide stats.
OTOH these import tasks can be automated and scheduled.
If the database shows no activity at 3:00am daily, do it then.

Jul 20 '05 #2
THe database is in use 24 hours a day. I need to take a dump of the
data and and make some updates but what happens when a user is updting
while I take a dump. Does DTS freeze the data when I'm exporting?

ALso, is there a way I can take the difference easily?

Thank yoU!

"mountain man" <hobbit@southern_seaweed.com.op> wrote in message news:<38******************@news-server.bigpond.net.au>...
"Angel Cat" <ki***********@hotmail.com> wrote in message
news:9b**************************@posting.google.c om...
I'm exporting a large file from a large Production database (SQL).
Users are currently updating and inserting new records.


Is it 24hr updating or is there a break during the night?
Does the export take a snapshot of the data when it starts ? or will
it freeze the database so all udpates/inserts happen after the export
completes?


Snapshot.
Also, how do I get the delta of data that wasn't exported, if I want
to get the difference the next day?


Comparitive reporting on some key field to provide stats.
OTOH these import tasks can be automated and scheduled.
If the database shows no activity at 3:00am daily, do it then.

Jul 20 '05 #3
"Angel Cat" <ki***********@hotmail.com> wrote in message
news:9b**************************@posting.google.c om...
THe database is in use 24 hours a day. I need to take a dump of the
data and and make some updates but what happens when a user is updting
while I take a dump. Does DTS freeze the data when I'm exporting?
Effectively it does a snapshot.
ALso, is there a way I can take the difference easily?
The quantitative difference can be approximated in the first
instance by publishing the rowcount of the table "as at snapshot"
as distinct from the rowcount of the realtime SQL table which
can be easily obtained dynamically between loads. This will
represent (net) rows to be added/deleted.

Operationally this will imply part of the export process
will be to write the "last record included" type of thing
to some local table.

The quantitative differences are more difficult issues to deal
with but obviously you need to decide what elements of the
data you wish to keep track of during inter-load build-ups.
These you can add to the rowcount info if/when req'd.

Another idle thought here includes a master-publication
register accessible to the distribution group (who are getting
your export file) which is updated at every publication with
relevant information, and coupled with a realtime query into
SQL to compare nowtime with last publication.

Thank yoU!

"mountain man" <hobbit@southern_seaweed.com.op> wrote in message

news:<38******************@news-server.bigpond.net.au>...
"Angel Cat" <ki***********@hotmail.com> wrote in message
news:9b**************************@posting.google.c om...
I'm exporting a large file from a large Production database (SQL).
Users are currently updating and inserting new records.


Is it 24hr updating or is there a break during the night?
Does the export take a snapshot of the data when it starts ? or will
it freeze the database so all udpates/inserts happen after the export
completes?


Snapshot.
Also, how do I get the delta of data that wasn't exported, if I want
to get the difference the next day?


Comparitive reporting on some key field to provide stats.
OTOH these import tasks can be automated and scheduled.
If the database shows no activity at 3:00am daily, do it then.

Jul 20 '05 #4
Angel Cat,

It was my understanding that SQL 7 and 2000 have a snapshot of the data "as
of" the end time of the databases.
If you start your backup at 6pm and users are inserting and updating, and
your database backup finishes at 6:30pm, your backup will be as of 6:30pm.

MSSQL 6.5 had a snapshot of the data at 6pm. Assuming the example above.

Oscar....

"Angel Cat" <ki***********@hotmail.com> wrote in message
news:9b**************************@posting.google.c om...
I'm exporting a large file from a large Production database (SQL).

Users are currently updating and inserting new records.

Does the export take a snapshot of the data when it starts ? or will
it freeze the database so all udpates/inserts happen after the export
completes?

Also, how do I get the delta of data that wasn't exported, if I want
to get the difference the next day?

Thank yoU!!!

Jul 20 '05 #5

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

3
by: sridevi | last post by:
Hello How to export data from ms-access database to excel worksheet using ASP. mainly i need to export data to multiple worksheets. it is very urgent to us. i have a sample code which works...
1
by: Janne Ruuttunen | last post by:
Hello DB2 people, I'm having problems exporting >= 250000 lobs to IXF files with the LOBSINFILE option, using a legacy DB2 2.1 system on Win NT. If I don't specify a path for the lobs,...
5
by: Jayjay | last post by:
Is it possible to export a report to word and have it include the graphics that are in the report? I'd like to take some of our reports and export them to word so we can email those to the...
4
by: Dom Hicklin | last post by:
I have created a form onto which images can be dropped and thus added to the OLE field of a Table (Access 2000 linked to SQL 2000 server). I use the Stephen Lebans ExportOLE function to do this...
0
by: Stephan Golux | last post by:
Hello. I am using an access 97 application that exports a report to RTF format, which is subsequently emailed to various people. The main informational field in the report is a free form memo...
2
by: pmud | last post by:
Hi, I am exporting data from an EDITABLE DATA GRID EXCEL. But the 1st column in data grid is Edit Column. I want to display all columns in Excel except for the Edit column. The following...
2
by: bienwell | last post by:
Hi, I have a question about exporting data from datagrid control into Excel file in ASP.NET. On my Web page, I have a linkbutton "Export data". This link will call a Sub Function to perform...
3
by: David P. Donahue | last post by:
I'm re-writing an application in C# that was originally written in Delphi 7. The heart of the application is a DataSet displayed in a DataGrid. One of the main functions of the previous...
1
by: cmgmyr | last post by:
Hey All, I'm having a little problem with exporting data from my database. The problem is that the query seems to be too much for PHP and MySQL to handle since it is timing out. I have the timeout...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.