473,763 Members | 7,727 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Exporting data while people are using the site?

I'm exporting a large file from a large Production database (SQL).

Users are currently updating and inserting new records.

Does the export take a snapshot of the data when it starts ? or will
it freeze the database so all udpates/inserts happen after the export
completes?

Also, how do I get the delta of data that wasn't exported, if I want
to get the difference the next day?

Thank yoU!!!
Jul 20 '05 #1
4 1983
"Angel Cat" <ki***********@ hotmail.com> wrote in message
news:9b******** *************** ***@posting.goo gle.com...
I'm exporting a large file from a large Production database (SQL).
Users are currently updating and inserting new records.
Is it 24hr updating or is there a break during the night?
Does the export take a snapshot of the data when it starts ? or will
it freeze the database so all udpates/inserts happen after the export
completes?
Snapshot.
Also, how do I get the delta of data that wasn't exported, if I want
to get the difference the next day?


Comparitive reporting on some key field to provide stats.
OTOH these import tasks can be automated and scheduled.
If the database shows no activity at 3:00am daily, do it then.

Jul 20 '05 #2
THe database is in use 24 hours a day. I need to take a dump of the
data and and make some updates but what happens when a user is updting
while I take a dump. Does DTS freeze the data when I'm exporting?

ALso, is there a way I can take the difference easily?

Thank yoU!

"mountain man" <hobbit@souther n_seaweed.com.o p> wrote in message news:<38******* ***********@new s-server.bigpond. net.au>...
"Angel Cat" <ki***********@ hotmail.com> wrote in message
news:9b******** *************** ***@posting.goo gle.com...
I'm exporting a large file from a large Production database (SQL).
Users are currently updating and inserting new records.


Is it 24hr updating or is there a break during the night?
Does the export take a snapshot of the data when it starts ? or will
it freeze the database so all udpates/inserts happen after the export
completes?


Snapshot.
Also, how do I get the delta of data that wasn't exported, if I want
to get the difference the next day?


Comparitive reporting on some key field to provide stats.
OTOH these import tasks can be automated and scheduled.
If the database shows no activity at 3:00am daily, do it then.

Jul 20 '05 #3
"Angel Cat" <ki***********@ hotmail.com> wrote in message
news:9b******** *************** ***@posting.goo gle.com...
THe database is in use 24 hours a day. I need to take a dump of the
data and and make some updates but what happens when a user is updting
while I take a dump. Does DTS freeze the data when I'm exporting?
Effectively it does a snapshot.
ALso, is there a way I can take the difference easily?
The quantitative difference can be approximated in the first
instance by publishing the rowcount of the table "as at snapshot"
as distinct from the rowcount of the realtime SQL table which
can be easily obtained dynamically between loads. This will
represent (net) rows to be added/deleted.

Operationally this will imply part of the export process
will be to write the "last record included" type of thing
to some local table.

The quantitative differences are more difficult issues to deal
with but obviously you need to decide what elements of the
data you wish to keep track of during inter-load build-ups.
These you can add to the rowcount info if/when req'd.

Another idle thought here includes a master-publication
register accessible to the distribution group (who are getting
your export file) which is updated at every publication with
relevant information, and coupled with a realtime query into
SQL to compare nowtime with last publication.

Thank yoU!

"mountain man" <hobbit@souther n_seaweed.com.o p> wrote in message

news:<38******* ***********@new s-server.bigpond. net.au>...
"Angel Cat" <ki***********@ hotmail.com> wrote in message
news:9b******** *************** ***@posting.goo gle.com...
I'm exporting a large file from a large Production database (SQL).
Users are currently updating and inserting new records.


Is it 24hr updating or is there a break during the night?
Does the export take a snapshot of the data when it starts ? or will
it freeze the database so all udpates/inserts happen after the export
completes?


Snapshot.
Also, how do I get the delta of data that wasn't exported, if I want
to get the difference the next day?


Comparitive reporting on some key field to provide stats.
OTOH these import tasks can be automated and scheduled.
If the database shows no activity at 3:00am daily, do it then.

Jul 20 '05 #4
Angel Cat,

It was my understanding that SQL 7 and 2000 have a snapshot of the data "as
of" the end time of the databases.
If you start your backup at 6pm and users are inserting and updating, and
your database backup finishes at 6:30pm, your backup will be as of 6:30pm.

MSSQL 6.5 had a snapshot of the data at 6pm. Assuming the example above.

Oscar....

"Angel Cat" <ki***********@ hotmail.com> wrote in message
news:9b******** *************** ***@posting.goo gle.com...
I'm exporting a large file from a large Production database (SQL).

Users are currently updating and inserting new records.

Does the export take a snapshot of the data when it starts ? or will
it freeze the database so all udpates/inserts happen after the export
completes?

Also, how do I get the delta of data that wasn't exported, if I want
to get the difference the next day?

Thank yoU!!!

Jul 20 '05 #5

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

3
9248
by: sridevi | last post by:
Hello How to export data from ms-access database to excel worksheet using ASP. mainly i need to export data to multiple worksheets. it is very urgent to us. i have a sample code which works only exporting to single worksheet. but i need to export data to multiple worksheets. it is very urgent to us. so please help me in code.
1
7495
by: Janne Ruuttunen | last post by:
Hello DB2 people, I'm having problems exporting >= 250000 lobs to IXF files with the LOBSINFILE option, using a legacy DB2 2.1 system on Win NT. If I don't specify a path for the lobs, defining more than 250 base names for the lobs leads to an error message something like "DB2 encountered an unexpected error when sending the query to the backend process" (I don't have the exact message at hand). It doesn't matter how short the base...
5
5536
by: Jayjay | last post by:
Is it possible to export a report to word and have it include the graphics that are in the report? I'd like to take some of our reports and export them to word so we can email those to the client, but when I export, I lose the logo as well as any graphics (grey line separaters, etc) and only get the text of the reports.
4
3437
by: Dom Hicklin | last post by:
I have created a form onto which images can be dropped and thus added to the OLE field of a Table (Access 2000 linked to SQL 2000 server). I use the Stephen Lebans ExportOLE function to do this and it creates images on my shared drive beautifully! Being new at this I wondered if there is an easy way of taking the image whatever it's size when pasted and always exporting it as 66*75?
0
1857
by: Stephan Golux | last post by:
Hello. I am using an access 97 application that exports a report to RTF format, which is subsequently emailed to various people. The main informational field in the report is a free form memo field which can be very short or very long. When the report is created in access, the formatting is fine. If you print it, is fine. No problem.
2
2310
by: pmud | last post by:
Hi, I am exporting data from an EDITABLE DATA GRID EXCEL. But the 1st column in data grid is Edit Column. I want to display all columns in Excel except for the Edit column. The following code which I am using allows exporting only from text data from data grid & not from Edit columns which are link buttons. How to leave this column while displaying data from data grid in Excel?
2
2415
by: bienwell | last post by:
Hi, I have a question about exporting data from datagrid control into Excel file in ASP.NET. On my Web page, I have a linkbutton "Export data". This link will call a Sub Function to perform exporting ALL data from the datagrid control. Exporting data works fine when I show all data on the datagrid control. I'd like to shows only 30 records on the datagrid control instead of ALL data using page navigation, and perform exporting...
3
2053
by: David P. Donahue | last post by:
I'm re-writing an application in C# that was originally written in Delphi 7. The heart of the application is a DataSet displayed in a DataGrid. One of the main functions of the previous application was to save the data to a file (it was XML, but the format is unimportant) that can be re-loaded into the DataSet at a later time. (The reason for this was that the queries which populate the DataSet can take a while to run, and people...
1
1939
by: cmgmyr | last post by:
Hey All, I'm having a little problem with exporting data from my database. The problem is that the query seems to be too much for PHP and MySQL to handle since it is timing out. I have the timeout set right now at 3 minutes. I can run this in phpMyAdmin and it usually takes 4-5 minuted to complete. I do not want to have to make the client wait that long for this. This is part of an import/export Excel function that I have made. Here is...
0
9563
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
10144
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
0
9997
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
1
9937
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
0
9822
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
1
7366
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
5270
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
0
5405
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
3
2793
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.