473,472 Members | 1,717 Online
Bytes | Software Development & Data Engineering Community
Create Post

Home Posts Topics Members FAQ

Moving data for reporting

Hi all,
I have 5 databases, each about 20GB in size. I need to copy the data to
a new server for reporting purposes. Initially I wanted to setup
transactional replication; however, the database schemas often change
(adding or modifying tables) and in order to accomodate those changes
through replication I would need to send a new snapshot each time a
change occurs. This is very time consuming.

So I decided instead to use log shipping, until I realized the
reporting databases would be unavailable during the period when the
transaction log was being applied. That also will not work.

So what does everyone else use? My only requirements are that the
reporting databases be available during business hours and there be
very little administration when it comes to changing the database
schema.

Thanks,
Josh

Jul 23 '05 #1
4 1109

"joshsackett" <jo*********@gmail.com> wrote in message
news:11**********************@z14g2000cwz.googlegr oups.com...
Hi all,
I have 5 databases, each about 20GB in size. I need to copy the data to
a new server for reporting purposes. Initially I wanted to setup
transactional replication; however, the database schemas often change
(adding or modifying tables) and in order to accomodate those changes
through replication I would need to send a new snapshot each time a
change occurs. This is very time consuming.

So I decided instead to use log shipping, until I realized the
reporting databases would be unavailable during the period when the
transaction log was being applied. That also will not work.

So what does everyone else use? My only requirements are that the
reporting databases be available during business hours and there be
very little administration when it comes to changing the database
schema.

Thanks,
Josh


What about simply using backup and restore? If they only have to be
available during business hours, then you have all night to do that, unless
of course you have multiple offices in multiple time zones, which would
reduce your maintenance window.

Simon
Jul 23 '05 #2
I need the data to be current, as they are reporting databases. The
most lag-time I can have is about 15 minutes.

Jul 23 '05 #3

"joshsackett" <jo*********@gmail.com> wrote in message
news:11*********************@g44g2000cwa.googlegro ups.com...
I need the data to be current, as they are reporting databases. The
most lag-time I can have is about 15 minutes.


Ah, well you didn't include that in your "only" requirements... :-) Probably
transactional replication is still the best option, given the time
constraint, and if you can manage the schema changes; you can replicate
adding and dropping columns, but whole tables may be more awkward.
Personally, I would be concerned if the schema is constantly changing, and
especially if it's changing during working hours, but I appreciate that this
may be out of your control. If you can implement schema changes only during
defined and planned maintenance windows, then you should be able to handle
the snapshots at the same time.

You might also want to post in microsoft.public.sqlserver.replication, given
that replication is quite a specialized area.

Simon
Jul 23 '05 #4
I suppose I did miss one of the more important requirements...

I think you are right and I've been going at this the wrong way.
Instead of trying to back fill schema changes on the fly it should be
built into a process.

Thanks.

Jul 23 '05 #5

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

0
by: Sunil Chaudhary | last post by:
JOB SUMMARY: The Business Analyst will be responsible for much of the modeling, tracking, reporting, analysis, and forecasting. The successful candidate will work with Business Managers to...
18
by: steve.anon | last post by:
Hi I'm a Java developer moving to windows only applications. Of course the first thing I thought was "well at least, without the VM now I can write desktop applications that run real fast". So I...
0
by: damian.rimmer | last post by:
I'm using a custom assembly (DPE) in reporting services, but I'm having problems getting the class library to find DB configuration settings in a config file. I'm using the excellent Data...
4
by: Ryan | last post by:
I'm trying to create a report (similar to access) in VB 2005. It appears that Crystal Reports is the recommended method. I created a Crystal Report, set up the data connection (using the Wizard...
1
by: C4rtm4N | last post by:
I'm about to embark on re-writing a database & bespoke web reporting application for our call centre & would like a little advice please. Currently the database has 10 tables containing summaried...
6
by: Senthil | last post by:
Hi All We are having a VB application on SQL. But we need to collect information from persons who will be offline to verify data and insert new data. Generally they will be entering the data in...
7
by: =?Utf-8?B?TW9iaWxlTWFu?= | last post by:
Hello everyone: I am looking for everyone's thoughts on moving large amounts (actually, not very large, but large enough that I'm throwing exceptions using the default configurations). We're...
1
by: =?Utf-8?B?UmljaA==?= | last post by:
In a database search application (vb2005), the user wants to be able to scroll through records using the mousewheel. The data display form contains textboxes for the main data and a datagridview...
5
by: Sanjay Pais | last post by:
I have a table with over 1.3 million rows. I am retrieving only 20 at a time using the with - over clauses In query analyser, the data is retrieved in under a second. When retrieving using the...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
1
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...
1
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new...
0
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
0
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated ...
0
muto222
php
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.