473,387 Members | 1,891 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,387 software developers and data experts.

Recommended Stretagy for Bi-Directional SQL DB Synchronization

Hi,

Our company is an independent Voice applications solution provider with
number clients using our suite. We have a CT application suite which is
running with Application Server and SQL Server 7 / 2000 as DB Engines
at the back end.

The SQL server has two databases configured:

Logging Database - Massive updates every second, the data grows
rapidly,

Configuration Database - Generally small-sized and updated
occasionally.

Now we want to have the reslience implemented on the server. We have to
synchronize the two databases 'real-timely' and in 'efficient'
manner, so that if Primary server or its Databases gets unavailable,
the users are seamlessly switched over to the Secondry server that will
have its own set of data updated and well synchronized.

Typically, it can be explained as follows:

1. We will have 2 database servers A - Primary (acting as publisher)
and B - Secondary (acting as subscriber). Our application will be
initially connected to A.

2. When A becomes unavailable (for whatever reason), the application
will fail-over to B.

3. All the users will be switched to server B and the updates are being
done accordingly without being replicated on Server A temporarily.

4. When A is back on-line, A needs to be brought up-to-date with B
automatically (In other words, I shouldn't have to manually export all
the data from B to A ).

Our requirements are:

- The system should support Bi-directional Synchronization
between both the servers for their set of databases (the logging and
configuration).

- There will be constant and heavy activity in Logging
Database, thus if one server gets down the data should be logged and
maintained as it is on second server and on fail-back no data-loss
should occur with minimum latency time.

- There could be a scenario when a server fails-over for a
week's time, there will be constant logging each second! Once it
fails-back the system should rapidly synchronize the data without
noticeable delay among the two server database sets.

- The system should also work fine if certain amount of
records are purged over a time period.

Our concern is, observing the above scenario, how any of your SQL
server replication strategy can help us achieve the requirements.
Thanks
John

Jul 23 '05 #1
4 1552
Ray
Well you certainly have a challenge. It's the "for whatever reason" clause
that has me concerned. You can only mitigate foreseeable issues. I
recommend you start by determining a list of events that would cause outages
or failures and work the list. Clustering with a good SAN and multiple
network paths will handle most of the situations but thre are a few that
clustering is not a solution for like Site DR, SAN issues, and data
manipulation errors.

<om******@gmail.com> wrote in message
news:11**********************@c13g2000cwb.googlegr oups.com...
Hi,

Our company is an independent Voice applications solution provider with
number clients using our suite. We have a CT application suite which is
running with Application Server and SQL Server 7 / 2000 as DB Engines
at the back end.

The SQL server has two databases configured:

Logging Database - Massive updates every second, the data grows
rapidly,

Configuration Database - Generally small-sized and updated
occasionally.

Now we want to have the reslience implemented on the server. We have to
synchronize the two databases 'real-timely' and in 'efficient'
manner, so that if Primary server or its Databases gets unavailable,
the users are seamlessly switched over to the Secondry server that will
have its own set of data updated and well synchronized.

Typically, it can be explained as follows:

1. We will have 2 database servers A - Primary (acting as publisher)
and B - Secondary (acting as subscriber). Our application will be
initially connected to A.

2. When A becomes unavailable (for whatever reason), the application
will fail-over to B.

3. All the users will be switched to server B and the updates are being
done accordingly without being replicated on Server A temporarily.

4. When A is back on-line, A needs to be brought up-to-date with B
automatically (In other words, I shouldn't have to manually export all
the data from B to A ).

Our requirements are:

- The system should support Bi-directional Synchronization
between both the servers for their set of databases (the logging and
configuration).

- There will be constant and heavy activity in Logging
Database, thus if one server gets down the data should be logged and
maintained as it is on second server and on fail-back no data-loss
should occur with minimum latency time.

- There could be a scenario when a server fails-over for a
week's time, there will be constant logging each second! Once it
fails-back the system should rapidly synchronize the data without
noticeable delay among the two server database sets.

- The system should also work fine if certain amount of
records are purged over a time period.

Our concern is, observing the above scenario, how any of your SQL
server replication strategy can help us achieve the requirements.
Thanks
John

Jul 23 '05 #2
On 2/12/05 1:34 PM, in article
v_*****************@newssvr17.news.prodigy.com, "Ray" <so*****@nowhere.com>
wrote:
Well you certainly have a challenge. It's the "for whatever reason" clause
that has me concerned. You can only mitigate foreseeable issues. I
recommend you start by determining a list of events that would cause outages
or failures and work the list. Clustering with a good SAN and multiple
network paths will handle most of the situations but thre are a few that
clustering is not a solution for like Site DR, SAN issues, and data
manipulation errors.

<om******@gmail.com> wrote in message
news:11**********************@c13g2000cwb.googlegr oups.com...
Hi,

Our company is an independent Voice applications solution provider with
number clients using our suite. We have a CT application suite which is
running with Application Server and SQL Server 7 / 2000 as DB Engines
at the back end.

The SQL server has two databases configured:

Logging Database - Massive updates every second, the data grows
rapidly,

Configuration Database - Generally small-sized and updated
occasionally.

Now we want to have the reslience implemented on the server. We have to
synchronize the two databases 'real-timely' and in 'efficient'
manner, so that if Primary server or its Databases gets unavailable,
the users are seamlessly switched over to the Secondry server that will
have its own set of data updated and well synchronized.

Typically, it can be explained as follows:

1. We will have 2 database servers A - Primary (acting as publisher)
and B - Secondary (acting as subscriber). Our application will be
initially connected to A.

2. When A becomes unavailable (for whatever reason), the application
will fail-over to B.

3. All the users will be switched to server B and the updates are being
done accordingly without being replicated on Server A temporarily.

4. When A is back on-line, A needs to be brought up-to-date with B
automatically (In other words, I shouldn't have to manually export all
the data from B to A ).

Our requirements are:

- The system should support Bi-directional Synchronization
between both the servers for their set of databases (the logging and
configuration).

- There will be constant and heavy activity in Logging
Database, thus if one server gets down the data should be logged and
maintained as it is on second server and on fail-back no data-loss
should occur with minimum latency time.

- There could be a scenario when a server fails-over for a
week's time, there will be constant logging each second! Once it
fails-back the system should rapidly synchronize the data without
noticeable delay among the two server database sets.

- The system should also work fine if certain amount of
records are purged over a time period.

Our concern is, observing the above scenario, how any of your SQL
server replication strategy can help us achieve the requirements.
Thanks
John



Active/Active Cluster.

-Greg

Jul 23 '05 #3
Ray
I usually recommend active/passive. Active/active only buys you the ability
to run SQL on both servers and if one fails all instances of SQL Server will
switch to running on the remaining servers. But if you have a need to run
more databases it's fine.

"Gregory Dean" <gd***@datapex.com> wrote in message
news:BE33C842.4E3D%gd***@datapex.com...
On 2/12/05 1:34 PM, in article
v_*****************@newssvr17.news.prodigy.com, "Ray"
<so*****@nowhere.com>
wrote:
Well you certainly have a challenge. It's the "for whatever reason"
clause
that has me concerned. You can only mitigate foreseeable issues. I
recommend you start by determining a list of events that would cause
outages
or failures and work the list. Clustering with a good SAN and multiple
network paths will handle most of the situations but thre are a few that
clustering is not a solution for like Site DR, SAN issues, and data
manipulation errors.

<om******@gmail.com> wrote in message
news:11**********************@c13g2000cwb.googlegr oups.com...
Hi,

Our company is an independent Voice applications solution provider with
number clients using our suite. We have a CT application suite which is
running with Application Server and SQL Server 7 / 2000 as DB Engines
at the back end.

The SQL server has two databases configured:

Logging Database - Massive updates every second, the data grows
rapidly,

Configuration Database - Generally small-sized and updated
occasionally.

Now we want to have the reslience implemented on the server. We have to
synchronize the two databases 'real-timely' and in 'efficient'
manner, so that if Primary server or its Databases gets unavailable,
the users are seamlessly switched over to the Secondry server that will
have its own set of data updated and well synchronized.

Typically, it can be explained as follows:

1. We will have 2 database servers A - Primary (acting as publisher)
and B - Secondary (acting as subscriber). Our application will be
initially connected to A.

2. When A becomes unavailable (for whatever reason), the application
will fail-over to B.

3. All the users will be switched to server B and the updates are being
done accordingly without being replicated on Server A temporarily.

4. When A is back on-line, A needs to be brought up-to-date with B
automatically (In other words, I shouldn't have to manually export all
the data from B to A ).

Our requirements are:

- The system should support Bi-directional Synchronization
between both the servers for their set of databases (the logging and
configuration).

- There will be constant and heavy activity in Logging
Database, thus if one server gets down the data should be logged and
maintained as it is on second server and on fail-back no data-loss
should occur with minimum latency time.

- There could be a scenario when a server fails-over for a
week's time, there will be constant logging each second! Once it
fails-back the system should rapidly synchronize the data without
noticeable delay among the two server database sets.

- The system should also work fine if certain amount of
records are purged over a time period.

Our concern is, observing the above scenario, how any of your SQL
server replication strategy can help us achieve the requirements.
Thanks
John



Active/Active Cluster.

-Greg

Jul 23 '05 #4
Yes, actually what we need is not a hot/wram standby system but
completely an automated fail-over system which seamlessly switches to
the secondary server and maintain all the transactions as they were
being handled on primary without having an effect at the clients' end.
Moreover, once the primary server is functional again, all the changes
and transactions that were done while it was offline will be
replicated/incremented to the primary server and the users should be
automatically and seamlessly switched back to the primary server.

This is what our requirements are. Do you still think that
active/active cluster is best for the scenario that we have?

Furthermore, what are the minimum hardware and software requirements in
case we go for a Fail-over Clustering solution with 2 nodes (i.e. 2 SQL
server machines)?

Thanks
John

Jul 23 '05 #5

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

0
by: DD | last post by:
Hi Guys! Just would like to share with you my experiense in this matter. I was trying to evaluate how suitable Oracle OLAP for our applications. As probably you did, I have downloaded from OTN...
0
by: V?ronique | last post by:
hi everyone, if you are a BI tool user, speak spanish, then you might be interested in decideo, which is a community of BI tool users. the newsletter is on: ...
0
by: YellowFin Announcements | last post by:
Announcing Yellowfin Version 2.4 release. (www.yellowfin.com.au) Existing SQLserver users can take advantage of this upgrade as soon as convenient. V2.4 Exciting changes in the latest...
3
by: ShihChengYu | last post by:
Dear all: How to convert color image to bi-level image? I have confronted one problem when I build my OCR project. I used an software API function to enhance my project, but the API only...
1
by: jimdandy | last post by:
Hi all, Am looking for some guidance/advice in terms of best practices for deploying a MS BI project. We have a relatively large BI system that we need to deploy between DEV/QA/UAT/PROD and...
0
by: YellowFin | last post by:
Yellowfin International today announced that Yellowfin has joined IBM's Partner Program, and that the Yellowfin BI Suite are now validated on IBM's popular DB2 9 database. This partnership opens...
0
by: WI Projects | last post by:
Hi, A CMM Level 5 company is looking for Microsoft Business Intelligence (MS BI) professionals for its Hyderabad location. There is a an element of onsite travel & work to this position. ...
15
by: rinmanb70 | last post by:
I use a db for keeping up with my checkbook and I'm having trouble setting up a new functionality. I get paid every two weeks on Friday, and I need a report to figure my balance that includes only...
0
by: YellowFin Announcements | last post by:
Yellowfin, Powered by J2EE, Jasper, BIRT, Spring, jfreeChart Advanta releases ATLAS BI using Yellowfin Business Intelligence 3rd of August, 2007 - Advanta Software, specialist software...
0
by: zyro | last post by:
Hi, This is Michael Bowen. I've put together cubegeek.com as a new and hopefully exciting site for the BI professional to network, share get information. This is the industry's first portal...
0
by: taylorcarr | last post by:
A Canon printer is a smart device known for being advanced, efficient, and reliable. It is designed for home, office, and hybrid workspace use and can also be used for a variety of purposes. However,...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: aa123db | last post by:
Variable and constants Use var or let for variables and const fror constants. Var foo ='bar'; Let foo ='bar';const baz ='bar'; Functions function $name$ ($parameters$) { } ...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.