473,856 Members | 1,546 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

DB2 Tools/tuning to help performance over high network latency sites?

Hello again all..
We have a giant application from a giant software vendor that has very
poor SQL.
It's a PLM CAD application, that makes a call to the db for every cad
node in the assembly.
So for an assembly with many parts, from remote locations, the
performance goes out the window.
Locally, it all works fine because network latency is <1ms. But some
remote sites we have (that are growing) latency can be as high as
80-100ms.
We've opened many PMR's with the software vendor, they are somewhat
willing to not help, saying our expectations are too high. Nice..
Anyhow, what we notice when we put traces/network sniffers on to try
and figure out where the slowdown is coming from, are many many calls
to the DB with small simple SQL. Each call is initiated in it's own
bubble and is thus subjected to the 80ms wait. The speed is ok, it's
the latency that is killing it.
We've done many things to try and improve the load times, but with
little success.

Local assembly load time: 12s
Current Remote Assembly load time: 59s

The customer would like to see times in the 20s to be happy.

What I'm wondering is, are there any tools or tricks out there that
could help us? Something to collect/intercept sql and send a bunch of
SQL at once, like at a few second interval, instead of bombarding the
server with hundreds of individual calls? Tuning? Anything we can do
db2 wise to help it?

Any help is much appreciated.
Thanks

Ken

Sep 26 '07 #1
4 3514
73********@cent urytel.net wrote:
Hello again all..
We have a giant application from a giant software vendor that has very
poor SQL.
It's a PLM CAD application, that makes a call to the db for every cad
node in the assembly.
So for an assembly with many parts, from remote locations, the
performance goes out the window.
Locally, it all works fine because network latency is <1ms. But some
remote sites we have (that are growing) latency can be as high as
80-100ms.
We've opened many PMR's with the software vendor, they are somewhat
willing to not help, saying our expectations are too high. Nice..
Anyhow, what we notice when we put traces/network sniffers on to try
and figure out where the slowdown is coming from, are many many calls
to the DB with small simple SQL. Each call is initiated in it's own
bubble and is thus subjected to the 80ms wait. The speed is ok, it's
the latency that is killing it.
We've done many things to try and improve the load times, but with
little success.

Local assembly load time: 12s
Current Remote Assembly load time: 59s

The customer would like to see times in the 20s to be happy.

What I'm wondering is, are there any tools or tricks out there that
could help us? Something to collect/intercept sql and send a bunch of
SQL at once, like at a few second interval, instead of bombarding the
server with hundreds of individual calls? Tuning? Anything we can do
db2 wise to help it?
I don't think it's that simple.
There are means to do batching but they have to be initiated by the
application.
The problem is that fundamentaly the app is unlikely to send a new SQL
statement before it has received the results of the previous ones. So I
doubt that problem is solvable transparently to the application.

Do you have an IBM rep whom you can engage? Perhaps throwing around a
bit more weight will help to get your app vendors attention.
If the app vendor needs help tuning it wouldn't be the first time we
help with that...

Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab
Sep 26 '07 #2
On Sep 26, 11:38 am, Serge Rielau <srie...@ca.ibm .comwrote:
73k5bla...@cent urytel.net wrote:
Hello again all..
We have a giant application from a giant software vendor that has very
poor SQL.
It's a PLM CAD application, that makes a call to the db for every cad
node in the assembly.
So for an assembly with many parts, from remote locations, the
performance goes out the window.
Locally, it all works fine because network latency is <1ms. But some
remote sites we have (that are growing) latency can be as high as
80-100ms.
We've opened many PMR's with the software vendor, they are somewhat
willing to not help, saying our expectations are too high. Nice..
Anyhow, what we notice when we put traces/network sniffers on to try
and figure out where the slowdown is coming from, are many many calls
to the DB with small simple SQL. Each call is initiated in it's own
bubble and is thus subjected to the 80ms wait. The speed is ok, it's
the latency that is killing it.
We've done many things to try and improve the load times, but with
little success.
Local assembly load time: 12s
Current Remote Assembly load time: 59s
The customer would like to see times in the 20s to be happy.
What I'm wondering is, are there any tools or tricks out there that
could help us? Something to collect/intercept sql and send a bunch of
SQL at once, like at a few second interval, instead of bombarding the
server with hundreds of individual calls? Tuning? Anything we can do
db2 wise to help it?

I don't think it's that simple.
There are means to do batching but they have to be initiated by the
application.
The problem is that fundamentaly the app is unlikely to send a new SQL
statement before it has received the results of the previous ones. So I
doubt that problem is solvable transparently to the application.

Do you have an IBM rep whom you can engage? Perhaps throwing around a
bit more weight will help to get your app vendors attention.
If the app vendor needs help tuning it wouldn't be the first time we
help with that...

Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab
I am an IBM rep. Well, I'm a tech, working with many sales reps, and
no, we can't bend the app vendor. We've been trying. I've shown them
where a simple operation is taking 837 queries to the DB, when I could
get the same results in less than 10.

I've been looking into DB2 Q Replication, it seems like that might be
able to help us. I've looked at SQL replication before, but the
snapshots are too heavy to run constantly on the database master, and
thus becomes not really real time. The new Q Replication stuff looks
very interesting. Do you know why they say in hub and spoke setup Q
Replication is not so good? We have one master location, and 6 remote
sites we'd like to use this at. Remote sites mostly read, but also
would need to write as well. The only issue that really jumps out at
me is the number of fail points in the whole setup. Websphere, it's
database, mq series quues, app server, db server...adds alot of
complexity, but if it gives us the response we need, it might be worth
it.

Sep 26 '07 #3
73********@cent urytel.net wrote:
I am an IBM rep. Well, I'm a tech, working with many sales reps, and
no, we can't bend the app vendor. We've been trying. I've shown them
where a simple operation is taking 837 queries to the DB, when I could
get the same results in less than 10.
*sigh*
I've been looking into DB2 Q Replication,
ST or email and I hook you up with Q-Rep skills.

Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab
Sep 26 '07 #4
Ken,

You might also take a look at GRIDSCALE. I'm an ITS at xkoto, I can
provide you with any technical information on the product. It can also
be configured for local reads, remote-write. This may be simpler to
implement and maintain than Q-rep in a hub-and spoke architecture.

Paul LaPointe,
Systems Engineer,
xkoto Inc.
E: pa***********@x koto.com

W: www.xkoto.com
xkoto is a winner of the 2007 Deloitte Fast 50 Companies-to-Watch
award http://www.xkoto.com/pressrelease/070920-deloitte.php
On Sep 26, 3:47 pm, Serge Rielau <srie...@ca.ibm .comwrote:
73k5bla...@cent urytel.net wrote:
I am an IBM rep. Well, I'm a tech, working with many sales reps, and
no, we can't bend the app vendor. We've been trying. I've shown them
where a simple operation is taking 837 queries to the DB, when I could
get the same results in less than 10.

*sigh*
I've been looking intoDB2Q Replication,

ST or email and I hook you up with Q-Rep skills.

Cheers
Serge
--
Serge RielauDB2Soluti ons Development
IBM Toronto Lab

Sep 28 '07 #5

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

0
3507
by: abcd | last post by:
kutthaense Secretary Djetvedehald H. Rumsfeld legai predicted eventual vicmadhlary in Iraq mariyu Afghmadhlaistmadhla, kaani jetvedehly after "a ljetvedehg, hard slog," mariyu vede legai pressed Pentagjetvedeh karuvificials madhla reachathe strategy in karkun campaign deshatinst terrorism. "mudivae maretu winning or losing karkun global varti jetvedeh terror?" Mr. Rumsfeld adugued in a recent memormariyuum. vede velli jetvedeh madhla...
21
4846
by: dub | last post by:
Hello web folks... I've been desigining web pages for 13 years using my trusty text editor (UltraEdit) and in depth knowledge of HTML. I'm truly a text editor ninja at this point. I am frequently using regular expressions to search and replace in multiple files. I also use many different copy buffers and know all the keyboard shortcuts like the back of my hand. The point is... it's comfortable. Unfortunately, it's become just too...
4
6421
by: Roland Hedberg | last post by:
Hi! I need a fast protocol to use between a client and a server, both sides written i Python. What the protocol has to accomplish is extremely simple; the client sends a number of lines (actually a RDF) and the server accepts or rejects the packet. That's all ! Now, presently I'm using Twisted and XMLRPC ( why so is a long
1
1782
by: share-postgres | last post by:
Hi All, I have recently started evaluating Postgresql 7.4.2 to replace some *cough* more proprietary database systems... Thanks to the _excellent_ documentation (a point I cannot overemphasize) I was up and running in no time, and got a first test application running on the native C interface. There is just one point where I found the documentation lacking any description and practical hints (as opposed to all other topics), namely...
4
2180
by: Michael | last post by:
Hi! (OK, slightly silly subject line :) I'm extremely pleased to say - Kamaelia 0.4.0 has been released! What's New & Changed? =====================
15
2588
by: Jay | last post by:
I have a multi threaded VB.NET application (4 threads) that I use to send text messages to many, many employees via system.timer at a 5 second interval. Basically, I look in a SQL table (queue) to determine who needs to receive the text message then send the message to the address. Only problem is, the employee may receive up to 4 of the same messages because each thread gets the recors then sends the message. I need somehow to prevent...
13
4614
by: atlaste | last post by:
Hi, I'm currently developing an application that uses a lot of computational power, disk access and memory caching (to be more exact: an information retrieval platform). In these kind of applications the last thing that remains is bare performance tuning. So for example, you can do an 'if then else' on a bit like a 'case/ switch', an 'if/then/else' and as a multiplication with a static buffer. Or, you can do sorting with an inline...
0
1544
by: ianwr | last post by:
Hi, I was wondering if anyone could shed any light on performance problems we are having with sql 2005. We have 3 boxes which are all 64bit itanium boxes (4 CPU) connected to a 145 spindle SAN using a 2gb FC card. All 3 servers also have identical builds of windows 2003 sp1. The performance on the 2005 boxes has always seemed to be worse than the 2000 box for some reason. to checkout the san performance i ran sqlio and when the box is...
3
2581
by: aernst | last post by:
I found some helpful replies to someone's post regarding data base replication. I started approaching my problem pretty much the same way but need someone with way more knowledge than me to provide guidance. Basically I know very little about these things but want to learn so please bear with me. The symptoms: I created a very very small MS Access DB (first one - indicative of current knowledge level). It did what it was supposed to do,...
0
9765
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
1
10795
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
0
10390
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
0
9536
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
7934
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
5763
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
0
5962
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
1
4581
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
3
3203
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.