Hi,
we are using DB2 v8.1 on Linux64 for a DW application. We have a
table with around 800 million records in it. For performance purpose we
created about 2 or 3 MQT's(summary tables) on the table with refresh
immediate option. But when developers come up with some changes on the
MQT(which happens all most once every month). We drop the MQT and
recreate it. When the table was small we never had problem. But later
on we started having the transaction log full error.
As a work around, we are dropping all the MQTs. Renaming the table to
someother name. And then create the table again, create the MQT and
then insert the 800 million records again. Which requires around 3 -4
hrs time to reinsert all the records back into the table. Is there
anyother simple way to solve this problem.
Regards,
Koushik S
4  3357 
Assuming that you're using circular logging; did you try increasing the
log space?
Phil Sherman
lpmsk wrote:
Hi,
we are using DB2 v8.1 on Linux64 for a DW application. We have a
table with around 800 million records in it. For performance purpose we
created about 2 or 3 MQT's(summary tables) on the table with refresh
immediate option. But when developers come up with some changes on the
MQT(which happens all most once every month). We drop the MQT and
recreate it. When the table was small we never had problem. But later
on we started having the transaction log full error.
As a work around, we are dropping all the MQTs. Renaming the table to
someother name. And then create the table again, create the MQT and
then insert the 800 million records again. Which requires around 3 -4
hrs time to reinsert all the records back into the table. Is there
anyother simple way to solve this problem.
Regards,
Koushik S
Hi Phil,
Yes, We are using circular log.
We already increased the log file size. Our log file size is 30 000
pages. Increasing more than this resulted in slower performance of the
ETL process the load the DW.
Log Retain No
Log primary 20
Log secondary 30
This combination worked good for us. So we retained it. Is there
anything I need to change in this.
Regards,
Koushik S
Phil Sherman wrote:
Assuming that you're using circular logging; did you try increasing the
log space?
Phil Sherman
lpmsk wrote:
Hi,
we are using DB2 v8.1 on Linux64 for a DW application. We have a
table with around 800 million records in it. For performance purpose we
created about 2 or 3 MQT's(summary tables) on the table with refresh
immediate option. But when developers come up with some changes on the
MQT(which happens all most once every month). We drop the MQT and
recreate it. When the table was small we never had problem. But later
on we started having the transaction log full error.
As a work around, we are dropping all the MQTs. Renaming the table to
someother name. And then create the table again, create the MQT and
then insert the 800 million records again. Which requires around 3 -4
hrs time to reinsert all the records back into the table. Is there
anyother simple way to solve this problem.
Regards,
Koushik S
It didn't quite work - your update job failed!
I'd try upping the "log secondary" parameter to at least 80 (doubling
the total log space) and verify that you have the disk space to support
it. After the job completes, do a "GET SNAPSHOT FOR DATABASE ON db_name"
and look at the "Maximum secondary log space used" line to determine how
to properly set the parameter.
Phil Sherman
lpmsk wrote:
Hi Phil,
Yes, We are using circular log.
We already increased the log file size. Our log file size is 30 000
pages. Increasing more than this resulted in slower performance of the
ETL process the load the DW.
Log Retain No
Log primary 20
Log secondary 30
This combination worked good for us. So we retained it. Is there
anything I need to change in this.
Regards,
Koushik S
Phil Sherman wrote:
>>Assuming that you're using circular logging; did you try increasing the
log space?
Phil Sherman
lpmsk wrote:
>>>Hi,
we are using DB2 v8.1 on Linux64 for a DW application. We have a
table with around 800 million records in it. For performance purpose we
created about 2 or 3 MQT's(summary tables) on the table with refresh
immediate option. But when developers come up with some changes on the
MQT(which happens all most once every month). We drop the MQT and
recreate it. When the table was small we never had problem. But later
on we started having the transaction log full error.
As a work around, we are dropping all the MQTs. Renaming the table to
someother name. And then create the table again, create the MQT and
then insert the 800 million records again. Which requires around 3 -4
hrs time to reinsert all the records back into the table. Is there
anyother simple way to solve this problem.
Regards,
Koushik S
lpmsk wrote:
Hi,
we are using DB2 v8.1 on Linux64 for a DW application. We have a
table with around 800 million records in it. For performance purpose we
created about 2 or 3 MQT's(summary tables) on the table with refresh
immediate option. But when developers come up with some changes on the
MQT(which happens all most once every month). We drop the MQT and
recreate it. When the table was small we never had problem. But later
on we started having the transaction log full error.
You can also do:
db2 +c alter table mqt activate not logged initially
db2 refresh table mqt;
db2 commit This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics | |
by: MaKiT |
last post by:
I have a program which on start makes a 4x4 grid of tiles. These tiles
are all blank. Two Array variables hold the position of 8 pairs of
images. Then when you click a tile it is uncovered and you try to
match up.
I attempted to modify this so it is a 8x8 grid with 16 pairs of
images. The only problem is that only some random tiles seem to be
placed and not all of them.
Heres the original start part of the code:
|
by: Peter Olcott |
last post by:
www.halting-problem.com
|
by: ashu |
last post by:
hi to all,
Please read the following ques. first.
assume that a bank maintains 2 kinds of accounts for
customers one called as
savings accounts & other as current account.
the savings account provides simple interest &
withdraw facilities but no check book facilities.
the current account provides check book facilities but
no interest.
|
by: Jon Davis |
last post by:
If I have a class with a virtual method, and a child class that overrides
the virtual method, and then I create an instance of the child class AS A
base class...
BaseClass bc = new ChildClass();
.... and then call the virtual method, why is it that the base class's method
is called instead of the overridden method? How do I fix this if I don't
know at runtime what the child class is? I'm using
Activator.CreateInstance() to load the...
|
by: Ammar |
last post by:
Dear All,
I'm facing a small problem.
I have a portal web site, that contains articles, for each article, the end
user can send a comment about the article.
The problem is:
I the comment length is more that 1249 bytes, then the progress bar of the
browser will move too slow and then displaying that the page not found!!!!
If the message is less than or equal to 1249 then no problem.
| | |
by: Dany |
last post by:
Our web service was working fine until we installed .net Framework 1.1 service pack 1. Uninstalling SP1 is not an option because our largest customer says service packs marked as "critical" by Microsoft must be installed on their servers.
Now german Umlaute (ä, ü, ö) and quotes are returned incorrectly in SOAP fault responses.
This can be easily verified:
Implement the following in a web service method (just raises a SOAPException with a...
|
by: Marcin Zmyslowski |
last post by:
Hello all!
I have the following problem with MS Access 2003 permissions.
I have two users. One is admin and the second one is user who has full
permissions to enter modify and read data.
I have one table and one queries which is based on this table.
This query is good working for these two users.
|
by: S. Justin Gengo |
last post by:
A while ago I submitted a bug report for a problem that occurrs when using
the admin tool. There is now a "permanent" fix available I thought I'd
share. First the problem was:
After running the Website - ASP.NET Configuration utility a xmlns
attribute is added to the
Web.config file. This attribute stops intellisense from
working.
Edited by Microsoft on 2005-11-08 at 03:58:05
|
by: Mike Collins |
last post by:
I cannot get the correct drop down list value from a drop down I have on my
web form. I get the initial value that was loaded in the list.
It was asked by someone else what the autopostback was set to...it is set to
false.
Can someone show me what I am doing wrong and tell me the correct way? Thank
you.
In the page load event, I am doing the following:
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look !
Part I. Meaning of...
|
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed.
This is as boiled down as I can make it.
Here is my compilation command:
g++-12 -std=c++20 -Wnarrowing bit_field.cpp
Here is the code in...
| | |
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
|
by: isladogs |
last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM).
In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules.
He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms.
Adolph will...
|
by: conductexam |
last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one.
At the time of converting from word file to html my equations which are in the word document file was convert into image.
Globals.ThisAddIn.Application.ActiveDocument.Select();...
|
by: TSSRALBI |
last post by:
Hello
I'm a network technician in training and I need your help.
I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs.
The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols.
I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
|
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
|
by: 6302768590 |
last post by:
Hai team
i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
| | |
by: bsmnconsultancy |
last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...
| |
