473,795 Members | 2,410 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

validation testing -- use TPC-C? (or what?)

z
How can validation testing on DBMSs such as DB2 and Oracle be performed?

Is there a quick commonly used publicly available DBMS test that can be
used?

Could TPC-C be used? If so, where can TPC-C be obtained? (Is is publicly
available?)

Thanks.
Dec 13 '05 #1
6 3891
My TPC knowledge is a bit dated, so take it with a grain of salt.

First of all, make sure you are looking for the right benchmark for the
type of processing you are interested in. For example, TPC-C is a benchmark
that is indicative primarily of rapid transaction processing. There are
other benchmarks for workloads that are more DSS-intensive (TPC-H or TPC-D)
or web-intensive (TPC-W).

Second, I don't know of any publicly available TPC-C kits. It is my
understanding that the source code used for TPC-C benchmark applications are
closely-guarded secrets, since the application code itself might contain
code that accounts for significant performance improvements.
--
--------------------
Larry Menard
"Defender of Geese and of All Things Natural"
"z" <z@y.x.invali d> wrote in message
news:6O******** ***********@new ssvr27.news.pro digy.net...
How can validation testing on DBMSs such as DB2 and Oracle be performed?

Is there a quick commonly used publicly available DBMS test that can be
used?

Could TPC-C be used? If so, where can TPC-C be obtained? (Is is publicly
available?)

Thanks.

Dec 13 '05 #2
"Larry Menard" <ro**@GoSpamYou rself.com> wrote in message
news:To******** *************** *******@rogers. com...
My TPC knowledge is a bit dated, so take it with a grain of salt.

First of all, make sure you are looking for the right benchmark for the
type of processing you are interested in. For example, TPC-C is a
benchmark that is indicative primarily of rapid transaction processing.
There are other benchmarks for workloads that are more DSS-intensive
(TPC-H or TPC-D) or web-intensive (TPC-W).

Second, I don't know of any publicly available TPC-C kits. It is my
understanding that the source code used for TPC-C benchmark applications
are closely-guarded secrets, since the application code itself might
contain code that accounts for significant performance improvements.
--
--------------------
Larry Menard
"Defender of Geese and of All Things Natural"

The TPC benchmarks are published at www.tpc.org

I have reproduced the TPC-H (decision support) benchmark and the tpc.org
site provides you with everything you will need, including the test data
generator program. You may find it a bit difficult to compile the test data
generator program successfully, but I was able to get it to work after
changing a few compile parms. They also supply the schema and queries. You
will want to look at the vendor docs for each benchmark to pick up any
customization they have done to queries to allow for slight variations in
SQL syntax between the databases.

The TPC-C OLTP benchmark may be harder to reproduce as mentioned above, but
details of the benchmarks are published by each vendor on the website so you
could look there.
Dec 13 '05 #3
Larry Menard wrote:
My TPC knowledge is a bit dated, so take it with a grain of salt.

First of all, make sure you are looking for the right benchmark for the
type of processing you are interested in. For example, TPC-C is a benchmark
that is indicative primarily of rapid transaction processing. There are
other benchmarks for workloads that are more DSS-intensive (TPC-H or TPC-D)
or web-intensive (TPC-W).

Second, I don't know of any publicly available TPC-C kits. It is my
understanding that the source code used for TPC-C benchmark applications are
closely-guarded secrets, since the application code itself might contain
code that accounts for significant performance improvements.

Larry,

Actually the rules demand full disclosure. And everything should be
available rom the TPC website. Starting from the algorithms to generate
the data to the exact configuration and sourcecodee for any run.
In theory a competitor can validate a TPC result inhouse
(I doubt that this has ever been done though).
Due to this rule to expose these benchmarks can be challenged.
E.g. Oracle successfully challenged the first SQL Server 2000 TPC-C
benchmark using clustering (partitioned views) because SS2000 couldn't
update the partitioning key.

Cheers
Serge
--
Serge Rielau
DB2 SQL Compiler Development
IBM Toronto Lab
Dec 13 '05 #4
I stand (or actually, sit) corrected.

--
--------------------
Larry Menard
"Defender of Geese and of All Things Natural"
"Serge Rielau" <sr*****@ca.ibm .com> wrote in message
news:40******** *****@individua l.net...
Larry Menard wrote:
My TPC knowledge is a bit dated, so take it with a grain of salt.

First of all, make sure you are looking for the right benchmark for
the type of processing you are interested in. For example, TPC-C is a
benchmark that is indicative primarily of rapid transaction processing.
There are other benchmarks for workloads that are more DSS-intensive
(TPC-H or TPC-D) or web-intensive (TPC-W).

Second, I don't know of any publicly available TPC-C kits. It is my
understanding that the source code used for TPC-C benchmark applications
are closely-guarded secrets, since the application code itself might
contain code that accounts for significant performance improvements.

Larry,

Actually the rules demand full disclosure. And everything should be
available rom the TPC website. Starting from the algorithms to generate
the data to the exact configuration and sourcecodee for any run.
In theory a competitor can validate a TPC result inhouse
(I doubt that this has ever been done though).
Due to this rule to expose these benchmarks can be challenged.
E.g. Oracle successfully challenged the first SQL Server 2000 TPC-C
benchmark using clustering (partitioned views) because SS2000 couldn't
update the partitioning key.

Cheers
Serge
--
Serge Rielau
DB2 SQL Compiler Development
IBM Toronto Lab

Dec 14 '05 #5

"z" <z@y.x.invali d> wrote in message
news:6O******** ***********@new ssvr27.news.pro digy.net...
How can validation testing on DBMSs such as DB2 and Oracle be performed?

Is there a quick commonly used publicly available DBMS test that can be
used?

Could TPC-C be used? If so, where can TPC-C be obtained? (Is is publicly
available?)


If you want to validate a database for use in your business environment, the
best thing to do is build a simple prototype of your business app and test
it on the databases you're considering. Both DB2 and Oracle come in
"express" editions, and should be full-featured enough to put a prototype
through it's paces. This way you can play with performance scaling, various
DDL options, backup/restore and other things that you're bound to do when in
production, and really get a feel for what works best in the intended
environment.

To echo someone else's comments -- using an off-the-shelf benchmark (such as
any of the TPC benchmarks) may not be anywhere near close to what your
business needs are, and thus you'd end up with something that isn't a good
fit. It's much like deciding to buy a sports car because it was the fastest
and flashiest, and then finding out that your wife is pregnant with triplets
and you should have bought a mini-van :)

--
Matt Emmerton
Dec 14 '05 #6
Matt Emmerton wrote:
"z" <z@y.x.invali d> wrote in message
news:6O******** ***********@new ssvr27.news.pro digy.net...
How can validation testing on DBMSs such as DB2 and Oracle be performed?

Is there a quick commonly used publicly available DBMS test that can be
used?

Could TPC-C be used? If so, where can TPC-C be obtained? (Is is publicly
available?)

If you want to validate a database for use in your business environment, the
best thing to do is build a simple prototype of your business app and test
it on the databases you're considering.


Absolutely. TCP-? has absolutely nothing to do with the real world and
will provide you zero information related to your specific hardware,
your specific operating system, your specific configuration, your
specific application or anything else.
--
Daniel A. Morgan
http://www.psoug.org
da******@x.wash ington.edu
(replace x with u to respond)
Dec 14 '05 #7

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

5
5587
by: Mark A | last post by:
DB2 UDB V8.2, eServer p595, and TotalStorage FASt900 published an amazing TPC-C result of 3,210,540 tpmC at a price/performance of $5.19/tpmC, demonstrating 2.7x better performance than Oracle RAC. Never before has any database vendor taken such a decisive leadership position in this benchmark. In fact, this new DB2 result leads the previous record by a margin wider than the top results of Oracle and Microsoft combined! ...
6
8466
by: O. Kouame | last post by:
Hi all, Does anyone know where I can find an implementation of the TPC-C benchmark for SQL Server 2000 (preferably written in .NET) ? All I can find is an old Microsoft implementation of TPC-B written in C, and my C skills are rusty to say the least :( Oracle seems to have Hammerora, so maybe someone ported it to SQL Server ? In the worst case, if anyone would be interested in collaborating on writing such an implementation, I'd be more...
67
5354
by: Scott Meyers | last post by:
I have a web site that, due to maintenance by several people, some of whom are fairly clueless about HTML and CSS, etc. (notably me), has gotten to the point where I'm pretty sure it's suffering from bit rot. Though the pages seem to display okay under IE and FF, I really think it's time for an under-the-hood cleaning. I recently received a copy of Molly Holzschlag's "Spring Into HTML and CSS," and in the first chapter, she makes a big...
3
5441
by: Gaetano Mendola | last post by:
I found this article: http://www.serverwatch.com/news/article.php/10824_1126981_Ext that is clear out dated, it's anyway a good comparison with mysql. Do you know if someone did the TPC-C test with 7.4.X version ?
3
4230
by: UnixSlaxer | last post by:
Hello, I am trying to validate all the 22-Queries in the TPC-H Benchmark on DB2 UDB 8.2, I am having a little bit of trouble with Query #8 The result should be: YEAR MKT_SHARE 1995 .03 1996 .04
7
736
by: Mathew Hill | last post by:
I am a beginner to the more technical aspects of Microsoft Access (2000) and was wondering if any one can help? I have a field in a table called: ADMIN NUMBER This field should have 4 characters and ONLY NUMBERS should be inputted. Does anyone know what the validation rule should be for this field?
0
2162
by: Boltar | last post by:
Hello, I am trying to use a CustomValidator control to perform client-side validation via a server callback. I have an example below that validates if a textbox contains an odd number. I realize that I can use client-side javascript entirely for this, I have just created a simplified example. My actual callback validation
6
2869
by: Shalu Gupta | last post by:
Hello, We are trying to import the TPC-H data into postgresql using the COPY command and for the larger files we get an error due to insufficient memory space. We are using a linux system with Postgresql-7.3.4 Is it that Postgresql cannot handle such large files or is there some other possible reason.
0
1084
by: Lucky Star | last post by:
Hello All, We have the following requirement. Please send matching profiles along with the rate Expectations, Availability and Contact Details for the same. Position: Lead Validation Consultant
0
9672
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
9519
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
10214
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
0
10001
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
0
9042
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
7538
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
1
4113
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
2
3723
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
3
2920
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.