472,967 Members | 2,008 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 472,967 software developers and data experts.

Table Partitioning on a RAID 5 Server

Is there any benefit in creating seperate file groups for a partitioned
table on a multi-processor server with RAID5 and 1 Logical Drive?

Dec 1 '06 #1
8 2231
IMHO, No. I assume you have one raid controller and as you state, one
Logical Drive.
However, there might be a slight difference with windows if you have
two logical drives defined at the O/S level.

Rob.
ju**********@gmail.com wrote:
Is there any benefit in creating seperate file groups for a partitioned
table on a multi-processor server with RAID5 and 1 Logical Drive?
Dec 2 '06 #2
Does this hold true for creating mutiple filegroups for the database
itself? even if it is 100G + in size?

Dec 2 '06 #3
RAID 5 should be no where near a database server now-a-days; use RAID 1 or
preferably RAID 10.

Each file spawns a thread out to the OS so yes there is benefit; you have to
be aware that the two threads will be doing async io so on a poor io
subsystem or one that is loaded you can actually hurt performance by doing
it.

--
Tony Rogerson
SQL Server MVP
http://sqlblogcasts.com/blogs/tonyrogerson - technical commentary from a SQL
Server Consultant
http://sqlserverfaq.com - free video tutorials
<ju**********@gmail.comwrote in message
news:11*********************@f1g2000cwa.googlegrou ps.com...
Is there any benefit in creating seperate file groups for a partitioned
table on a multi-processor server with RAID5 and 1 Logical Drive?

Dec 2 '06 #4
Tony,
I like to use RAID 10 when I can, much faster than 5.
Are you saying that even thou there is a single logical drive that the
raid controller built, there is a difference at the windows level when
we create seperate O/S logical drives? Or, are you refering back to the
Raid 5 vs. Raid 1??
I'd like to clarity on this point as I am going to building new
servers.
Tony Rogerson wrote:
RAID 5 should be no where near a database server now-a-days; use RAID 1 or
preferably RAID 10.

Each file spawns a thread out to the OS so yes there is benefit; you have to
be aware that the two threads will be doing async io so on a poor io
subsystem or one that is loaded you can actually hurt performance by doing
it.

--
Tony Rogerson
SQL Server MVP
http://sqlblogcasts.com/blogs/tonyrogerson - technical commentary from a SQL
Server Consultant
http://sqlserverfaq.com - free video tutorials
<ju**********@gmail.comwrote in message
news:11*********************@f1g2000cwa.googlegrou ps.com...
Is there any benefit in creating seperate file groups for a partitioned
table on a multi-processor server with RAID5 and 1 Logical Drive?
Dec 2 '06 #5
If you create multiple files then a thread is spawned per file.

You really need to test to see if your system benefits from such a
configuration.

The other thing to think of with multiple files (not specifically file
groups because thats something different) is that each file has multiple
IAMS so you get less contention on object creation which is why there is a
recommendation to have a file per cpu on tempdb.

The other thing to think about is the system partition (usually C:) has a
default allocation size of 4KB which cannot be changed; the recommendation
is that when you format your own partition (so don't put the database/logs
on C:) that you match the allocation size (FORMAT /A) to the stripe size of
the RAID controller - usually you set it to 64KB - that's DELL's
recommendation for their equipment.

--
Tony Rogerson
SQL Server MVP
http://sqlblogcasts.com/blogs/tonyrogerson - technical commentary from a SQL
Server Consultant
http://sqlserverfaq.com - free video tutorials
"rcamarda" <ro**************@gmail.comwrote in message
news:11**********************@73g2000cwn.googlegro ups.com...
Tony,
I like to use RAID 10 when I can, much faster than 5.
Are you saying that even thou there is a single logical drive that the
raid controller built, there is a difference at the windows level when
we create seperate O/S logical drives? Or, are you refering back to the
Raid 5 vs. Raid 1??
I'd like to clarity on this point as I am going to building new
servers.
Tony Rogerson wrote:
>RAID 5 should be no where near a database server now-a-days; use RAID 1
or
preferably RAID 10.

Each file spawns a thread out to the OS so yes there is benefit; you have
to
be aware that the two threads will be doing async io so on a poor io
subsystem or one that is loaded you can actually hurt performance by
doing
it.

--
Tony Rogerson
SQL Server MVP
http://sqlblogcasts.com/blogs/tonyrogerson - technical commentary from a
SQL
Server Consultant
http://sqlserverfaq.com - free video tutorials
<ju**********@gmail.comwrote in message
news:11*********************@f1g2000cwa.googlegro ups.com...
Is there any benefit in creating seperate file groups for a partitioned
table on a multi-processor server with RAID5 and 1 Logical Drive?

Dec 2 '06 #6
Is there any "rule of thumb" for determining how many files a database
should be split into based on the size of the database or the number of
CPUs?

Thanks in advance for all of your advice

Dec 2 '06 #7
ju**********@gmail.com wrote:
Is there any "rule of thumb" for determining how many files a database
should be split into based on the size of the database or the number of
CPUs?

Thanks in advance for all of your advice
No.

The point is to maximize the number of spindles. How you do that depends
on your hardware.

The only sure thing about a "rule of thumb" is that it is more often
wrong that right.
--
Daniel A. Morgan
University of Washington
da******@x.washington.edu
(replace x with u to respond)
Puget Sound Oracle Users Group
www.psoug.org
Dec 2 '06 #8
Rule of thumb for tempdb is one file per logical CPU.

Rule of thumb for application databases depends entirely on what you are
doing and the disk access pattern your queries create when they run - you
aim to service all queries from caching so its only the checkpoint /
lazywriter you need worry about.

--
Tony Rogerson
SQL Server MVP
http://sqlblogcasts.com/blogs/tonyrogerson - technical commentary from a SQL
Server Consultant
http://sqlserverfaq.com - free video tutorials
<ju**********@gmail.comwrote in message
news:11**********************@73g2000cwn.googlegro ups.com...
Is there any "rule of thumb" for determining how many files a database
should be split into based on the size of the database or the number of
CPUs?

Thanks in advance for all of your advice

Dec 2 '06 #9

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

6
by: Matt Liverance | last post by:
I REALLY dont want to switch to oracle :( but I cant get these tables working any faster. I've got 2 dedicated servers, each with a slave, all run 32gig 15k rpm raid 5 on u320 perc raid...
1
by: JJ | last post by:
Hi, I was going to buy a server with Raid 1 as I thought that it meant that if one of the two mirrored drives fail, you simply take it out and put a new one in. At which point presumably the...
18
by: Jeff Boes | last post by:
I'm sure this is a concept that's been explored here. I have a table (fairly simple, just two columns, one of which is a 32-digit checksum) with several million rows (currently, about 7 million)....
1
by: Mats Kling | last post by:
Hi all, We are logging approx. 3 million records every day into a history table. Last week we ran into the 64 GB limit in UDB 8 so we recreated the table with 8 k pagesize to get some...
10
by: Sumanth | last post by:
Hi, I have a table that I would like to partition. It has a column c1 which has 100 distinct values. I was planning to partition the table on column c1 using a partioned index, and then apply...
13
by: Dave | last post by:
RAID 5 beats RAID 10 Can I get some feedback on these results? We were having some serious IO issues according to PerfMon so I really pushed for RAID 10. The results are not what I expected. ...
10
by: shsandeep | last post by:
DB2 V8.2 (not Viper yet and no range partitioning!!) I have created a table T1 (col1, col2) with col1 as the primary key. When I try to create a partitioning key on col2, it gives me error that it...
110
by: alf | last post by:
Hi, is it possible that due to OS crash or mysql itself crash or some e.g. SCSI failure to lose all the data stored in the table (let's say million of 1KB rows). In other words what is the worst...
15
by: Piero 'Giops' Giorgi | last post by:
Hi! I have a question: I already have a DB that uses partitions to divide data in US Counties, partitioned by state. Can I use TWO levels of partitioning? I mean... 3077 filegroups and...
2
by: DJRhino | last post by:
Was curious if anyone else was having this same issue or not.... I was just Up/Down graded to windows 11 and now my access combo boxes are not acting right. With win 10 I could start typing...
2
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 4 Oct 2023 starting at 18:00 UK time (6PM UTC+1) and finishing at about 19:15 (7.15PM) The start time is equivalent to 19:00 (7PM) in Central...
0
tracyyun
by: tracyyun | last post by:
Hello everyone, I have a question and would like some advice on network connectivity. I have one computer connected to my router via WiFi, but I have two other computers that I want to be able to...
3
NeoPa
by: NeoPa | last post by:
Introduction For this article I'll be using a very simple database which has Form (clsForm) & Report (clsReport) classes that simply handle making the calling Form invisible until the Form, or all...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 1 Nov 2023 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM) Please note that the UK and Europe revert to winter time on...
3
by: nia12 | last post by:
Hi there, I am very new to Access so apologies if any of this is obvious/not clear. I am creating a data collection tool for health care employees to complete. It consists of a number of...
0
NeoPa
by: NeoPa | last post by:
Introduction For this article I'll be focusing on the Report (clsReport) class. This simply handles making the calling Form invisible until all of the Reports opened by it have been closed, when it...
0
isladogs
by: isladogs | last post by:
The next online meeting of the Access Europe User Group will be on Wednesday 6 Dec 2023 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, Mike...
2
by: GKJR | last post by:
Does anyone have a recommendation to build a standalone application to replace an Access database? I have my bookkeeping software I developed in Access that I would like to make available to other...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.