473,804 Members | 3,461 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Table Partitioning on a RAID 5 Server

Is there any benefit in creating seperate file groups for a partitioned
table on a multi-processor server with RAID5 and 1 Logical Drive?

Dec 1 '06 #1
8 2260
IMHO, No. I assume you have one raid controller and as you state, one
Logical Drive.
However, there might be a slight difference with windows if you have
two logical drives defined at the O/S level.

Rob.
ju**********@gm ail.com wrote:
Is there any benefit in creating seperate file groups for a partitioned
table on a multi-processor server with RAID5 and 1 Logical Drive?
Dec 2 '06 #2
Does this hold true for creating mutiple filegroups for the database
itself? even if it is 100G + in size?

Dec 2 '06 #3
RAID 5 should be no where near a database server now-a-days; use RAID 1 or
preferably RAID 10.

Each file spawns a thread out to the OS so yes there is benefit; you have to
be aware that the two threads will be doing async io so on a poor io
subsystem or one that is loaded you can actually hurt performance by doing
it.

--
Tony Rogerson
SQL Server MVP
http://sqlblogcasts.com/blogs/tonyrogerson - technical commentary from a SQL
Server Consultant
http://sqlserverfaq.com - free video tutorials
<ju**********@g mail.comwrote in message
news:11******** *************@f 1g2000cwa.googl egroups.com...
Is there any benefit in creating seperate file groups for a partitioned
table on a multi-processor server with RAID5 and 1 Logical Drive?

Dec 2 '06 #4
Tony,
I like to use RAID 10 when I can, much faster than 5.
Are you saying that even thou there is a single logical drive that the
raid controller built, there is a difference at the windows level when
we create seperate O/S logical drives? Or, are you refering back to the
Raid 5 vs. Raid 1??
I'd like to clarity on this point as I am going to building new
servers.
Tony Rogerson wrote:
RAID 5 should be no where near a database server now-a-days; use RAID 1 or
preferably RAID 10.

Each file spawns a thread out to the OS so yes there is benefit; you have to
be aware that the two threads will be doing async io so on a poor io
subsystem or one that is loaded you can actually hurt performance by doing
it.

--
Tony Rogerson
SQL Server MVP
http://sqlblogcasts.com/blogs/tonyrogerson - technical commentary from a SQL
Server Consultant
http://sqlserverfaq.com - free video tutorials
<ju**********@g mail.comwrote in message
news:11******** *************@f 1g2000cwa.googl egroups.com...
Is there any benefit in creating seperate file groups for a partitioned
table on a multi-processor server with RAID5 and 1 Logical Drive?
Dec 2 '06 #5
If you create multiple files then a thread is spawned per file.

You really need to test to see if your system benefits from such a
configuration.

The other thing to think of with multiple files (not specifically file
groups because thats something different) is that each file has multiple
IAMS so you get less contention on object creation which is why there is a
recommendation to have a file per cpu on tempdb.

The other thing to think about is the system partition (usually C:) has a
default allocation size of 4KB which cannot be changed; the recommendation
is that when you format your own partition (so don't put the database/logs
on C:) that you match the allocation size (FORMAT /A) to the stripe size of
the RAID controller - usually you set it to 64KB - that's DELL's
recommendation for their equipment.

--
Tony Rogerson
SQL Server MVP
http://sqlblogcasts.com/blogs/tonyrogerson - technical commentary from a SQL
Server Consultant
http://sqlserverfaq.com - free video tutorials
"rcamarda" <ro************ **@gmail.comwro te in message
news:11******** **************@ 73g2000cwn.goog legroups.com...
Tony,
I like to use RAID 10 when I can, much faster than 5.
Are you saying that even thou there is a single logical drive that the
raid controller built, there is a difference at the windows level when
we create seperate O/S logical drives? Or, are you refering back to the
Raid 5 vs. Raid 1??
I'd like to clarity on this point as I am going to building new
servers.
Tony Rogerson wrote:
>RAID 5 should be no where near a database server now-a-days; use RAID 1
or
preferably RAID 10.

Each file spawns a thread out to the OS so yes there is benefit; you have
to
be aware that the two threads will be doing async io so on a poor io
subsystem or one that is loaded you can actually hurt performance by
doing
it.

--
Tony Rogerson
SQL Server MVP
http://sqlblogcasts.com/blogs/tonyrogerson - technical commentary from a
SQL
Server Consultant
http://sqlserverfaq.com - free video tutorials
<ju**********@ gmail.comwrote in message
news:11******* **************@ f1g2000cwa.goog legroups.com...
Is there any benefit in creating seperate file groups for a partitioned
table on a multi-processor server with RAID5 and 1 Logical Drive?

Dec 2 '06 #6
Is there any "rule of thumb" for determining how many files a database
should be split into based on the size of the database or the number of
CPUs?

Thanks in advance for all of your advice

Dec 2 '06 #7
ju**********@gm ail.com wrote:
Is there any "rule of thumb" for determining how many files a database
should be split into based on the size of the database or the number of
CPUs?

Thanks in advance for all of your advice
No.

The point is to maximize the number of spindles. How you do that depends
on your hardware.

The only sure thing about a "rule of thumb" is that it is more often
wrong that right.
--
Daniel A. Morgan
University of Washington
da******@x.wash ington.edu
(replace x with u to respond)
Puget Sound Oracle Users Group
www.psoug.org
Dec 2 '06 #8
Rule of thumb for tempdb is one file per logical CPU.

Rule of thumb for application databases depends entirely on what you are
doing and the disk access pattern your queries create when they run - you
aim to service all queries from caching so its only the checkpoint /
lazywriter you need worry about.

--
Tony Rogerson
SQL Server MVP
http://sqlblogcasts.com/blogs/tonyrogerson - technical commentary from a SQL
Server Consultant
http://sqlserverfaq.com - free video tutorials
<ju**********@g mail.comwrote in message
news:11******** **************@ 73g2000cwn.goog legroups.com...
Is there any "rule of thumb" for determining how many files a database
should be split into based on the size of the database or the number of
CPUs?

Thanks in advance for all of your advice

Dec 2 '06 #9

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

6
22540
by: Matt Liverance | last post by:
I REALLY dont want to switch to oracle :( but I cant get these tables working any faster. I've got 2 dedicated servers, each with a slave, all run 32gig 15k rpm raid 5 on u320 perc raid cards, dell 2600/4600's with single channel backplanes (new ones will have dual channel) All have 2 gig of ram, but I've never seen mysql use more than 300mb of ram.
1
4128
by: JJ | last post by:
Hi, I was going to buy a server with Raid 1 as I thought that it meant that if one of the two mirrored drives fail, you simply take it out and put a new one in. At which point presumably the hardware takes over and copies the other drive over to mirror it again. However, my sql server admin book, says raid 1 is bad, as it means you have lots of downtime, when recovering from a broken drive. Can anyone give me some advice on this? What...
18
6365
by: Jeff Boes | last post by:
I'm sure this is a concept that's been explored here. I have a table (fairly simple, just two columns, one of which is a 32-digit checksum) with several million rows (currently, about 7 million). About a million times a day we do select * from my_table where md5 = ? to verify presence or absence of the row, and base further processing on that information.
1
2057
by: Mats Kling | last post by:
Hi all, We are logging approx. 3 million records every day into a history table. Last week we ran into the 64 GB limit in UDB 8 so we recreated the table with 8 k pagesize to get some breathingroom before we hit the 128 GB limit. We are considering partitioning and I just wanted to check with you that our proposal is the best one:
10
2396
by: Sumanth | last post by:
Hi, I have a table that I would like to partition. It has a column c1 which has 100 distinct values. I was planning to partition the table on column c1 using a partioned index, and then apply data partitioned secondary indexes on the table. I then read about partioned table spaces, How do I get the same behaviour as above by creating a partioned table space?Do I create the partion table space, create the
13
15418
by: Dave | last post by:
RAID 5 beats RAID 10 Can I get some feedback on these results? We were having some serious IO issues according to PerfMon so I really pushed for RAID 10. The results are not what I expected. I have 2 identical servers. Hardware: PowerEdge 2850
10
3564
by: shsandeep | last post by:
DB2 V8.2 (not Viper yet and no range partitioning!!) I have created a table T1 (col1, col2) with col1 as the primary key. When I try to create a partitioning key on col2, it gives me error that it should have all primary keys included. So, I created table T1 again with col2 as the partitioning key. Now, I do not have col1 as the primary key. When I try to create col1 as the primary key, I get the following error: 1 The primary key, each...
110
10639
by: alf | last post by:
Hi, is it possible that due to OS crash or mysql itself crash or some e.g. SCSI failure to lose all the data stored in the table (let's say million of 1KB rows). In other words what is the worst case scenario for MyISAM backend? Also is it possible to not to lose data but get them corrupted?
15
3689
by: Piero 'Giops' Giorgi | last post by:
Hi! I have a question: I already have a DB that uses partitions to divide data in US Counties, partitioned by state. Can I use TWO levels of partitioning? I mean... 3077 filegroups and 50 partition functions that address
0
9705
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
9576
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
10323
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
0
9138
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
7613
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
6847
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
5515
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
1
4291
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
3
2983
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.