473,324 Members | 2,246 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,324 software developers and data experts.

Good storage solution

I'm doing a PHP script on FreeBSD which servers multi-TBytes worth of
content mostly files ranging in size from 100KB to 600MB. Similar to a
file-sharing sites where users upload their pictures/videos/binary
files.

I'd prefer a simple storage system but not fimilar with large storage
as this. I'd prefer to serve the files in URLs in this format:
http://archive.site.com/$FILENAME

I'd have 4x FreeBSD servers (local LAN linked) each with 6x 500GB SATA
hard-drives (RAID5 array) totaling 12 TBytes storage between the
servers.

What would be your recommendation(s)?

Sep 29 '07 #1
4 1251
In comp.sys.ibm.pc.hardware.storage qw*******@googlemail.com wrote:
I'm doing a PHP script on FreeBSD which servers multi-TBytes worth of
content mostly files ranging in size from 100KB to 600MB. Similar to a
file-sharing sites where users upload their pictures/videos/binary
files.
I'd prefer a simple storage system but not fimilar with large storage
as this. I'd prefer to serve the files in URLs in this format:
http://archive.site.com/$FILENAME
I'd have 4x FreeBSD servers (local LAN linked) each with 6x 500GB SATA
hard-drives (RAID5 array) totaling 12 TBytes storage between the
servers.
What would be your recommendation(s)?
What is your question? I have used RAID5/6 in TB range under Linux,
so I guess doung the same under FreeBSD should not be an issue.
Export via NFS and you are done.

Arno
Sep 29 '07 #2
On Sep 29, 4:44 pm, Arno Wagner <m...@privacy.netwrote:
What is your question? I have used RAID5/6 in TB range under Linux,
so I guess doung the same under FreeBSD should not be an issue.
Export via NFS and you are done.

Arno
Can you provide any good links for tutorials on NFS? I have read
Wikipedia's page for but don't understand how I can use NFS to create
a virtual drive of 12TBytes spread over 4 servers and 24 hard drives.

Oct 2 '07 #3
In comp.sys.ibm.pc.hardware.storage qw*******@googlemail.com wrote:
On Sep 29, 4:44 pm, Arno Wagner <m...@privacy.netwrote:
>What is your question? I have used RAID5/6 in TB range under Linux,
so I guess doung the same under FreeBSD should not be an issue.
Export via NFS and you are done.

Arno
Can you provide any good links for tutorials on NFS? I have read
Wikipedia's page for but don't understand how I can use NFS to create
a virtual drive of 12TBytes spread over 4 servers and 24 hard drives.
Oh, you want one unified filesystem? Doing that with more than
one computer may not be a good idea. If you do, some type of
cluster filesystem should be used. Otherwise you could get
serious trouble if one computer goes down.

Come to think of it, why not put the 24 disks all in one computer?
This may need a cube-type server case and three 8x SATA controllers,
but both are available.

Arno

Oct 2 '07 #4
In comp.sys.ibm.pc.hardware.storage Michael Vilain <vi****@spamcop.netwrote:
In article <11**********************@o80g2000hse.googlegroups .com>,
qw*******@googlemail.com wrote:
>On Sep 29, 4:44 pm, Arno Wagner <m...@privacy.netwrote:
What is your question? I have used RAID5/6 in TB range under Linux,
so I guess doung the same under FreeBSD should not be an issue.
Export via NFS and you are done.

Arno

Can you provide any good links for tutorials on NFS? I have read
Wikipedia's page for but don't understand how I can use NFS to create
a virtual drive of 12TBytes spread over 4 servers and 24 hard drives.
"That depends" on how you're using your storage. NFS is just the
transport mechanism. Layout, redundancy, and BACKUPS are a bigger
concern. You need someone who understands storage, optimization, and
backups ASAP. Hire a consultant or go do a LOT of reading.
I have to say I agree to that.

Arno

Oct 2 '07 #5

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

52
by: Tony Marston | last post by:
Several months ago I started a thread with the title "What is/is not considered to be good OO programming" which started a long and interesting discussion. I have condensed the arguments into a...
5
by: AaronV | last post by:
Hello, I'm a webmaster for a college newspaper and I'm implementing an article search. I'm running PHP with a MySQL database to store the weekly stories. Does anyone know of an article that...
5
by: Bernhard Krautschneider | last post by:
hello group, is it possible to do a storage snapshot of a running ms-sql database without losing transactions? What tasks must be done before such a snapshot. thanks in advance, Bernhard
36
by: toedipper | last post by:
Hello, I am designing a table of vehicle types, nothing special, just a list of unique vehicle types such as truck, lorry, bike, motor bike, plane, tractor etc etc For the table design I am...
4
by: David Groves | last post by:
Are there any plans to incorporate a native C# facility to deal with the OLE Structured Storage concept? It's clumsy at best to have to construct a C++ interface to the .doc files (or any such...
10
by: Dave | last post by:
Has anyone out there managed to create a structured storage file using pure VB.Net? Specifically; with the API function StgCreateStorageEx? If so, could you post a working example here please. One...
5
by: philip | last post by:
Here is some lines of code than I wrote. You can copy/paste theis code as code of form1 in a new project. My problem is this one : I try to write in a file a serie of bytes. BUT some bytes...
11
by: eBob.com | last post by:
I have this nasty problem with Shared methods and what I think of as "global storage" - i.e. storage declared outside of any subroutines or functions. In the simple example below this "global"...
75
by: Amkcoder | last post by:
http://amkcoder.fileave.com/L_BitWise.zip http://amkcoder.fileave.com/L_ptr2.zip
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
by: ryjfgjl | last post by:
ExcelToDatabase: batch import excel into database automatically...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
1
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
1
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
1
by: Defcon1945 | last post by:
I'm trying to learn Python using Pycharm but import shutil doesn't work
1
by: Shællîpôpï 09 | last post by:
If u are using a keypad phone, how do u turn on JavaScript, to access features like WhatsApp, Facebook, Instagram....
0
by: Faith0G | last post by:
I am starting a new it consulting business and it's been a while since I setup a new website. Is wordpress still the best web based software for hosting a 5 page website? The webpages will be...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 3 Apr 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome former...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.