473,765 Members | 2,057 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Good storage solution

I'm doing a PHP script on FreeBSD which servers multi-TBytes worth of
content mostly files ranging in size from 100KB to 600MB. Similar to a
file-sharing sites where users upload their pictures/videos/binary
files.

I'd prefer a simple storage system but not fimilar with large storage
as this. I'd prefer to serve the files in URLs in this format:
http://archive.site.co m/$FILENAME

I'd have 4x FreeBSD servers (local LAN linked) each with 6x 500GB SATA
hard-drives (RAID5 array) totaling 12 TBytes storage between the
servers.

What would be your recommendation( s)?

Sep 29 '07 #1
4 1275
In comp.sys.ibm.pc .hardware.stora ge qw*******@googl email.com wrote:
I'm doing a PHP script on FreeBSD which servers multi-TBytes worth of
content mostly files ranging in size from 100KB to 600MB. Similar to a
file-sharing sites where users upload their pictures/videos/binary
files.
I'd prefer a simple storage system but not fimilar with large storage
as this. I'd prefer to serve the files in URLs in this format:
http://archive.site.co m/$FILENAME
I'd have 4x FreeBSD servers (local LAN linked) each with 6x 500GB SATA
hard-drives (RAID5 array) totaling 12 TBytes storage between the
servers.
What would be your recommendation( s)?
What is your question? I have used RAID5/6 in TB range under Linux,
so I guess doung the same under FreeBSD should not be an issue.
Export via NFS and you are done.

Arno
Sep 29 '07 #2
On Sep 29, 4:44 pm, Arno Wagner <m...@privacy.n etwrote:
What is your question? I have used RAID5/6 in TB range under Linux,
so I guess doung the same under FreeBSD should not be an issue.
Export via NFS and you are done.

Arno
Can you provide any good links for tutorials on NFS? I have read
Wikipedia's page for but don't understand how I can use NFS to create
a virtual drive of 12TBytes spread over 4 servers and 24 hard drives.

Oct 2 '07 #3
In comp.sys.ibm.pc .hardware.stora ge qw*******@googl email.com wrote:
On Sep 29, 4:44 pm, Arno Wagner <m...@privacy.n etwrote:
>What is your question? I have used RAID5/6 in TB range under Linux,
so I guess doung the same under FreeBSD should not be an issue.
Export via NFS and you are done.

Arno
Can you provide any good links for tutorials on NFS? I have read
Wikipedia's page for but don't understand how I can use NFS to create
a virtual drive of 12TBytes spread over 4 servers and 24 hard drives.
Oh, you want one unified filesystem? Doing that with more than
one computer may not be a good idea. If you do, some type of
cluster filesystem should be used. Otherwise you could get
serious trouble if one computer goes down.

Come to think of it, why not put the 24 disks all in one computer?
This may need a cube-type server case and three 8x SATA controllers,
but both are available.

Arno

Oct 2 '07 #4
In comp.sys.ibm.pc .hardware.stora ge Michael Vilain <vi****@spamcop .netwrote:
In article <11************ **********@o80g 2000hse.googleg roups.com>,
qw*******@googl email.com wrote:
>On Sep 29, 4:44 pm, Arno Wagner <m...@privacy.n etwrote:
What is your question? I have used RAID5/6 in TB range under Linux,
so I guess doung the same under FreeBSD should not be an issue.
Export via NFS and you are done.

Arno

Can you provide any good links for tutorials on NFS? I have read
Wikipedia's page for but don't understand how I can use NFS to create
a virtual drive of 12TBytes spread over 4 servers and 24 hard drives.
"That depends" on how you're using your storage. NFS is just the
transport mechanism. Layout, redundancy, and BACKUPS are a bigger
concern. You need someone who understands storage, optimization, and
backups ASAP. Hire a consultant or go do a LOT of reading.
I have to say I agree to that.

Arno

Oct 2 '07 #5

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

52
6439
by: Tony Marston | last post by:
Several months ago I started a thread with the title "What is/is not considered to be good OO programming" which started a long and interesting discussion. I have condensed the arguments into a single article which can be viewed at http://www.tonymarston.net/php-mysql/good-bad-oop.html I fully expect this to be the start of another flame war, so sharpen your knives and get stuck in!
5
2052
by: AaronV | last post by:
Hello, I'm a webmaster for a college newspaper and I'm implementing an article search. I'm running PHP with a MySQL database to store the weekly stories. Does anyone know of an article that could offer good search theory. My top priority right now is multiple search terms and relevance sorting based on how many word hits are returned.
5
948
by: Bernhard Krautschneider | last post by:
hello group, is it possible to do a storage snapshot of a running ms-sql database without losing transactions? What tasks must be done before such a snapshot. thanks in advance, Bernhard
36
4656
by: toedipper | last post by:
Hello, I am designing a table of vehicle types, nothing special, just a list of unique vehicle types such as truck, lorry, bike, motor bike, plane, tractor etc etc For the table design I am proposing a single column table with a field name called vehicle_type and this will contain the vehicle type. Sot it will be
4
7315
by: David Groves | last post by:
Are there any plans to incorporate a native C# facility to deal with the OLE Structured Storage concept? It's clumsy at best to have to construct a C++ interface to the .doc files (or any such files by any suffix), when Microsoft uses the concept in most, if not all, of their other products. "Just how hard could it be?" he asks, knowing that 'hard' is a relative concept. -- David Groves Thermo Finnigan--AID
10
5654
by: Dave | last post by:
Has anyone out there managed to create a structured storage file using pure VB.Net? Specifically; with the API function StgCreateStorageEx? If so, could you post a working example here please. One that can be pasted into a VB.Net project and run. Thanks Dave
5
3661
by: philip | last post by:
Here is some lines of code than I wrote. You can copy/paste theis code as code of form1 in a new project. My problem is this one : I try to write in a file a serie of bytes. BUT some bytes written in file are not the sent bytes. Copy and paste the following lines to observe my problem. What can I do to resolve problem ? Only System.Text.Encoding.ASCII write the same number of bytes, but not the good bytes. Someone can help me. Thanks by...
11
3164
by: eBob.com | last post by:
I have this nasty problem with Shared methods and what I think of as "global storage" - i.e. storage declared outside of any subroutines or functions. In the simple example below this "global" storage is ButtonHasBeenClicked. In this simple example code in Form1 calls a routine in Module1 which then calls code back in Form1 (subroutine WhatEver). WhatEver needs to access ButtonHasBeenClicked but the reference to ButtonHasBeenClicked...
75
3410
by: Amkcoder | last post by:
http://amkcoder.fileave.com/L_BitWise.zip http://amkcoder.fileave.com/L_ptr2.zip
0
9568
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
10164
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
1
9959
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
0
9835
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
0
8833
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
7379
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
5277
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
1
3926
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
2
3532
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.