Good storage solution

  • Thread starter Thread starter qwertycat
  • Start date Start date
Q

qwertycat

I'm doing a PHP script on FreeBSD which servers multi-TBytes worth of
content mostly files ranging in size from 100KB to 600MB. Similar to a
file-sharing sites where users upload their pictures/videos/binary
files.

I'd prefer a simple storage system but not fimilar with large storage
as this. I'd prefer to serve the files in URLs in this format:
http://archive.site.com/$FILENAME

I'd have 4x FreeBSD servers (local LAN linked) each with 6x 500GB SATA
hard-drives (RAID5 array) totaling 12 TBytes storage between the
servers.

What would be your recommendation(s)?
 
In said:
I'm doing a PHP script on FreeBSD which servers multi-TBytes worth of
content mostly files ranging in size from 100KB to 600MB. Similar to a
file-sharing sites where users upload their pictures/videos/binary
files.
I'd prefer a simple storage system but not fimilar with large storage
as this. I'd prefer to serve the files in URLs in this format:
http://archive.site.com/$FILENAME
I'd have 4x FreeBSD servers (local LAN linked) each with 6x 500GB SATA
hard-drives (RAID5 array) totaling 12 TBytes storage between the
servers.
What would be your recommendation(s)?

What is your question? I have used RAID5/6 in TB range under Linux,
so I guess doung the same under FreeBSD should not be an issue.
Export via NFS and you are done.

Arno
 
What is your question? I have used RAID5/6 in TB range under Linux,
so I guess doung the same under FreeBSD should not be an issue.
Export via NFS and you are done.

Arno

Can you provide any good links for tutorials on NFS? I have read
Wikipedia's page for but don't understand how I can use NFS to create
a virtual drive of 12TBytes spread over 4 servers and 24 hard drives.
 
Can you provide any good links for tutorials on NFS? I have read
Wikipedia's page for but don't understand how I can use NFS to create
a virtual drive of 12TBytes spread over 4 servers and 24 hard drives.

"That depends" on how you're using your storage. NFS is just the
transport mechanism. Layout, redundancy, and BACKUPS are a bigger
concern. You need someone who understands storage, optimization, and
backups ASAP. Hire a consultant or go do a LOT of reading.
 
Can you provide any good links for tutorials on NFS? I have read
Wikipedia's page for but don't understand how I can use NFS to create
a virtual drive of 12TBytes spread over 4 servers and 24 hard drives.

Oh, you want one unified filesystem? Doing that with more than
one computer may not be a good idea. If you do, some type of
cluster filesystem should be used. Otherwise you could get
serious trouble if one computer goes down.

Come to think of it, why not put the 24 disks all in one computer?
This may need a cube-type server case and three 8x SATA controllers,
but both are available.

Arno
 
In comp.sys.ibm.pc.hardware.storage Michael Vilain said:
"That depends" on how you're using your storage. NFS is just the
transport mechanism. Layout, redundancy, and BACKUPS are a bigger
concern. You need someone who understands storage, optimization, and
backups ASAP. Hire a consultant or go do a LOT of reading.

I have to say I agree to that.

Arno
 
Back
Top