The [H]ard Forum Storage Showoff Thread - READ requirements in first post

Status
Not open for further replies.
My forray into the NAS world! :p

Intel Celeron 420 (1.6 GHz)
Intel D945GCNL
1 GB Crucial Value DDR2-533 RAM
Dell Perc 5/i SAS RAID w/BBU
4x Samsung F1 750 GB HDD (RAID5 w/the Perc)
1x WD Caviar 750 GB HDD (Temp drive/unsorted data) in a hot swap enclosure
2x 4 GB Energizer USB stick (One as / and the other as /usr)
Generic 400w PSU
2U Rackmount case (the cheap one :p)

Total HDD space: 2.05 TiB + 689 TiB

OS is Ubuntu Server 8.04 x64. I plan on finishing it off soon, I've still got a bit more to do (add 2 more HDDs for a 5+1 array, get said RAID array working [gparted issues], cut a hole in the PSU back for airflow, etc.), but it's fully functional as is right now running just the WD 750 GB HDD (which was my external laptop drive), which will eventually be just the temp drive.

And here's the pics:

Front of the case (crappy; I can't use a camera for the life of me!):


Inside 1:


Inside 2:


From the back (also crappy):
 
Camera is not available yet (being shipped), but my main rig pretty much qualifies...
1x150GB Raptor
1x120GB WD Caviar JS-series
2x750GB WD Caviar KS-series

No RAID, no JBOD, just plain disks. Usable space: 1.6TB (assuming 1000GB/TB). Also have a 1TB external, but per the thread rules those don't count (at least not a USB). Looking for more storage...

I keep pretty much all my storage (minus the movie collection on the external which I may bring home from college since it is portable) inside my big rig. Thermaltake Armor still has room for five more drives. I'm gonna run out of ports before I run out of places to put drives.
 
Server: - Running OpenSolaris 2008.05 - Fileserver, FTP, Web, etc
Water cooled w/ MCP655 pump, MCR320 radiator, Apogee water blocks, Swiftech res
Gigabyte ga-n680sli-dq6 board
Intel q6600 2.4ghz quad
4gb ocz ram
Intel pro1000mt dual nic
LSI Megaraid 8344elp 8x SAS Raid
Corsair 620HX power supply
Supermicro SC750a full tower case

Storage Array HW: (3.62TB ZFS Raid-Z array)
Supermicro SC750a full tower case (wanted plenty of room/ventilation)
Corsair 750TX power supply
2x Sata -> 4x SAS multilane bridge adapters
8x Seagate 500gb sata drives
2x Coolermaster 4 in 3 drive cages with 120mm fans

I run the two 4x multilane infiniband cables from the server (1 from raid card, one from internal cable to 4x multilane bridge card to make it external), and then the storage case has two of those bridge boards turning the infiniband cables into internal 4x sata boards that go to the drives. I have the drives mounted in the CM 4 in 3 cages, but I turned the cages on their sides and mounted them in the bottom of the case to contain the spindle noise. In doing this I also was able to rubber mount them to the case so I get no vibration at all. Its quiet enough that I cant hear it 8ft away unless the drives are seeking

Here's a pic of the server itself.. forgot to take pics of the other case with the 8x drives in it

web.jpg



Here's the 8x drives in their cages- I mounted them sideways w/ the blue rubber bushings facing down, so they are rubber mounted to the bottom of the case

web.jpg
 
kay kay... my turn.. ok this may not be Truely [H]ard.. but fuck you it's all i can afford ;)

Specs
GA-965P-DS3P
Conroe e6700
Kingmax PC2-800 4x2GiB
Inno3d/Nvidia 8800GTX
Thermalright HR03 Plus
8x400GB WD RE2 RAID5 "Space"
4x1TB WD GP RAID10(0+1) "Desktop"
Areca ARC-1220
Coolermaster Stacker 810 includes 1 4in3 HDD cage
2 additional Coolermaster 4in3 HDD cages
Samsung Writemaster DVD
Corsair TX750W

TOTAL STORAGE: Space (2.54TB) and Desktop (1.81TB) - ALL with REDUNDANCY..

Complete.jpg




a look at how the cabling for the 4x1TB Western Digital GP drives connect.
Bottom_Half.jpg


a look at the original 4x400GB Western Digital RE2 drives.
Top_Half.jpg


a look at the complete sheathed computer.
Outside.jpg


what's hiding on the backside? well my fan connectors and 2x PCIe 8-pin plugs.
Backside.jpg


i hope this qualifies for this page :)
 
@ gaspah - Your cat makes you qualify :D


Some of my latest storage toys

Top to bottom:

MiniGalaxy - 4TB
Galaxy 4.75 - 10TB
Galaxy 5.0 - 25TB


 
No where near as impressive as some of the systems in here, but here is mine anyways...

Power Supply
Antec Earthwatts 420

RAID Level: None, WHS duplication for important files
RAID Controller, Ip35 onboard raid

4x 640gb WD AAKS
1x Maxtor 80gb (OS)


Total Amount of Advertised (before formatting) Space:
Storage: 640x4 = 2560gb Before format
2.4tb after format

post1.jpg

post2.jpg

IMG_3355.jpg

IMG_3352.jpg

IMG_3319.jpg


I have cleaned up the cables a little more since those shots, but you get the idea.
 
Well, mine is basically all done, so time to post in here. Worklog can be found here.

12x 1TB Seagate ES.2's on an ARC-1261ML. RAID level in the screenshot is 0 but I'm in the process of switching it to 6.

Advertised Space: 12TB
Formatted Space: 11.2TB

spacekp0.jpg
 
I don't have pics yet but here is my setup:

Intel BOXDG33TDM
Core2Duo E6400
2Gb DDR2
1x Hitachi 7200rpm Laptop Drive (For Booting)
LIAN LI PC-V350B Case
FreeNAS 0.7 alpha

Array:
5x Western Digital 1TB GP Hard Drives
4TB before formatting although I have 4.05TB free with compression somehow and 550gb of data on it.
All the drives are in one ZFS pool running as raidz

I'm getting a writeup of what I did together here.
 
ColdZero said:
I don't have pics yet but here is my setup:

Intel BOXDG33TDM
Core2Duo E6400
2Gb DDR2
1x Hitachi 7200rpm Laptop Drive (For Booting)
LIAN LI PC-V350B Case
FreeNAS 0.7 alpha

Array:
5x Western Digital 1TB GP Hard Drives
4TB before formatting although I have 4.05TB free with compression somehow and 550gb of data on it.
All the drives are in one ZFS pool running as raidz

I'm getting a writeup of what I did together here.
Click to expand...


GLSauron said:
and amazingly hes not using raid...
Click to expand...

If i can read right, he is running raid.
 
My desktop just had its drives upgraded, swapped four 320GBs for four 750s and removed my four 160GB hotswap laptop drives (they are still pictured though). Other major specs are in my sig below.

cm8.JPG


comp2.JPG


Total space, 4x80GB RAID0 + 4x750GB RAID 5 = an unformatted capacity of 2490GB

And also another little tiny update.. Behold my new Windows Home Server!

DSCF0271.JPG


DSCF0268.JPG


OK. I lied, not so tiny. (worklog HERE)

* Lian Li PC-75 Full Tower
* Supermicro / AbleCOM SP450-RP 450w Server Power Supply (30A on the 12v)
* Intel Entry Server Motherboard SE7221BK1-E
* Pentium 4 540 3.2GHz
* 2x1GB Kingston DDR2 PC5300 RAM
* SUPERMICRO AOC-SAT2-MV8 (8 port SATA controller)
* Adaptec 1210SA (2 port SATA controller)
* Netgear 802.11G Wireless PCI card (not being used but it might come in handy)
* Seven 80mm fans, one 120mm fan all under-volted
* Eight Seagate 7200.10 320GB drives (storage)
* Four Western Digital Scorpio 2.5" 160GB drives (storage)
* Single Western Digital Raptor (ADFD) 74GB drive (OS / storage)
* ASUS DVD-ROM / Samsung Floppy

Total space, 1x74GB + 4x160GB + 8x320GB NO RAID = an unformatted capacity of 3274GB

homeserver3.JPG


I think I should be set for a year or so, maybe.
 
jtg1993 said:
If i can read right, he is running raid.
Click to expand...
I thought he was and then couldnt find it when I re-read the post. In that case, his total space numbers are somewhere between whacky and false. :shrug:
 
GLSauron said:
I thought he was and then couldnt find it when I re-read the post. In that case, his total space numbers are somewhere between whacky and false. :shrug:
Click to expand...

ZFS / RaidZ shows the total array size, but it calculates in parity when you move data to it. My array showed 3.62TB, but when I copied say a 100mb file, it would actually take like 115mb or so because of the partiy information. You do end up losing space to parity, its just not all taken up when you create the array.
 
question to people that run raidz on zfs:

Is there a way to expand raidz? can you add additional drives to the raid group (not the storage pool)?
 
GLSauron said:
and amazingly hes not using raid...
Click to expand...

Na, its running with raidz which is basically raid 5.

ZFS / RaidZ shows the total array size, but it calculates in parity when you move data to it. My array showed 3.62TB, but when I copied say a 100mb file, it would actually take like 115mb or so because of the partiy information. You do end up losing space to parity, its just not all taken up when you create the array.
Click to expand...

Cool, I've been trying to figure that out.

Here is a pic of the relevant info about the array:

zfsge6.jpg
 
axan said:
question to people that run raidz on zfs:

Is there a way to expand raidz? can you add additional drives to the raid group (not the storage pool)?
Click to expand...

If you mean just add another drive and expand the array and have the new drive protected no. The only way right now is to either replace all of the drives in the array with larger ones or add another drive to the pool.

If you replace all the drives, you just pull one out, add the new one and let it rebuild and then rinse and repeat until everything is replaced and you have a larger array.

The other way is that if you add another drive to the pool, the original raidz will be protected but the new drive won't. You could add 3 drives to your pool and create a second raidz and they just act as one large pool with the old drives.

Hopefully sun figures out how to expand an array soon.
 
Platform is Gentoo Linux x86_64 with a relatively recent kernel sharing out over NFSv4. 1.9GHz AMD64 X2 Brisbane with 2GB DDR2-667, Silverstone OP750 PSU. Filesystem is XFS. Drives are a mixture of Seagate, Western Digital, and Maxtor. 8x500G, 8x1T, 1x80G. 9.6T of usable space after format. Each group of 8 drives are mdadm RAID5, and the two arrays are grouped into a single logical volume.



MWave does a nice job of shipping OEM drives:
shippedms1.png


How it looks now:
stackyc6.png


Front:
frontkl6.png


Back:
backem2.png


Interior:
insidern5.png


Drive cages:
hddmv6.png


Basically stole Ockie's old ideas.
 
boomslang: very nice job on the cable management, the rest of the system ain't too shabby either :D
what sata controllers are you running? supermicro?
 
axan said:
boomslang: very nice job on the cable management, the rest of the system ain't too shabby either :D
what sata controllers are you running? supermicro?
Click to expand...

Yup, Supermicro. Performance is crap because they're both on the same PCI bus, but it was cheap and "sufficient" that way.
 
Boomslang said:
Yup, Supermicro. Performance is crap because they're both on the same PCI bus, but it was cheap and "sufficient" that way.
Click to expand...
Yeah PCI-E does have benefits if using multiple controllers. :)
Nice system.

Mine is OCEing to a 5th WD7500AAKS now. Now I need to find a way to do a complete backup while swapping to GPT. I just realized my 2.25TiB array shows as 2048GB + 48GB in windows. :/
 
Just setup a new storage server for my VMWare lab and to upgrade my media storage. I'm running OpenFiler 2.3 and presenting all the storage as iSCSI to my ESX hosts and VMs. I'm using the onboard sata controller for the OS drives and a Dell Perc5i for the storage drives. The drive layout is: 2 x 250GB in Software RAID1 for OS, 4 x 500GB in hardware RAID10 for the VMFS, and 4 x 1TB in hardware RAID5 for media storage. Rest of the system specs: Q6600, 8GB DDR2, Lian Li PC-V2000B case, 2 Intel gigabit NICs for SAN traffic, onboard gigabit NIC for network traffic.

The Lab
vmware%20lab02.jpg


Storage Server front
vmware%20lab07.jpg


Side:
vmware%20lab04.jpg


Side open:
vmware%20lab06.jpg


Drives:
vmware%20lab05.jpg


ESX Hosts
vmware%20lab01.jpg
 
EarthWatts 500w

System
RAID1 (mdadm)
2 x 250gb WD
250gb

Store
RAID5 (3ware 9650se)
4 x 500gb Samsung
1.5T

Backup
1 x 500gb Samsung
500gb

Total Space: 2.25T

2820090245_88ed146644_b.jpg
 
ACK! Sorry, didn't mean to break the thread rules, will repost in the discussion thread. DOH!
 
Vantec Stealth 520-Watt

RAID 6 (Linux Soft-RAID)
2 HighPoint RocketRAID 454
16 300GB IDE Seagate Barracuda 7200.8 (ST3300831A)

Singles Drives:
1 250GB Seagate scratch & boot disk

5020 GB Advertised space
~4TB Available space

horde-small.jpg

PIC00023.JPG

(Pics are from 2006 and kinda sad. Next dusting i will take updated ones)

Code: 
horde:/$ cat /proc/mdstat 
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10] 
md1 : active raid6 hde1[0] hdt1[15] hds1[14] hdr1[13] hdq1[12] hdp1[11] hdo1[10] hdn1[9] hdm1[8] hdl1[7] hdk1[6] hdj1[5] hdi1[4] hdh1[3] hdg1[2] hdf1[1]
      4102244608 blocks level 6, 64k chunk, algorithm 2 [16/16] [UUUUUUUUUUUUUUUU]
      
unused devices: <none>
horde:/$ df -H /mnt/storage
Filesystem             Size   Used  Avail Use% Mounted on
/dev/md1               4.3T   4.0T   225G  95% /mnt/storage
 



(click the thumbnails)

Power supply:
Zippy/Emacs HP2-6460P 460W

3ware 9650SE-8LPML
RAID 5
8x WD10EACS 1TB

Other system specs:
Intel D965WH
Celeron 420
2x512MB Kingston Value RAM
512MB Transcend DOM (for the OS)
Supermicro M35T (yes the drive labels are messed up from when I upgraded to 1TB drives lol)
Adaptec 335SAS
Lian Li case (so old I do not recall the model)

OS: Debian Etch

Total advertised space: 8TB
Total space with array: 7TB
Total array space after formatting: 6.2TB
 


e5420@3ghz.jpg


PSU 900w redundant in Supermicro SC846E1 chassis
Array 1 12x 1TB WD1000FYPS RAID 6
Array 2 6x 500GB D5000YS RAID5
Supermicro AOC-USAS-H4iR SAS controller using LSISAS1078 controller
Boot Array 2x150GB WD Raptors RAID1
Onboard Intel RAID controller

15TB total
or
9.08TB usable misc array
2.26TB usable Pr0n array

Underneath is my old server

PSU 400w redundant
8x120GB WD special edition drives RAID5
3Ware 7508
2x36GB 10k Fujitsu RAID1
LSI Elite 1600
 
My new gong show of a home file server. It was supposed to be a cheap project I was given a DFI lan party sli which posted once and then killed my processor. So my cheap project went over budget by a factor of 2 because now I need a new processor, mobo and ram... Then they sold me a sodimm rather then full size stick grr

Antec 300 mid tower
Asus P5QL PRO
Intel e7200 (stock speed)
1 gig of ram
ATI x1900
Win2k3
Promise ultra 66 to give me an extra 2 channels

3x160 IDE WD drives
5x640 SATA2 WD drives (software Raid 5)
1x500 USB Seagate drive

Useable space after format
2.32TB Raid 5
912GB other jbod

The machine just serves me so I'm not worried about software raid overhead
I already have plans for upgrading the space and the ram will be upped next paycheck

pc.jpg
 
OS: Windows Server 2003 R2
Power Supply: 2x 500W
RAID Controller: AMCC 3ware Escalade 9550SX-8LP, PCI-X 133MHz

RAID5
  • 8 x Samsung 500GB HD502IJ SATA (Raid5)

Single HDDs:
  • 1 x Samsung 120GB
  • 1 x Samsung 400GB
  • 1 x Samsung 500GB HD502IJ SATA

Total Amount of Advertised Space - 5,02TB

controlleren3.jpg


minidsc02876rc7.jpg


minidsc02878wk3.jpg


miniserverih8.jpg
 
New DDR2 based SSD.

backside.jpg


(Edit: Nuts... why is the image not showing? Link works)
 
Here are my storage servers:

spiderof1/spiderof2

coolermaster.JPG


spiderof1

Disk summary
spiderof13dm2.JPG


Inside
centinside.JPG


Specs:
Coolermaster Centurion 590
3ware 9650-8ML
3Ware 9500-8
Samsung Spinpoint 750x8
Opteron 165
Asus K8N-LR

spiderof2

Disk summary
spiderof23dm2.JPG


Inside
stackinside.JPG


Specs:
Coolermaster Stacker
3ware 9550SX-8
Seagate 7200.11 1TBx4
WD Green 1TBx4
Opteron 165
Asus K8N-LR

Spideresx

smdrives.JPG

sminside.JPG


Specs

Seagate 7200.9 500GB x 4 + hotspare
Intel 5430x2
Supermicro MBD-X7DVA-E-O
SUPERMICRO CSE-743T-645B
Dell Perc 5i
 
I guess now that it's officially in use I can post it here

Full work log here

Power Supply : Corsair 1000HX

RAID Level (if any): Raid 6
RAID Controller: Areca 1280ML
Quantity and Name of drives in the RAID array:

19 Seagate ST31000340AS 1TB drives in Raid 6 + 1 hot spare for total of 20
Singles Drives (if any)
80GB Seagate Sata boot drive

Total Amount of Advertised (before formatting) Space: 17 TB

drives.jpg


PICT0715.JPG


PICT0719.JPG


PICT0722.JPG
 
OS: Windows Server 2003 R2
Power Supply: 2 x 650W
RAID Controller: Areca/Tekram ARC-1231ML, PCIe x8

RAID6
* 12 x Seagate Barracuda 7200.11 1000GB SATA II (ST31000340AS) (Raid6)

Single HDDs:
* 1 x Western Digital 80GB
* 1 x Samsung 500GB
* 1 x Seagate Barracuda 7200.11 1000GB SATA II (ST31000340AS)

Total Amount of Advertised Space - 9,09TB





 
Status
Not open for further replies.
Back
Top