From: Feed the (ZUDZUG) [#1]
4 Feb 12:12
To: ALL
From: Insert Smiley (CMERE) [#2]
4 Feb 13:26
To: Feed the (ZUDZUG) [#1] 4 Feb 14:18
From: Feed the (ZUDZUG) [#3]
4 Feb 14:19
To: Insert Smiley (CMERE) [#2] 4 Feb 16:01
From: Insert Smiley (CMERE) [#4]
4 Feb 16:04
To: Feed the (ZUDZUG) [#3] 4 Feb 17:59
From: Arglex1 [#5]
4 Feb 17:42
To: Insert Smiley (CMERE) [#4] 5 Feb 12:04
From: Feed the (ZUDZUG) [#6]
4 Feb 18:00
To: Insert Smiley (CMERE) [#4] 5 Feb 12:04
From: GET BENT! (BOTLROKIT) [#7]
5 Feb 0:49
To: Arglex1 [#5] 5 Feb 9:38
From: Insert Smiley (CMERE) [#8]
5 Feb 12:05
To: Feed the (ZUDZUG) [#6] 5 Feb 13:07
From: Insert Smiley (CMERE) [#9]
5 Feb 12:44
To: Arglex1 [#5] 5 Feb 13:32
Opensolaris on commodity hardware.
1 x Intel Quad-Core Xeon E5405 / 2 GHz ( 1333 MHz ) - LGA771 Socket -
1 x SUPERMICRO X7DWE
2 x Intel RAID Controller SASUC8I
8 GB 4 x 2 GB Memory
1 x Supermicro AOC-SIMLP-3+
2 x Transcend 2.5" Solid State 64 GB -
2 x FUJITSU Mobile MHZ2160BJ - 2.5" 160 GB
1 x QLogic QLE2562 - PCI Express 2.0 8Gb Fibre Channel HBA
1 x Network adapter - PCI Express x4 - 4 Port Gigabit
1 x Supermicro SC846 E2-R900B
24 x 2TB Seagate Barracuda 7200RPM Sata
Plus some misc. parts and cables to put everything together. Comes in around $11,000 for 48 Raw TB of Storage. We're putting two of this model in place for D2D backups and archival storage. We built another one with 15k SAS drives for one of our departments that needed faster disk access and throughput. It was a bit more, but still MUCH less than any of the proprietary solutions out there.
A few nice things about the setup:
Opensolaris, zpools, and zfs are the bomb. We have incredible flexiblity in how we can present the storage to our network, zfs is FAST, there's no zero write hole issue to worry about, and dedupe is around the corner.
We've built a lot of redundancy into it, the second raid controller is redundant to the first through the chassis backplane, all the drives are hot swap, 2 drives for an OS mirror, and 2 drives for the zfs log mirror. About the only real worry right now is the MB/CPU, but we have spare parts on hand and I can swap them out in about 20 minutes if I need to. Which brings up another nice thing, I can keep spare drives on hand to swap in at a moments notice, unlike some other storage vendors...
The SAS unit is very fast, I was getting iop numbers equal to the enterprise stuff we have.Using the built in benchmark tool that Opensolaris has, I was getting 22000 iops over 14 drives using their database simulation and approx. 270MB/sec read/write using the file server test. Benchmarking the SATA unit next week.
The drawback to opensolaris is you better be able to manage it, there's no pretty gui or webpage, it's all command line, but if you're familiar with linux then you'll be OK.
It IS OS agnostic, so windows server will work, however we found that we lost about 30% of the performance in testing.
From: Arglex1 [#10]
5 Feb 14:43
To: Insert Smiley (CMERE) [#9] 5 Feb 16:13
Cool.
CLI stuff is absolutely no prob for us. 90% of our infrastructure is now running open source in one way or another. We typically manage all of or servers through ssh.
The only windows stuff we use are domain controllers now. Active Directory is pretty much it.
From: Insert Smiley (CMERE) [#11]
5 Feb 16:15
To: Arglex1 [#10] 5 Feb 16:16
From: Arglex1 [#12]
5 Feb 16:17
To: Insert Smiley (CMERE) [#11] 5 Feb 16:25
That's funny, we have run into Samba issues with our AD forest and multiple domains.
I am actually in the process of migrating a large amount of our users onto a single domain spanning multiple sites with multi-homed samba servers.
From: Insert Smiley (CMERE) [#13]
5 Feb 16:29
To: Arglex1 [#12] 5 Feb 16:40
From: Arglex1 [#14]
5 Feb 16:43
To: Insert Smiley (CMERE) [#13] 5 Feb 16:47
Our main goal with a San is for our Linux servers. The main one being our Cluster running Zimbra.
Currently we have 4TB internal SAS (0+1). As our storage is growing, we are seeing more and more the need for a San.
We started offering hosted mailboxes on our Zimbra setup (plus BES) to small businesses and the response has been awesome. In the past year we double the accounts on the system and have not lost a single customer. The referrals are amazing.
From: Insert Smiley (CMERE) [#15]
5 Feb 16:50
To: Arglex1 [#14] 5 Feb 16:52