Configuring the Open Compute Open Vault 2U Knox Unit JBOD storage array
The Wiwynn ST7110-30A is a 30 drive SAS/SATA JBOD storage array designed around the Open Compute (OCP) platform. Known as the “Knox Unit” or “Knox Device”, it is manufactured by Wiwynn. The unit is field serviceable, completely tool-less, entirely redundant, and quite easy to manage and configure. See the entire feature breakdown here.
Device Information
Highlights ● Highest storage density in the industry ● Tool-less design for easy maintenance ● Hot-pluggable HDD ● Full redundant data path to each HDD ● Hot-plug and redundant cooling for high availability Specification |
Form Factor | 2U 30 3.5″ disk drives |
SAS Expander | LSI 2X28 |
Hard Drive | Up to thirty 3.5” hot-plug SAS/SATA HDD |
I/O | four ports SAS 6Gb/s |
Power | Busbar 12VDC |
The array shows up under /proc/scsi/scsi as the Wiwynn Knox2U storage server.
cat /proc/scsi/scsi Attached devices: Host: scsi0 Channel: 00 Id: 46 Lun: 00 Vendor: Wiwynn Model: Knox2U Rev: 0e3 Type: Enclosure ANSI SCSI revision: 05 Host: scsi4 Channel: 00 Id: 00 Lun: 00 Vendor: ATA Model: KINGSTON SV300S3 Rev: 505A Type: Direct-Access ANSI SCSI revision: 05 Host: scsi0 Channel: 02 Id: 00 Lun: 00 Vendor: LSI Model: MR9286CV-8e Rev: 3.19 Type: Direct-Access ANSI SCSI revision: 05
In our OCP Winterfell servers we are using the LSI MEGARAID SAS 9286CV-8E controller that you can see in the above output.
Linux Configuration
To configure the OCP Open Vault on your RHEL/CentOS flavors, grab the driver and MegaCLI files and get them downloaded to your server. The next step is to install the RPM’s.
rpm -ivh MegaCli-38.07.07-1.noarch.rpm megaraid_sas-06.601.06.00_centos6.3-1.src.rpm
Then, install the driver
modprobe megaraid_sas
I create a symbolic link so I don’t have to type the full, case-sensitive path:
ln -s /opt/MegaRAID/MegaCli/MegaCli64 /usr/bin/megacli
Use MegaCLI to list your controller and attached devices:
megacli -PDList -aALL | egrep 'Adapter|Enclosure|Slot|Inquiry'
Below is a sample output:
./MegaCli -PDList -aALL | egrep 'Adapter|Enclosure|Slot|Inquiry' Adapter #0 Enclosure Device ID: 38 Slot Number: 0 Enclosure position: 1 Inquiry Data: SEAGATE ST3600057SS 00086SL6GY1P Enclosure Device ID: 38 Slot Number: 1 Enclosure position: 1 Inquiry Data: SEAGATE ST3600057SS 00086SL6KVKM Enclosure Device ID: 38 Slot Number: 2 Enclosure position: 1 Inquiry Data: SEAGATE ST3600057SS 00086SL6KT0G
Create raid 1 volume using disk 0 and disk 1
megacli -CfgLdAdd -r1' [38:0,38:1]' -a0
Create raid 5 volume using disk 0-14
megacli -CfgLdAdd -r5 '[38:0,38:1,38:2,38:3,38:4,38:5,38:6,38:7,38:8,38:9,38:10,38:11,38:12,38:13,38:14]' -a0 -NoLog
Create individual raid 0 volumes on drives 2-14
i=2; while [ $i -le 14 ] ; do megacli -cfgldadd -r0 [38:${i}] WB RA Cached CachedBadBBU -strpsz512 -a0 -NoLog ; i=`expr $i + 1`; done
VMware Configuration
The installation on ESXi is somewhat similar, you use VIB files instead of RPM’s however. You can download the LSI MegaRaid SAS drivers for ESXi from VMware’s Website.
First, SCP the VIB file to /tmp on ESXi node
Install vib file on ESXi
esxcli software vib install -v /tmp/vmware-esx-MegaCli-38.07.07.vib --no-sig-check
cd to /opt/lsi/MegaCli
cd /opt/lsi/MegaCLI
Find Enclosure ID
./MegaCli -PDList -aALL | egrep 'Adapter|Enclosure|Slot|Inquiry'
Create raid 1 volume with disk 0 and 1
./MegaCli -CfgLdAdd -r1' [38:0,38:1]' -a0
Create individual raid 0 volumes on drives 2-14
i=0; while [ $i -le 14 ] ; do ./MegaCli -cfgldadd -r0 [38:${i}] WB RA Cached CachedBadBBU -strpsz512 -a0 -NoLog ; i=`expr $i + 1`; done
MegaCLI usage examples
List all controllers and all volumes there
./MegaCli -LDInfo -Lall -aALL
Create raid 50 span volume across two arrays
./MegaCli -CfgSpanAdd -r50 -Array0[38:0,38:1,38:2,38:3,38:4,38:5] -Array1[38:6,38:7,38:8,38:9,38:10,38:11] Direct RA WB -a0
Bring physical drive online
./MegaCli -PDMakeGood -PhysDrv[38:14] -a0
Show drive status
./MegaCli -PDList -a0
Tags: cloud computing, Facebook Servers, Facebook Storage, OCP, Open Compute, Open Vault