Configuring the Open Compute Open Vault 2U Knox Unit JBOD storage array

The Wiwynn ST7110-30A is a 30 drive SAS/SATA JBOD storage array designed around the Open Compute (OCP) platform. Known as the “Knox Unit” or “Knox Device”, it is manufactured by Wiwynn. The unit is field serviceable, completely tool-less, entirely redundant, and quite easy to manage and configure. See the entire feature breakdown here.

Device Information

Wiwynn ST7110-30A
Wiwynn ST7110-30A
Highlights
● Highest storage density in the industry
● Tool-less design for easy maintenance
● Hot-pluggable HDD
● Full redundant data path to each HDD
● Hot-plug and redundant cooling for high availability
Specification

 Form Factor  2U 30 3.5″ disk drives
 SAS Expander  LSI 2X28
 Hard Drive  Up to thirty 3.5” hot-plug SAS/SATA HDD
 I/O  four ports SAS 6Gb/s
 Power  Busbar 12VDC

The array shows up under /proc/scsi/scsi as the Wiwynn Knox2U storage server.

cat /proc/scsi/scsi
Attached devices:
Host: scsi0 Channel: 00 Id: 46 Lun: 00
Vendor: Wiwynn Model: Knox2U Rev: 0e3
Type: Enclosure ANSI SCSI revision: 05

Host: scsi4 Channel: 00 Id: 00 Lun: 00
Vendor: ATA Model: KINGSTON SV300S3 Rev: 505A
Type: Direct-Access ANSI SCSI revision: 05

Host: scsi0 Channel: 02 Id: 00 Lun: 00
Vendor: LSI Model: MR9286CV-8e Rev: 3.19
Type: Direct-Access ANSI SCSI revision: 05

In our OCP Winterfell servers we are using the LSI MEGARAID SAS 9286CV-8E controller that you can see in the above output.

Linux Configuration

To configure the OCP Open Vault on your RHEL/CentOS flavors, grab the driver and MegaCLI files and get them downloaded to your server. The next step is to install the RPM’s.

rpm -ivh MegaCli-38.07.07-1.noarch.rpm megaraid_sas-06.601.06.00_centos6.3-1.src.rpm

Then, install the driver

modprobe megaraid_sas

I create a symbolic link so I don’t have to type the full, case-sensitive path:

ln -s /opt/MegaRAID/MegaCli/MegaCli64 /usr/bin/megacli

Use MegaCLI to list your controller and attached devices:

megacli -PDList -aALL | egrep 'Adapter|Enclosure|Slot|Inquiry'

Below is a sample output:

./MegaCli -PDList -aALL | egrep 'Adapter|Enclosure|Slot|Inquiry'
Adapter #0
Enclosure Device ID: 38
Slot Number: 0
Enclosure position: 1
Inquiry Data: SEAGATE ST3600057SS     00086SL6GY1P            
Enclosure Device ID: 38
Slot Number: 1
Enclosure position: 1
Inquiry Data: SEAGATE ST3600057SS     00086SL6KVKM            
Enclosure Device ID: 38
Slot Number: 2
Enclosure position: 1
Inquiry Data: SEAGATE ST3600057SS     00086SL6KT0G

Create raid 1 volume using disk 0 and disk 1

megacli -CfgLdAdd -r1' [38:0,38:1]' -a0

Create raid 5 volume using disk 0-14

megacli -CfgLdAdd -r5 '[38:0,38:1,38:2,38:3,38:4,38:5,38:6,38:7,38:8,38:9,38:10,38:11,38:12,38:13,38:14]' -a0 -NoLog

Create individual raid 0 volumes on drives 2-14

i=2; while [ $i -le 14 ] ; do megacli -cfgldadd -r0 [38:${i}] WB RA Cached CachedBadBBU -strpsz512 -a0 -NoLog ; i=`expr $i + 1`; done

VMware Configuration

The installation on ESXi is somewhat similar, you use VIB files instead of RPM’s however. You can download the LSI MegaRaid SAS drivers for ESXi from VMware’s Website.

First, SCP the VIB file to /tmp on ESXi node

Install vib file on ESXi

esxcli software vib install -v /tmp/vmware-esx-MegaCli-38.07.07.vib --no-sig-check

cd to /opt/lsi/MegaCli

cd /opt/lsi/MegaCLI

Find Enclosure ID

./MegaCli -PDList -aALL | egrep 'Adapter|Enclosure|Slot|Inquiry'

Create raid 1 volume with disk 0 and 1

./MegaCli -CfgLdAdd -r1' [38:0,38:1]' -a0

Create individual raid 0 volumes on drives 2-14

i=0; while [ $i -le 14 ] ; do ./MegaCli -cfgldadd -r0 [38:${i}] WB RA Cached CachedBadBBU -strpsz512 -a0 -NoLog ; i=`expr $i + 1`; done

MegaCLI usage examples

List all controllers and all volumes there

./MegaCli -LDInfo -Lall -aALL

Create raid 50 span volume across two arrays

./MegaCli -CfgSpanAdd -r50 -Array0[38:0,38:1,38:2,38:3,38:4,38:5] -Array1[38:6,38:7,38:8,38:9,38:10,38:11] Direct RA WB -a0

Bring physical drive online

./MegaCli -PDMakeGood -PhysDrv[38:14] -a0

Show drive status

./MegaCli -PDList -a0

Author: Eric Sarakaitis

I'm Eric, I love to cook, sing, garden and enjoy cold beverages!