Monday, April 2, 2012

Meanwhile, Cluster Storage

Interesting dmesg:

[ 3773.406686] iscsi_trgt: Abort Task (01) issued on tid:1 lun:1 by sid:844424967684608 (Function Complete)
[ 3801.645553] iscsi_trgt: cmnd_rx_start(1863) 1 4b000010 -7
[ 3801.645861] iscsi_trgt: cmnd_skip_pdu(475) 4b000010 1 28 0
[ 3863.275926] iscsi_trgt: Abort Task (01) issued on tid:1 lun:1 by sid:844424967684608 (Function Complete)
[ 3863.276207] iscsi_trgt: Abort Task (01) issued on tid:1 lun:1 by sid:844424967684608 (Function Complete)
[ 3873.259744] iscsi_trgt: Abort Task (01) issued on tid:1 lun:1 by sid:844424967684608 (Function Complete)
[ 3873.260209] iscsi_trgt: Logical Unit Reset (05) issued on tid:1 lun:1 by sid:844424967684608 (Function Complete)
[ 3883.243507] iscsi_trgt: Abort Task (01) issued on tid:1 lun:1 by sid:844424967684608 (Function Complete)
[ 3883.243788] iscsi_trgt: Target Warm Reset (06) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 3893.227235] iscsi_trgt: Abort Task (01) issued on tid:1 lun:1 by sid:844424967684608 (Function Complete)
[ 4019.005333] iscsi_trgt: Abort Task (01) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4019.005688] iscsi_trgt: Abort Task (01) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4028.989010] iscsi_trgt: Abort Task (01) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4028.989375] iscsi_trgt: Logical Unit Reset (05) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4038.972785] iscsi_trgt: Abort Task (01) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4038.973091] iscsi_trgt: Target Warm Reset (06) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4048.956574] iscsi_trgt: Abort Task (01) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4090.888634] iscsi_trgt: Abort Task (01) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4090.888985] iscsi_trgt: Logical Unit Reset (05) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4090.889242] iscsi_trgt: Target Warm Reset (06) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4090.889575] iscsi_trgt: scsi_cmnd_start(972) 16000010 0
[ 4090.897476] iscsi_trgt: cmnd_skip_pdu(475) 16000010 1c 0 0
[ 4100.873321] iscsi_trgt: Abort Task (01) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4100.873629] iscsi_trgt: Logical Unit Reset (05) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4100.873892] iscsi_trgt: Target Warm Reset (06) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4142.810375] iscsi_trgt: Abort Task (01) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4142.810768] iscsi_trgt: Logical Unit Reset (05) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4142.811135] iscsi_trgt: Target Warm Reset (06) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4142.811485] iscsi_trgt: scsi_cmnd_start(972) 56000010 0
[ 4142.819205] iscsi_trgt: cmnd_skip_pdu(475) 56000010 1c 0 0
[ 4152.795191] iscsi_trgt: Abort Task (01) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4152.795542] iscsi_trgt: Logical Unit Reset (05) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4152.795799] iscsi_trgt: Target Warm Reset (06) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4194.738037] iscsi_trgt: Abort Task (01) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4194.738300] iscsi_trgt: Logical Unit Reset (05) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4194.738583] iscsi_trgt: Target Warm Reset (06) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4194.738789] iscsi_trgt: scsi_cmnd_start(972) 68000010 0
[ 4194.746329] iscsi_trgt: cmnd_skip_pdu(475) 68000010 1c 0 0
[ 4204.721919] iscsi_trgt: Abort Task (01) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4204.722125] iscsi_trgt: Logical Unit Reset (05) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4204.722380] iscsi_trgt: Target Warm Reset (06) issued on tid:1 lun:0 by sid:844424967684608 (Function Complete)
[ 4245.655427] iscsi_trgt: nop_out_start(907) ignore this request 69000010
[ 4245.663146] iscsi_trgt: cmnd_rx_start(1863) 0 69000010 -7
[ 4245.670986] iscsi_trgt: cmnd_skip_pdu(475) 69000010 0 0 0
[ 4246.653815] iscsi_trgt: Abort Task (01) issued on tid:1 lun:2 by sid:844424967684608 (Unknown LUN)
[ 4246.653981] iscsi_trgt: cmnd_rx_start(1863) 2 4b000010 -7
[ 4246.661635] iscsi_trgt: cmnd_skip_pdu(475) 4b000010 2 0 0

Posted by at 0 comments

Add to test#1

Finaly do:
root@cl02-n01:~# qm start 100                                                     /dev/NAS01LUN1VG0/vm-100-disk-1: read failed after 0 of 4096 at 3221159936: Input/output error
  /dev/NAS01LUN1VG0/vm-100-disk-1: read failed after 0 of 4096 at 3221217280: Input/output error
  /dev/NAS01LUN1VG0/vm-100-disk-1: read failed after 0 of 4096 at 0: Input/output error
  /dev/NAS01LUN1VG0/vm-100-disk-1: read failed after 0 of 4096 at 4096: Input/output error
  /dev/NAS01LUN1VG0/vm-100-disk-1: read failed after 0 of 4096 at 3221159936: Input/output error
  /dev/NAS01LUN1VG0/vm-100-disk-1: read failed after 0 of 4096 at 3221217280: Input/output error
  /dev/NAS01LUN1VG0/vm-100-disk-1: read failed after 0 of 4096 at 0: Input/output error
  /dev/NAS01LUN1VG0/vm-100-disk-1: read failed after 0 of 4096 at 4096: Input/output error
  /dev/NAS01LUN1VG0/vm-100-disk-1: read failed after 0 of 4096 at 3221159936: Input/output error
  /dev/NAS01LUN1VG0/vm-100-disk-1: read failed after 0 of 4096 at 3221217280: Input/output error
  /dev/NAS01LUN1VG0/vm-100-disk-1: read failed after 0 of 4096 at 0: Input/output error
  /dev/NAS01LUN1VG0/vm-100-disk-1: read failed after 0 of 4096 at 4096: Input/output error
  Volume group "NAS01LUN1VG0" not found
can't activate LV 'NAS01-LUN1:vm-100-disk-1':   Skipping volume group NAS01LUN1VG0

Hehe, now "content" via PM GUI for both NAS01-PVELUNS and NAS01-LUN1 is empty.

I successfully broke all stuff.


Posted by at 0 comments

Test#1: Check HA for Storage cluster

For this testing, I created 1 VM. Then I setuped mikrotik 5.5. MT is just because, I have ISO here :)


Read more »
Posted by at 0 comments

Prepearing for testing

The cluster is ready to use.
Now I need to add my "HA-cluster-Storage" as a storage for my virtual machines:

Go to "Datacenter"-"Storage"-""Add" - iSCSITarget
Fill
 ID:NAS01-PVELUNS
 Portal : 172.16.70.2
 Target: iqn.2012-03.nas01:iscsi.PVELUNS
 Uncheck "Use LUNs directly"

And then, "Add" - LVM group
Fill
 ID:NAS01-LUN1
 Base storage: NAS01-PVELUNS 
 Base volume: CH 00 ID 0 LUN 1
 Volume group: NAS01LUN1VG0
 Check "Shared"

Ok, now we can see:

Now lookup to node1:

root@cl02-n01:~# pvdisplay
  Found duplicate PV MiXXJdMcRElPXQPEtzc6pPFAQLhQn0lC: using /dev/sde not /dev/sdd
  --- Physical volume ---
  PV Name               /dev/sde
  VG Name               NAS01LUN1VG0
  PV Size               4.00 TiB / not usable 4.00 MiB
  Allocatable           yes
  PE Size               4.00 MiB
  Total PE              1048575
  Free PE               1047807
  Allocated PE          768
  PV UUID               MiXXJd-McRE-lPXQ-PEtz-c6pP-FAQL-hQn0lC

  --- Physical volume ---
  PV Name               /dev/sda2
  VG Name               pve
  PV Size               297.59 GiB / not usable 0
  Allocatable           yes
  PE Size               4.00 MiB
  Total PE              76183
  Free PE               4095
  Allocated PE          72088
  PV UUID               mMvpci-6zko-K3uS-VOG1-GO4Z-Nsdj-t9WbtS

What does  "Found duplicate PV MiXXJdMcRElPXQPEtzc6pPFAQLhQn0lC: using /dev/sde not /dev/sdd" mean? And why this appear?

I will thinking about it...
Posted by at 0 comments

Cluster Tips: Keep your clocks on all nodes synchronized

Yes, I had not thought of.
There is a simple solutions for my first problem is just correct time at all nodes.

So, for now cluster looking well!
Posted by at 0 comments

Saturday, March 31, 2012

Creating PM 2.0 Cluster

So, today was installed my fresh-new Proxmox Virtual Environment.

First problem occured with GUI.
Asked at forum: http://forum.proxmox.com/threads/8949-GUI-login-problem
Thinking....
Posted by at 0 comments

Proxmox VE 2.0 final release !!!

Thats' perfect!
11 hours ago, was Proxmox VE 2.0 final release !!!


First of all, will make a USB stick for instalation on my ready-to-use 4 nodes.

Posted by at 0 comments
Subscribe to: Posts (Atom)