iSCSI und OCFS2

Hi,

ich versucher gerade ein OCFS2 Cluster mit einem iSCSI LUN zu bauen. Leider ist das File system immer nicht gemountet, wenn ich das System neustarte. Ich vermute es liegt daran, dass das OCFS2 Cluster vor dem iSCSI Initiator gestartet wird.

Aber erstmal zum Setup selbst:

Code:
root@kvm01:~# cat /etc/iscsi/nodes/iqn.2006-06.com.quadstor.vdisk.vlan56lun1/10.10.55.3,3260,1/default 
# BEGIN RECORD 2.0-871
node.name = iqn.2006-06.com.quadstor.vdisk.vlan56lun1
node.tpgt = 1
node.startup = automatic
iface.iscsi_ifacename = default
iface.transport_name = tcp
node.discovery_address = 10.10.55.3
node.discovery_port = 3260
node.discovery_type = send_targets
node.session.auth.authmethod = CHAP
node.session.auth.username = kvm
node.session.auth.password = kvm
node.session.initial_cmdsn = 0
node.session.initial_login_retry_max = 8
node.session.xmit_thread_priority = -20
node.session.cmds_max = 128
node.session.queue_depth = 32
node.session.auth.authmethod = None
node.session.timeo.replacement_timeout = 120
node.session.err_timeo.abort_timeout = 15
node.session.err_timeo.lu_reset_timeout = 20
node.session.err_timeo.host_reset_timeout = 60
node.session.iscsi.FastAbort = Yes
node.session.iscsi.InitialR2T = No
node.session.iscsi.ImmediateData = Yes
node.session.iscsi.FirstBurstLength = 262144
node.session.iscsi.MaxBurstLength = 16776192
node.session.iscsi.DefaultTime2Retain = 0
node.session.iscsi.DefaultTime2Wait = 2
node.session.iscsi.MaxConnections = 1
node.session.iscsi.MaxOutstandingR2T = 1
node.session.iscsi.ERL = 0
node.conn[0].address = 10.10.55.3
node.conn[0].port = 3260
node.conn[0].startup = manual
node.conn[0].tcp.window_size = 524288
node.conn[0].tcp.type_of_service = 0
node.conn[0].timeo.logout_timeout = 15
node.conn[0].timeo.login_timeout = 15
node.conn[0].timeo.auth_timeout = 45
node.conn[0].timeo.noop_out_interval = 5
node.conn[0].timeo.noop_out_timeout = 5
node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
node.conn[0].iscsi.HeaderDigest = None
node.conn[0].iscsi.DataDigest = None
node.conn[0].iscsi.IFMarker = No
node.conn[0].iscsi.OFMarker = No
# END RECORD
root@kvm01:~#

Code:
root@kvm01:~# fdisk -l /dev/sdb
Note: sector size is 4096 (not 512)

Disk /dev/sdb: 107.4 GB, 107374182400 bytes
255 heads, 63 sectors/track, 1631 cylinders
Units = cylinders of 16065 * 4096 = 65802240 bytes
Sector size (logical/physical): 4096 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 131072 bytes
Disk identifier: 0x02020202

Disk /dev/sdb doesn't contain a valid partition table
root@kvm01:~# ls -l /dev/disk/by-uuid/
total 0
lrwxrwxrwx 1 root root 10 Jan  4 13:13 1c4e7e27-b7e0-47c4-a635-a30d5c3b8552 -> ../../dm-1
lrwxrwxrwx 1 root root 10 Jan  4 13:13 34986827-9b4b-4223-b784-c1a70ed4b2b8 -> ../../sda1
lrwxrwxrwx 1 root root 10 Jan  4 13:13 6eabbc07-cea9-45ec-97d8-dc41116e99da -> ../../dm-0
lrwxrwxrwx 1 root root  9 Jan  4 13:13 f1d886a6-bc0d-412e-8290-c503d2c7bfac -> ../../sdb
root@kvm01:~#

Das iSCSI LUN ist nach einem Systemstart sichtbar.

Code:
root@kvm01:~# cat /etc/ocfs2/cluster.conf 
cluster:
        node_count = 2
        name = ocfs2

node:
        ip_port = 7777
        ip_address = 10.10.55.100
        number = 0
        name = kvm01
        cluster = ocfs2

node:
        ip_port = 7777
        ip_address = 10.10.55.101
        number = 1
        name = kvm02
        cluster = ocfs2
root@kvm01:~#

Code:
root@kvm01:~# cat /etc/fstab 
...
/dev/disk/by-uuid/f1d886a6-bc0d-412e-8290-c503d2c7bfac  /kvm/quadstor00  ocfs2  _netdev         0 0
root@kvm01:~#

Hier sieht man jetzt die Startreihenfolge:

Code:
root@kvm01:/etc/rcS.d# ls -l
total 4
...
lrwxrwxrwx 1 root root  20 Jan  4 08:21 S13networking -> ../init.d/networking
...
lrwxrwxrwx 1 root root  14 Jan  4 11:34 S14o2cb -> ../init.d/o2cb
...
lrwxrwxrwx 1 root root  15 Jan  4 11:34 S15ocfs2 -> ../init.d/ocfs2
...
lrwxrwxrwx 1 root root  20 Jan  4 11:01 S18open-iscsi -> ../init.d/open-iscsi
...
root@kvm01:/etc/rcS.d#

Open-iSCSI startet also nach OCFS - kann ansich nicht funktionieren oder? Allerdings lost ein mount -a nach dem Systemstart alle Probleme - nur ist es eben nicht automatisch ;)

In der syslog sieht man folgendes:

Code:
Jan  4 13:13:52 kvm01 kernel: [    4.553727] Loading iSCSI transport class v2.0-870.
Jan  4 13:13:52 kvm01 kernel: [    4.588790] iscsi: registered transport (tcp)
Jan  4 13:13:52 kvm01 kernel: [    4.626794] OCFS2 Node Manager 1.5.0
Jan  4 13:13:52 kvm01 kernel: [    4.643030] OCFS2 DLM 1.5.0
Jan  4 13:13:52 kvm01 kernel: [    4.646650] ocfs2: Registered cluster interface o2cb
Jan  4 13:13:52 kvm01 kernel: [    4.674494] iscsi: registered transport (iser)
Jan  4 13:13:52 kvm01 kernel: [    4.685894] OCFS2 DLMFS 1.5.0
Jan  4 13:13:52 kvm01 kernel: [    4.688291] OCFS2 User DLM kernel interface loaded
Jan  4 13:13:52 kvm01 kernel: [    4.964631] scsi3 : iSCSI Initiator over TCP/IP
Jan  4 13:13:52 kvm01 kernel: [    5.978281] scsi 3:0:0:0: Direct-Access     QUADSTOR VDISK            2.0  PQ: 0 ANSI: 5
Jan  4 13:13:52 kvm01 kernel: [    5.979181] sd 3:0:0:0: Attached scsi generic sg2 type 0
Jan  4 13:13:52 kvm01 kernel: [    5.984788] sd 3:0:0:0: [sdb] 26214400 4096-byte logical blocks: (107 GB/100 GiB)
Jan  4 13:13:52 kvm01 kernel: [    5.992920] sd 3:0:0:0: [sdb] Write Protect is off
Jan  4 13:13:52 kvm01 kernel: [    5.992923] sd 3:0:0:0: [sdb] Mode Sense: 2b 00 00 08
Jan  4 13:13:52 kvm01 kernel: [    5.993815] sd 3:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Jan  4 13:13:52 kvm01 kernel: [    5.994517] sd 3:0:0:0: [sdb] 26214400 4096-byte logical blocks: (107 GB/100 GiB)
Jan  4 13:13:52 kvm01 kernel: [    6.002531]  sdb: unknown partition table
Jan  4 13:13:52 kvm01 kernel: [    6.008787] sd 3:0:0:0: [sdb] 26214400 4096-byte logical blocks: (107 GB/100 GiB)
Jan  4 13:13:52 kvm01 kernel: [    6.013752] sd 3:0:0:0: [sdb] Attached SCSI disk
...
Jan  4 13:13:52 kvm01 iscsid: connection1:0 is operational now

Ich dachte eigentlich, dass der _netdev Parameter solche Probleme vermeiden soll, oder ist hier was ganz anderes faul?

ciao
serow
 
Hi,

wenn ich in der /etc/fstab statt /dev/disk/by-uuid/<uuid> einfach /dev/sdb eintrage, funktioniert alles. Scheinbar werden die Symlinks erst später angelegt.

Seltsam, aber scheint wohl so zu sein.

Gruesse
serow
 
Zurück
Oben