OmniOS kasutamine: erinevus redaktsioonide vahel
| (ei näidata sama kasutaja 36 vahepealset redaktsiooni) | |||
| 4. rida: | 4. rida: | ||
===20241221 kogemus=== |
===20241221 kogemus=== |
||
| + | |||
| + | ====Tööpõhimõte==== |
||
| + | |||
| + | Väited |
||
| + | |||
| + | * omnios puhul rakendub paljuski solarise praktika, aga on ka asju mis on oluliselt erinevad, nt dns kliendiks olemine |
||
| + | * süsteemi seadistusi hoitakse smf (Service Management Facility) keskkonnas, see on tõenäoliselt mingi nö binary laadse andmebaasi moodi nähtus - binari sisu alusel genereeritakse legacy /etc/xxx.conf failie (erandiks on omnios puhul nt /etc/resolv.conf fail, tundub, et see ei tule nö binari allikast, aga on ise tavalisel viisil kohal) |
||
| + | * arvuti ip konf on kuskil binaarses allikas, tundub |
||
| + | * paketihalduse teostamiseks on erinevaid võimalusi, nad natuke eksitavad, nt 'pkg info' vs 'pkginfo' (vastaval uus ja vana) ning ka seadistuse tegemine svccfg-svcs-svcadm utiliitidega (õige komplekt) |
||
| + | * iseloomulik on et ühe muudatuse ütlemine käivitab terve ahela muudatuste juhtumise, kusjuures üllatavalt ootuspäraselt, nt iscsi klient poolse discoverdamise käivitamine lõpeb multipath ressurssi moodustamisega |
||
| + | * tundub, et omnios draiverite koosseis on ahtam võrreldes nö kommerts-solarisega (nt qlc vs qlc+qlt - qlc on qlogic fc initiator draiver; qlt on qlogic fc target draiver; omnios puhul qlt puudub üldse) |
||
| + | |||
| + | ====boot keskkondadega opereerimine==== |
||
| + | |||
| + | Boot Environment keskkondade nimekirja esitamine |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~/20241224# beadm |
||
| + | BE Active Mountpoint Space Policy Created |
||
| + | omnios-r151052 - - 4.27M static 2024-12-24 21:44 |
||
| + | omnios-r151052f NR / 1.55G static 2024-12-24 21:57 |
||
| + | pre_napp-it-22.03 - - 201K static 2024-12-24 23:02 |
||
| + | </pre> |
||
| + | |||
| + | boot env vahel liikumine |
||
| + | |||
| + | <pre> |
||
| + | beadm create be-imretest-1 |
||
| + | beadm activate be-imretest-1 |
||
| + | |||
| + | root@omnios-02:~# beadm list -s |
||
| + | BE/Snapshot Space Policy Created |
||
| + | omnios-r151052 |
||
| + | omnios-r151052f |
||
| + | pre_napp-it-22.03 |
||
| + | omnios-r151052f-1 |
||
| + | omnios-r151052f-2 |
||
| + | omnios-r151052f-3 |
||
| + | omnios-r151052f-3@2024-12-24-19:57:01 104.50K static 2024-12-24 21:57 |
||
| + | omnios-r151052f-3@2024-12-24-19:57:44 33.81M static 2024-12-24 21:57 |
||
| + | omnios-r151052f-3@2024-12-24-21:02:49 78.00M static 2024-12-24 23:02 |
||
| + | omnios-r151052f-3@2024-12-24-21:29:33 352.50K static 2024-12-24 23:29 |
||
| + | omnios-r151052f-3@2024-12-24-21:30:32 341.50K static 2024-12-24 23:30 |
||
| + | omnios-r151052f-3@2024-12-24-23:26:09 71.72M static 2024-12-25 01:26 |
||
| + | imretest-1 |
||
| + | |||
| + | root@omnios-02:~# beadm activate imretest-1 |
||
| + | Activated successfully |
||
| + | root@omnios-02:~# beadm list -s |
||
| + | BE/Snapshot Space Policy Created |
||
| + | omnios-r151052 |
||
| + | omnios-r151052f |
||
| + | pre_napp-it-22.03 |
||
| + | omnios-r151052f-1 |
||
| + | omnios-r151052f-2 |
||
| + | omnios-r151052f-3 |
||
| + | imretest-1@2024-12-24-19:57:01 104.50K static 2024-12-24 21:57 |
||
| + | imretest-1@2024-12-24-19:57:44 33.81M static 2024-12-24 21:57 |
||
| + | imretest-1@2024-12-24-23:26:09 318.50K static 2024-12-25 01:26 |
||
| + | imretest-1@2024-12-24-21:29:33 352.50K static 2024-12-24 23:29 |
||
| + | imretest-1@2024-12-24-21:30:32 341.50K static 2024-12-24 23:30 |
||
| + | imretest-1@2024-12-25-12:08:23 52K static 2024-12-25 14:08 |
||
| + | imretest-1@2024-12-24-21:02:49 78.00M static 2024-12-24 23:02 |
||
| + | imretest-1 |
||
| + | |||
| + | root@omnios-02:~# beadm list |
||
| + | BE Active Mountpoint Space Policy Created |
||
| + | omnios-r151052 - - 4.27M static 2024-12-24 21:44 |
||
| + | omnios-r151052f - - 8.19M static 2024-12-24 21:57 |
||
| + | pre_napp-it-22.03 - - 201K static 2024-12-24 23:02 |
||
| + | omnios-r151052f-1 - - 69.23M static 2024-12-24 23:29 |
||
| + | omnios-r151052f-2 N / 173.50K static 2024-12-24 23:30 |
||
| + | omnios-r151052f-3 - - 69.10M static 2024-12-25 01:26 |
||
| + | imretest-1 R - 1.63G static 2024-12-25 14:08 |
||
| + | |||
| + | root@omnios-02:~# reboot |
||
| + | </pre> |
||
| + | |||
| + | ====Võrgu seadistamine==== |
||
| + | |||
| + | Füüsiliste võrguseadmete esitamine |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# dladm show-phys |
||
| + | LINK MEDIA STATE SPEED DUPLEX DEVICE |
||
| + | qede0 Ethernet up 25000 full qede0 |
||
| + | qede1 Ethernet up 25000 full qede1 |
||
| + | </pre> |
||
| + | |||
| + | teine variant |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# dladm show-link |
||
| + | LINK CLASS MTU STATE BRIDGE OVER |
||
| + | qede0 phys 1500 up -- -- |
||
| + | qede1 phys 9000 up -- -- |
||
| + | q4062 vlan 1500 up -- qede0 |
||
| + | q84 vlan 9000 up -- qede1 |
||
| + | q88 vlan 9000 up -- qede1 |
||
| + | q2602 vlan 1500 up -- qede0 |
||
| + | </pre> |
||
| + | |||
| + | draiveri info esitamine, 'pkg info -r xxx' aitab kui pole paigaldatud, nö remote küsimine |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~/20241224# pkg info qede |
||
| + | Name: driver/network/qede |
||
| + | Summary: QLogic FastLinQ QL45xxx Ethernet Driver |
||
| + | Description: QLogic FastLinQ QL45xxx Ethernet Driver |
||
| + | Category: Drivers/Networking |
||
| + | State: Installed (Manually installed) |
||
| + | Publisher: omnios |
||
| + | Version: 0.5.11 |
||
| + | Branch: 151052.0 |
||
| + | Packaging Date: October 17, 2024 at 09:00:37 PM |
||
| + | Last Install Time: December 24, 2024 at 08:50:18 PM |
||
| + | Size: 1.84 MB |
||
| + | FMRI: pkg://omnios/driver/network/qede@0.5.11-151052.0:20241017T210037Z |
||
| + | </pre> |
||
| + | |||
| + | Võrgunduse draiverite nimekirja küsimine |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# pkg list | grep 'driver/network' |
||
| + | driver/network/afe 0.5.11-151052.0 i-- |
||
| + | driver/network/amd8111s 0.5.11-151052.0 i-- |
||
| + | driver/network/atge 0.5.11-151052.0 i-- |
||
| + | driver/network/bfe 0.5.11-151052.0 i-- |
||
| + | driver/network/bge 0.5.11-151052.0 i-- |
||
| + | driver/network/bnx 0.5.11-151052.0 i-- |
||
| + | ... |
||
| + | </pre> |
||
| + | |||
| + | kui paketihaldusega proovida eemaldada midagi põhikoosseisust, siis saab teate |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# pkg uninstall e1000g |
||
| + | Creating Plan (Solver setup): / |
||
| + | pkg uninstall: Unable to remove 'driver/network/e1000g@0.5.11-151052.0' due to the following packages that depend on it: |
||
| + | entire@11-151052.0 |
||
| + | |||
| + | root@omnios-02:~# pkg info entire |
||
| + | Name: entire |
||
| + | Summary: Minimal set of core system packages |
||
| + | Description: Meta package to specify the minimum OmniOS software set |
||
| + | State: Installed |
||
| + | Publisher: omnios |
||
| + | Version: 11 |
||
| + | Branch: 151052.0 |
||
| + | Packaging Date: October 17, 2024 at 08:27:13 PM |
||
| + | Last Install Time: November 18, 2024 at 10:02:49 AM |
||
| + | Size: 1.79 kB |
||
| + | FMRI: pkg://omnios/entire@11-151052.0:20241017T202713Z |
||
| + | </pre> |
||
| + | |||
| + | Draiveri paigaldamine ilma võrguühenduseta arvutisse, https://illumos.topicbox.com/groups/discuss/T9a8038eb86649ccd |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~/20241224# pkgrecv -s https://pkg.omnios.org/r151052/core -d /tmp/qede.p5p.storage/qede -a qede |
||
| + | |||
| + | root@omnios-02:~/20241224# pkg install --no-refresh -g /tmp/qede.p5p.storage/qede qede |
||
| + | </pre> |
||
| + | |||
| + | vlan kasutamine |
||
| + | |||
| + | <pre> |
||
| + | # dladm create-vlan -l qede0 -v 4062 q4062 |
||
| + | # dladm create-ip q4062 |
||
| + | root@omnios-02:~# dladm show-vlan |
||
| + | LINK VID OVER FLAGS |
||
| + | q4062 4062 qede0 ----- |
||
| + | |||
| + | # ipadm create-addr -T static -a 172.31.181.22/24 q4062/v4static |
||
| + | root@omnios-02:~# route add default 172.31.181.1 |
||
| + | </pre> |
||
| + | |||
| + | eheda riistvara nimekirja küsimine, ei eelda, et draiverid oleksid olemas vms |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# prtconf -d | grep -i qlogi |
||
| + | pci1077,73 (pciex1077,8070) [QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller], instance #0 |
||
| + | pci1077,73 (pciex1077,8070) [QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller], instance #1 |
||
| + | pci1590,2d4 (pciex1077,2281) [QLogic Corp. ISP2812-based 64/32G Fibre Channel to PCIe Controller] (driver not attached) |
||
| + | pci1590,2d4 (pciex1077,2281) [QLogic Corp. ISP2812-based 64/32G Fibre Channel to PCIe Controller] (driver not attached) |
||
| + | </pre> |
||
| + | |||
| + | ====dns kliendi seadistamine==== |
||
| + | |||
| + | dns kliendi seadistuse muutmine, tundub, et omnios puhul on see väga erinev solaris-proper juhtumist |
||
| + | |||
| + | * solaris-proper puhul svccfg ja co abil tehtud muudatuste tulemusena moodustatakse sobiva sisuga failid /etc/resolv.conf ja /etc/nsswitch.conf |
||
| + | * omnios puhul failide /etc/resolv.conf ja /etc/nsswitch.conf sättimise tulemusena läheb 'svcs -l dns/client' state=online asendisse |
||
| + | |||
| + | Olgu lähtepunktiks /etc/resolv.conf puudumine |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# ls -ld /etc/resolv.conf |
||
| + | /etc/resolv.conf: No such file or directory |
||
| + | |||
| + | root@omnios-02:~# svcs -l dns/client |
||
| + | fmri svc:/network/dns/client:default |
||
| + | name DNS resolver |
||
| + | enabled true |
||
| + | state offline |
||
| + | next_state none |
||
| + | state_time December 25, 2024 at 08:11:44 PM EET |
||
| + | restarter svc:/system/svc/restarter:default |
||
| + | dependency optional_all/none svc:/network/dns/install (disabled) |
||
| + | dependency require_all/none svc:/system/filesystem/minimal (online) |
||
| + | dependency require_all/none svc:/network/service (online) |
||
| + | dependency require_all/none file://localhost/etc/resolv.conf (online) |
||
| + | dependency require_any/error svc:/network/loopback (online) |
||
| + | dependency optional_all/error svc:/milestone/network (online) |
||
| + | dependency optional_all/refresh svc:/network/location:default (disabled) |
||
| + | |||
| + | root@omnios-02:~# svcs -a | grep dns |
||
| + | disabled 20:11:44 svc:/network/dns/install:default |
||
| + | disabled 20:11:45 svc:/network/dns/multicast:default |
||
| + | offline 20:11:44 svc:/network/dns/client:default |
||
| + | root@omnios-02:~# |
||
| + | </pre> |
||
| + | |||
| + | ning faili /etc/resolv.conf käsitsi tekitamine ning faili /etc/nsswitch.conf asendamine .dns variatsiooniga paneb svc osakonnas asjad korda |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# cat /etc/resolv.conf |
||
| + | domain auul.pri.ee |
||
| + | nameserver 10.192.0.53 |
||
| + | |||
| + | root@omnios-02:~# cp /etc/nsswitch.conf /etc/nsswitch.bak |
||
| + | root@omnios-02:~# cp /etc/nsswitch.dns /etc/nsswitch.conf |
||
| + | |||
| + | root@omnios-02:~# svcadm refresh dns/client |
||
| + | root@omnios-02:~# svcadm disable dns/client |
||
| + | root@omnios-02:~# svcadm enable dns/client |
||
| + | root@omnios-02:~# svcadm restart dns/client |
||
| + | </pre> |
||
| + | |||
| + | Peale rebooti dns nimelahendus toimib |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# svcs -a | grep dns |
||
| + | disabled 20:19:08 svc:/network/dns/install:default |
||
| + | disabled 20:19:09 svc:/network/dns/multicast:default |
||
| + | online 20:19:11 svc:/network/dns/client:default |
||
| + | |||
| + | root@omnios-02:~# dig +short neti.auul.pri.ee a |
||
| + | 10.154.221.184 |
||
| + | 10.154.221.183 |
||
| + | |||
| + | root@omnios-02:~# ping neti.ee |
||
| + | neti.ee is alive |
||
| + | </pre> |
||
| + | |||
| + | ====iscsi kliendi kasutamine==== |
||
| + | |||
| + | Arvuti iscsi initiator nime küsimine |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# iscsiadm list initiator-node |
||
| + | Initiator node name: iqn.1986-03.com.sun:01:982f79dec5fd.676c184c |
||
| + | Initiator node alias: - |
||
| + | Login Parameters (Default/Configured): |
||
| + | Header Digest: NONE/NONE |
||
| + | Data Digest: NONE/NONE |
||
| + | Authentication Type: NONE |
||
| + | RADIUS Server: NONE |
||
| + | RADIUS Access: disabled |
||
| + | Tunable Parameters (Default/Configured): |
||
| + | Session Login Response Time: 60/- |
||
| + | Maximum Connection Retry Time: 180/- |
||
| + | Login Retry Time Interval: 60/- |
||
| + | Configured Sessions: 1 |
||
| + | </pre> |
||
| + | |||
| + | iscsi kliendiks olemise eelduseks on '/network/iscsi/initiator' teenuse käimine |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# svcs svc:/network/iscsi/initiator:default |
||
| + | STATE STIME FMRI |
||
| + | disabled 22:41:41 svc:/network/iscsi/initiator:default |
||
| + | |||
| + | root@omnios-02:~# iscsiadm add discovery-address 10.8.4.131 |
||
| + | iSCSI Initiator Service is disabled, try 'svcadm enable network/iscsi/initiator' to enable the service. |
||
| + | For more information, please refer to iscsi(4D). |
||
| + | |||
| + | root@omnios-02:~# svcadm enable svc:/network/iscsi/initiator:default |
||
| + | |||
| + | root@omnios-02:~# svcs svc:/network/iscsi/initiator:default |
||
| + | STATE STIME FMRI |
||
| + | online 22:47:36 svc:/network/iscsi/initiator:default |
||
| + | </pre> |
||
| + | |||
| + | targeti kasutamise alustamiseks ja lõpetamiseks sobib öelda vastavalt, paistab, et automaatselt tegeldakse ka multipath teemadega |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# iscsiadm add discovery-address 10.8.4.131 |
||
| + | root@omnios-02:~# dmesg |
||
| + | ... |
||
| + | Dec 26 22:36:13 localhost genunix: [ID 936769 kern.info] sd1 is /scsi_vhci/disk@g600000e00d300000003008ec00040000 |
||
| + | Dec 26 22:36:13 localhost genunix: [ID 408114 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) online |
||
| + | Dec 26 22:36:13 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: degraded: path 5 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110000B,0 is online |
||
| + | Dec 26 22:36:14 localhost genunix: [ID 530209 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 2 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111000C,0 is online: Load balancing: round-robin |
||
| + | Dec 26 22:36:14 localhost genunix: [ID 530209 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 4 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011000A,0 is online: Load balancing: round-robin |
||
| + | Dec 26 22:36:15 localhost genunix: [ID 530209 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 3 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:00100009,0 is online: Load balancing: round-robin |
||
| + | |||
| + | root@omnios-02:~# iscsiadm remove discovery-address 10.8.4.131 |
||
| + | root@omnios-02:~# dmesg |
||
| + | ... |
||
| + | Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 2 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111000C,0 is offline |
||
| + | Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(293) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 offline#012 |
||
| + | Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 5 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110000B,0 is offline |
||
| + | Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(290) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110 offline#012 |
||
| + | Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: degraded: path 4 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011000A,0 is offline |
||
| + | Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(287) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011 offline#012 |
||
| + | Dec 26 22:37:37 localhost genunix: [ID 408114 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) offline |
||
| + | Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: failed: path 3 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:00100009,0 is offline |
||
| + | Dec 26 22:37:37 localhost genunix: [ID 408114 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) offline |
||
| + | Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(284) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010 offline#012 |
||
| + | |||
| + | </pre> |
||
| + | |||
| + | discovery puntide nimekirja esitamine |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# iscsiadm list discovery-address |
||
| + | Discovery Address: 10.8.4.131:3260 |
||
| + | </pre> |
||
| + | |||
| + | iscsi targets |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# iscsiadm list target |
||
| + | Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 |
||
| + | Alias: - |
||
| + | TPGT: 12 |
||
| + | ISID: 4000002a0000 |
||
| + | Connections: 1 |
||
| + | Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110 |
||
| + | Alias: - |
||
| + | TPGT: 11 |
||
| + | ISID: 4000002a0000 |
||
| + | Connections: 1 |
||
| + | Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011 |
||
| + | Alias: - |
||
| + | TPGT: 10 |
||
| + | ISID: 4000002a0000 |
||
| + | Connections: 1 |
||
| + | Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010 |
||
| + | Alias: - |
||
| + | TPGT: 9 |
||
| + | ISID: 4000002a0000 |
||
| + | Connections: 1 |
||
| + | </pre> |
||
| + | |||
| + | target omadused |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# iscsiadm list target -v iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 |
||
| + | Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 |
||
| + | Alias: - |
||
| + | TPGT: 12 |
||
| + | ISID: 4000002a0000 |
||
| + | Connections: 1 |
||
| + | CID: 0 |
||
| + | IP address (Local): 10.8.8.22:49993 |
||
| + | IP address (Peer): 10.8.8.132:3260 |
||
| + | Discovery Method: SendTargets |
||
| + | Login Parameters (Negotiated): |
||
| + | Data Sequence In Order: yes |
||
| + | Data PDU In Order: yes |
||
| + | Default Time To Retain: 20 |
||
| + | Default Time To Wait: 2 |
||
| + | Error Recovery Level: 0 |
||
| + | First Burst Length: 65536 |
||
| + | Immediate Data: no |
||
| + | Initial Ready To Transfer (R2T): yes |
||
| + | Max Burst Length: 262144 |
||
| + | Max Outstanding R2T: 1 |
||
| + | Max Receive Data Segment Length: 16384 |
||
| + | Max Connections: 1 |
||
| + | Header Digest: NONE |
||
| + | Data Digest: NONE |
||
| + | </pre> |
||
| + | |||
| + | paistab, et multipath käivitatakse automaatselt |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# mpathadm list lu |
||
| + | /dev/rdsk/c0t600000E00D300000003008EC00040000d0s2 |
||
| + | Total Path Count: 4 |
||
| + | Operational Path Count: 4 |
||
| + | </pre> |
||
| + | |||
| + | ning |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# mpathadm show lu /dev/rdsk/c0t600000E00D300000003008EC00040000d0s2 |
||
| + | Logical Unit: /dev/rdsk/c0t600000E00D300000003008EC00040000d0s2 |
||
| + | mpath-support: libmpscsi_vhci.so |
||
| + | Vendor: FUJITSU |
||
| + | Product: ETERNUS_DXM |
||
| + | Revision: 0000 |
||
| + | Name Type: unknown type |
||
| + | Name: 600000e00d300000003008ec00040000 |
||
| + | Asymmetric: yes |
||
| + | Current Load Balance: round-robin |
||
| + | Logical Unit Group ID: NA |
||
| + | Auto Failback: on |
||
| + | Auto Probing: NA |
||
| + | |||
| + | Paths: |
||
| + | Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff |
||
| + | Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111,12 |
||
| + | Override Path: NA |
||
| + | Path State: OK |
||
| + | Disabled: no |
||
| + | |||
| + | Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff |
||
| + | Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010,9 |
||
| + | Override Path: NA |
||
| + | Path State: OK |
||
| + | Disabled: no |
||
| + | |||
| + | Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff |
||
| + | Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011,10 |
||
| + | Override Path: NA |
||
| + | Path State: OK |
||
| + | Disabled: no |
||
| + | |||
| + | Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff |
||
| + | Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110,11 |
||
| + | Override Path: NA |
||
| + | Path State: OK |
||
| + | Disabled: no |
||
| + | |||
| + | Target Port Groups: |
||
| + | ID: 32917 |
||
| + | Explicit Failover: no |
||
| + | Access State: active optimized |
||
| + | Target Ports: |
||
| + | Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111,12 |
||
| + | Relative ID: 16533 |
||
| + | |||
| + | ID: 32900 |
||
| + | Explicit Failover: no |
||
| + | Access State: active optimized |
||
| + | Target Ports: |
||
| + | Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010,9 |
||
| + | Relative ID: 16516 |
||
| + | |||
| + | ID: 32901 |
||
| + | Explicit Failover: no |
||
| + | Access State: active optimized |
||
| + | Target Ports: |
||
| + | Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011,10 |
||
| + | Relative ID: 16517 |
||
| + | |||
| + | ID: 32916 |
||
| + | Explicit Failover: no |
||
| + | Access State: active optimized |
||
| + | Target Ports: |
||
| + | Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110,11 |
||
| + | Relative ID: 16532 |
||
| + | </pre> |
||
| + | |||
| + | ressursi enda vaatlemiseks sobib nt format käsk |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# format |
||
| + | Searching for disks...done |
||
| + | |||
| + | |||
| + | AVAILABLE DISK SELECTIONS: |
||
| + | 0. c0t600000E00D300000003008EC00040000d0 <FUJITSU-ETERNUS_DXM-0000-1.00TB> |
||
| + | /scsi_vhci/disk@g600000e00d300000003008ec00040000 |
||
| + | 1. c2t1d0 <HPE-LOGICAL VOLUME-7.11-3.49TB> |
||
| + | /pci@7a,0/pci8086,347a@2/pci103c,600@0/disk@1,0 |
||
| + | Specify disk (enter its number): ^C |
||
| + | root@omnios-02:~# |
||
| + | </pre> |
||
| + | |||
| + | ressursi kasutamiseks sobib öelda nt kusjuures eemaldamiseks tuleb esmalt teha 'zpool destory ...' ja seejärel eemaldada iscsi ressurss |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# zpool create zp_eternus_02 c0t600000E00D300000003008EC00040000d0 |
||
| + | root@omnios-02:~# iscsiadm remove discovery-address 10.8.4.131 |
||
| + | iscsiadm: Logical unit in use |
||
| + | iscsiadm: Unable to complete operation |
||
| + | </pre> |
||
| + | |||
| + | ===napp-it lahenduse kasutamine=== |
||
| + | |||
| + | ====napp-it tarkvara paigaldamine==== |
||
| + | |||
| + | * https://www.illumos.org/hcl/ |
||
| + | * https://illumos.org/man/4D/qede |
||
| + | * https://docs.oracle.com/cd/E88353_01/html/E37851/qede-4d.html |
||
| + | * https://github.com/omniosorg/omnios-wiki/blob/master/GeneralAdministration.md |
||
| + | * https://docs.brconsulting.info/en/docs/infrastructure/storage/napp-it/02-nappit-comstarsetup/ |
||
<pre> |
<pre> |
||
| 16. rida: | 516. rida: | ||
omnios-r151046an-backup-3 - - 289K static 2024-12-21 18:33 |
omnios-r151046an-backup-3 - - 289K static 2024-12-21 18:33 |
||
</pre> |
</pre> |
||
| + | |||
| + | ====iscsi teenuse seadistamine==== |
||
| + | |||
| + | Lähtepunktiks on töötav OmniOS operatsioonisüsteem, millele on paigaldatud napp-it tarkvara. |
||
| + | |||
| + | 'iscsi target service' käivitamine, valida napp-it webgui liidesest |
||
| + | |||
| + | Services -> COMSTAR -> ISCSI target service -> online |
||
| + | |||
| + | Tundub, et sellele tegevusele vastab |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# svcs svc:/network/iscsi/target:default |
||
| + | STATE STIME FMRI |
||
| + | disabled 0:05:25 svc:/network/iscsi/target:default |
||
| + | </pre> |
||
| + | |||
| + | muutumine |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# svcs svc:/network/iscsi/target:default |
||
| + | STATE STIME FMRI |
||
| + | online 0:05:25 svc:/network/iscsi/target:default |
||
| + | </pre> |
||
| + | |||
| + | LUN tekitamiseks sobib webgui liideses öelda |
||
| + | |||
| + | Comstar -> Logical Units -> create volume LU |
||
| + | |||
| + | Käsureal vastab midagi sellist |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# stmfadm list-lu -v |
||
| + | LU Name: 600144F0650F1E060000676DEE2D0001 |
||
| + | Operational Status: Online |
||
| + | Provider Name : sbd |
||
| + | Alias : /dev/zvol/rdsk/zp_eternus_02/zvol_ers_01 |
||
| + | View Entry Count : 0 |
||
| + | Data File : /dev/zvol/rdsk/zp_eternus_02/zvol_ers_01 |
||
| + | Meta File : not set |
||
| + | Size : 429496729600 |
||
| + | Block Size : 512 |
||
| + | Management URL : not set |
||
| + | Vendor ID : SUN |
||
| + | Product ID : COMSTAR |
||
| + | Serial Num : not set |
||
| + | Write Protect : Disabled |
||
| + | Writeback Cache : Disabled |
||
| + | Access State : Active |
||
| + | </pre> |
||
| + | |||
| + | Target tekitamiseks sobib öelda |
||
| + | |||
| + | Comstar -> Targets -> ++add target |
||
| + | |||
| + | PILT |
||
| + | |||
| + | kus |
||
| + | |||
| + | * Target name: iqn.2010-09.org.zfs-san:1735257824 |
||
| + | |||
| + | käsureal vastab midagi sellist |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# itadm list-target -v |
||
| + | TARGET NAME STATE SESSIONS |
||
| + | iqn.2010-09.org.zfs-san:1735257824 online 0 |
||
| + | alias: omnios-02 |
||
| + | auth: none |
||
| + | targetchapuser: - |
||
| + | targetchapsecret: unset |
||
| + | tpg-tags: default |
||
| + | </pre> |
||
| + | |||
| + | host group tekitamine |
||
| + | |||
| + | Comstar -> Host-Groups -> name of Host Group -> hg_moraal_pve |
||
| + | |||
| + | ning add members |
||
| + | |||
| + | * Select host group: hg_adala_pve |
||
| + | * Members: iqn.2004-10.com.ubuntu:01:863b8b3dace pve node iscsi initiator) |
||
| + | |||
| + | käsureal vastab midagi sellist |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# stmfadm list-hg -v |
||
| + | Host Group: hg_adala_pve |
||
| + | Member: iqn.2004-10.com.ubuntu:01:863b8b3dace |
||
| + | </pre> |
||
| + | |||
| + | target group tekitamine |
||
| + | |||
| + | Comstar -> Target-Groups -> name of new Target Group - tg_luns_for_adala_pve_initiators |
||
| + | |||
| + | ning seejärel lisada konkreetne 'target' 'target group' sisse |
||
| + | |||
| + | Comstar -> Target-Groups -> add targets |
||
| + | |||
| + | * select target: iqn.2010-09.org.zfs-san:1735257824 |
||
| + | * add to target group: tg_luns_for_adala_pve_initiators |
||
| + | |||
| + | Käsurealt vastab midagi sellist |
||
| + | |||
| + | <pre> |
||
| + | root@omnios-02:~# stmfadm list-tg -v |
||
| + | Target Group: tg_luns_for_adala_pve_initiators |
||
| + | Member: iqn.2010-09.org.zfs-san:1735257824 |
||
| + | </pre> |
||
| + | |||
| + | View tekitamiseks sobib öelda |
||
| + | |||
| + | Comstar -> |
||
| + | |||
| + | * select LOgical Unit GUID: 600144F0650F1E060000676DEE2D0001(zp_eternus_02/zvol_ers_01) |
||
| + | * and to host group: hg_moraal_pve |
||
| + | * add to target group: tg_luns_for_moraal_pve_initiators |
||
| + | |||
| + | käsurealt vastab sellele midagi |
||
| + | |||
| + | <pre> |
||
| + | TODO |
||
| + | </pre> |
||
| + | |||
| + | Target Portal Group tekitamiseks sobib öelda |
||
| + | |||
| + | Comstar -> Target Portal Groups |
||
| + | |||
| + | * name of portal group: tpg_luns_for_adala_pve_initiators |
||
| + | * select ip address for this portal - nt 10.106.2.22 (q2602) |
||
===repo paketihalduse kasutamine=== |
===repo paketihalduse kasutamine=== |
||
| 33. rida: | 663. rida: | ||
# pkg contents postfix |
# pkg contents postfix |
||
# svcadm enable postfix |
# svcadm enable postfix |
||
| + | # svcadm restart ssh |
||
<pre> |
<pre> |
||
Viimane redaktsioon: 27. detsember 2024, kell 16:22
Sissejuhatus
TODO
20241221 kogemus
Tööpõhimõte
Väited
- omnios puhul rakendub paljuski solarise praktika, aga on ka asju mis on oluliselt erinevad, nt dns kliendiks olemine
- süsteemi seadistusi hoitakse smf (Service Management Facility) keskkonnas, see on tõenäoliselt mingi nö binary laadse andmebaasi moodi nähtus - binari sisu alusel genereeritakse legacy /etc/xxx.conf failie (erandiks on omnios puhul nt /etc/resolv.conf fail, tundub, et see ei tule nö binari allikast, aga on ise tavalisel viisil kohal)
- arvuti ip konf on kuskil binaarses allikas, tundub
- paketihalduse teostamiseks on erinevaid võimalusi, nad natuke eksitavad, nt 'pkg info' vs 'pkginfo' (vastaval uus ja vana) ning ka seadistuse tegemine svccfg-svcs-svcadm utiliitidega (õige komplekt)
- iseloomulik on et ühe muudatuse ütlemine käivitab terve ahela muudatuste juhtumise, kusjuures üllatavalt ootuspäraselt, nt iscsi klient poolse discoverdamise käivitamine lõpeb multipath ressurssi moodustamisega
- tundub, et omnios draiverite koosseis on ahtam võrreldes nö kommerts-solarisega (nt qlc vs qlc+qlt - qlc on qlogic fc initiator draiver; qlt on qlogic fc target draiver; omnios puhul qlt puudub üldse)
boot keskkondadega opereerimine
Boot Environment keskkondade nimekirja esitamine
root@omnios-02:~/20241224# beadm BE Active Mountpoint Space Policy Created omnios-r151052 - - 4.27M static 2024-12-24 21:44 omnios-r151052f NR / 1.55G static 2024-12-24 21:57 pre_napp-it-22.03 - - 201K static 2024-12-24 23:02
boot env vahel liikumine
beadm create be-imretest-1 beadm activate be-imretest-1 root@omnios-02:~# beadm list -s BE/Snapshot Space Policy Created omnios-r151052 omnios-r151052f pre_napp-it-22.03 omnios-r151052f-1 omnios-r151052f-2 omnios-r151052f-3 omnios-r151052f-3@2024-12-24-19:57:01 104.50K static 2024-12-24 21:57 omnios-r151052f-3@2024-12-24-19:57:44 33.81M static 2024-12-24 21:57 omnios-r151052f-3@2024-12-24-21:02:49 78.00M static 2024-12-24 23:02 omnios-r151052f-3@2024-12-24-21:29:33 352.50K static 2024-12-24 23:29 omnios-r151052f-3@2024-12-24-21:30:32 341.50K static 2024-12-24 23:30 omnios-r151052f-3@2024-12-24-23:26:09 71.72M static 2024-12-25 01:26 imretest-1 root@omnios-02:~# beadm activate imretest-1 Activated successfully root@omnios-02:~# beadm list -s BE/Snapshot Space Policy Created omnios-r151052 omnios-r151052f pre_napp-it-22.03 omnios-r151052f-1 omnios-r151052f-2 omnios-r151052f-3 imretest-1@2024-12-24-19:57:01 104.50K static 2024-12-24 21:57 imretest-1@2024-12-24-19:57:44 33.81M static 2024-12-24 21:57 imretest-1@2024-12-24-23:26:09 318.50K static 2024-12-25 01:26 imretest-1@2024-12-24-21:29:33 352.50K static 2024-12-24 23:29 imretest-1@2024-12-24-21:30:32 341.50K static 2024-12-24 23:30 imretest-1@2024-12-25-12:08:23 52K static 2024-12-25 14:08 imretest-1@2024-12-24-21:02:49 78.00M static 2024-12-24 23:02 imretest-1 root@omnios-02:~# beadm list BE Active Mountpoint Space Policy Created omnios-r151052 - - 4.27M static 2024-12-24 21:44 omnios-r151052f - - 8.19M static 2024-12-24 21:57 pre_napp-it-22.03 - - 201K static 2024-12-24 23:02 omnios-r151052f-1 - - 69.23M static 2024-12-24 23:29 omnios-r151052f-2 N / 173.50K static 2024-12-24 23:30 omnios-r151052f-3 - - 69.10M static 2024-12-25 01:26 imretest-1 R - 1.63G static 2024-12-25 14:08 root@omnios-02:~# reboot
Võrgu seadistamine
Füüsiliste võrguseadmete esitamine
root@omnios-02:~# dladm show-phys LINK MEDIA STATE SPEED DUPLEX DEVICE qede0 Ethernet up 25000 full qede0 qede1 Ethernet up 25000 full qede1
teine variant
root@omnios-02:~# dladm show-link LINK CLASS MTU STATE BRIDGE OVER qede0 phys 1500 up -- -- qede1 phys 9000 up -- -- q4062 vlan 1500 up -- qede0 q84 vlan 9000 up -- qede1 q88 vlan 9000 up -- qede1 q2602 vlan 1500 up -- qede0
draiveri info esitamine, 'pkg info -r xxx' aitab kui pole paigaldatud, nö remote küsimine
root@omnios-02:~/20241224# pkg info qede
Name: driver/network/qede
Summary: QLogic FastLinQ QL45xxx Ethernet Driver
Description: QLogic FastLinQ QL45xxx Ethernet Driver
Category: Drivers/Networking
State: Installed (Manually installed)
Publisher: omnios
Version: 0.5.11
Branch: 151052.0
Packaging Date: October 17, 2024 at 09:00:37 PM
Last Install Time: December 24, 2024 at 08:50:18 PM
Size: 1.84 MB
FMRI: pkg://omnios/driver/network/qede@0.5.11-151052.0:20241017T210037Z
Võrgunduse draiverite nimekirja küsimine
root@omnios-02:~# pkg list | grep 'driver/network' driver/network/afe 0.5.11-151052.0 i-- driver/network/amd8111s 0.5.11-151052.0 i-- driver/network/atge 0.5.11-151052.0 i-- driver/network/bfe 0.5.11-151052.0 i-- driver/network/bge 0.5.11-151052.0 i-- driver/network/bnx 0.5.11-151052.0 i-- ...
kui paketihaldusega proovida eemaldada midagi põhikoosseisust, siis saab teate
root@omnios-02:~# pkg uninstall e1000g
Creating Plan (Solver setup): /
pkg uninstall: Unable to remove 'driver/network/e1000g@0.5.11-151052.0' due to the following packages that depend on it:
entire@11-151052.0
root@omnios-02:~# pkg info entire
Name: entire
Summary: Minimal set of core system packages
Description: Meta package to specify the minimum OmniOS software set
State: Installed
Publisher: omnios
Version: 11
Branch: 151052.0
Packaging Date: October 17, 2024 at 08:27:13 PM
Last Install Time: November 18, 2024 at 10:02:49 AM
Size: 1.79 kB
FMRI: pkg://omnios/entire@11-151052.0:20241017T202713Z
Draiveri paigaldamine ilma võrguühenduseta arvutisse, https://illumos.topicbox.com/groups/discuss/T9a8038eb86649ccd
root@omnios-02:~/20241224# pkgrecv -s https://pkg.omnios.org/r151052/core -d /tmp/qede.p5p.storage/qede -a qede root@omnios-02:~/20241224# pkg install --no-refresh -g /tmp/qede.p5p.storage/qede qede
vlan kasutamine
# dladm create-vlan -l qede0 -v 4062 q4062 # dladm create-ip q4062 root@omnios-02:~# dladm show-vlan LINK VID OVER FLAGS q4062 4062 qede0 ----- # ipadm create-addr -T static -a 172.31.181.22/24 q4062/v4static root@omnios-02:~# route add default 172.31.181.1
eheda riistvara nimekirja küsimine, ei eelda, et draiverid oleksid olemas vms
root@omnios-02:~# prtconf -d | grep -i qlogi
pci1077,73 (pciex1077,8070) [QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller], instance #0
pci1077,73 (pciex1077,8070) [QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller], instance #1
pci1590,2d4 (pciex1077,2281) [QLogic Corp. ISP2812-based 64/32G Fibre Channel to PCIe Controller] (driver not attached)
pci1590,2d4 (pciex1077,2281) [QLogic Corp. ISP2812-based 64/32G Fibre Channel to PCIe Controller] (driver not attached)
dns kliendi seadistamine
dns kliendi seadistuse muutmine, tundub, et omnios puhul on see väga erinev solaris-proper juhtumist
- solaris-proper puhul svccfg ja co abil tehtud muudatuste tulemusena moodustatakse sobiva sisuga failid /etc/resolv.conf ja /etc/nsswitch.conf
- omnios puhul failide /etc/resolv.conf ja /etc/nsswitch.conf sättimise tulemusena läheb 'svcs -l dns/client' state=online asendisse
Olgu lähtepunktiks /etc/resolv.conf puudumine
root@omnios-02:~# ls -ld /etc/resolv.conf /etc/resolv.conf: No such file or directory root@omnios-02:~# svcs -l dns/client fmri svc:/network/dns/client:default name DNS resolver enabled true state offline next_state none state_time December 25, 2024 at 08:11:44 PM EET restarter svc:/system/svc/restarter:default dependency optional_all/none svc:/network/dns/install (disabled) dependency require_all/none svc:/system/filesystem/minimal (online) dependency require_all/none svc:/network/service (online) dependency require_all/none file://localhost/etc/resolv.conf (online) dependency require_any/error svc:/network/loopback (online) dependency optional_all/error svc:/milestone/network (online) dependency optional_all/refresh svc:/network/location:default (disabled) root@omnios-02:~# svcs -a | grep dns disabled 20:11:44 svc:/network/dns/install:default disabled 20:11:45 svc:/network/dns/multicast:default offline 20:11:44 svc:/network/dns/client:default root@omnios-02:~#
ning faili /etc/resolv.conf käsitsi tekitamine ning faili /etc/nsswitch.conf asendamine .dns variatsiooniga paneb svc osakonnas asjad korda
root@omnios-02:~# cat /etc/resolv.conf domain auul.pri.ee nameserver 10.192.0.53 root@omnios-02:~# cp /etc/nsswitch.conf /etc/nsswitch.bak root@omnios-02:~# cp /etc/nsswitch.dns /etc/nsswitch.conf root@omnios-02:~# svcadm refresh dns/client root@omnios-02:~# svcadm disable dns/client root@omnios-02:~# svcadm enable dns/client root@omnios-02:~# svcadm restart dns/client
Peale rebooti dns nimelahendus toimib
root@omnios-02:~# svcs -a | grep dns disabled 20:19:08 svc:/network/dns/install:default disabled 20:19:09 svc:/network/dns/multicast:default online 20:19:11 svc:/network/dns/client:default root@omnios-02:~# dig +short neti.auul.pri.ee a 10.154.221.184 10.154.221.183 root@omnios-02:~# ping neti.ee neti.ee is alive
iscsi kliendi kasutamine
Arvuti iscsi initiator nime küsimine
root@omnios-02:~# iscsiadm list initiator-node
Initiator node name: iqn.1986-03.com.sun:01:982f79dec5fd.676c184c
Initiator node alias: -
Login Parameters (Default/Configured):
Header Digest: NONE/NONE
Data Digest: NONE/NONE
Authentication Type: NONE
RADIUS Server: NONE
RADIUS Access: disabled
Tunable Parameters (Default/Configured):
Session Login Response Time: 60/-
Maximum Connection Retry Time: 180/-
Login Retry Time Interval: 60/-
Configured Sessions: 1
iscsi kliendiks olemise eelduseks on '/network/iscsi/initiator' teenuse käimine
root@omnios-02:~# svcs svc:/network/iscsi/initiator:default STATE STIME FMRI disabled 22:41:41 svc:/network/iscsi/initiator:default root@omnios-02:~# iscsiadm add discovery-address 10.8.4.131 iSCSI Initiator Service is disabled, try 'svcadm enable network/iscsi/initiator' to enable the service. For more information, please refer to iscsi(4D). root@omnios-02:~# svcadm enable svc:/network/iscsi/initiator:default root@omnios-02:~# svcs svc:/network/iscsi/initiator:default STATE STIME FMRI online 22:47:36 svc:/network/iscsi/initiator:default
targeti kasutamise alustamiseks ja lõpetamiseks sobib öelda vastavalt, paistab, et automaatselt tegeldakse ka multipath teemadega
root@omnios-02:~# iscsiadm add discovery-address 10.8.4.131 root@omnios-02:~# dmesg ... Dec 26 22:36:13 localhost genunix: [ID 936769 kern.info] sd1 is /scsi_vhci/disk@g600000e00d300000003008ec00040000 Dec 26 22:36:13 localhost genunix: [ID 408114 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) online Dec 26 22:36:13 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: degraded: path 5 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110000B,0 is online Dec 26 22:36:14 localhost genunix: [ID 530209 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 2 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111000C,0 is online: Load balancing: round-robin Dec 26 22:36:14 localhost genunix: [ID 530209 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 4 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011000A,0 is online: Load balancing: round-robin Dec 26 22:36:15 localhost genunix: [ID 530209 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 3 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:00100009,0 is online: Load balancing: round-robin root@omnios-02:~# iscsiadm remove discovery-address 10.8.4.131 root@omnios-02:~# dmesg ... Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 2 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111000C,0 is offline Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(293) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 offline#012 Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 5 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110000B,0 is offline Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(290) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110 offline#012 Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: degraded: path 4 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011000A,0 is offline Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(287) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011 offline#012 Dec 26 22:37:37 localhost genunix: [ID 408114 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) offline Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: failed: path 3 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:00100009,0 is offline Dec 26 22:37:37 localhost genunix: [ID 408114 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) offline Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(284) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010 offline#012
discovery puntide nimekirja esitamine
root@omnios-02:~# iscsiadm list discovery-address Discovery Address: 10.8.4.131:3260
iscsi targets
root@omnios-02:~# iscsiadm list target
Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111
Alias: -
TPGT: 12
ISID: 4000002a0000
Connections: 1
Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110
Alias: -
TPGT: 11
ISID: 4000002a0000
Connections: 1
Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011
Alias: -
TPGT: 10
ISID: 4000002a0000
Connections: 1
Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010
Alias: -
TPGT: 9
ISID: 4000002a0000
Connections: 1
target omadused
root@omnios-02:~# iscsiadm list target -v iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111
Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111
Alias: -
TPGT: 12
ISID: 4000002a0000
Connections: 1
CID: 0
IP address (Local): 10.8.8.22:49993
IP address (Peer): 10.8.8.132:3260
Discovery Method: SendTargets
Login Parameters (Negotiated):
Data Sequence In Order: yes
Data PDU In Order: yes
Default Time To Retain: 20
Default Time To Wait: 2
Error Recovery Level: 0
First Burst Length: 65536
Immediate Data: no
Initial Ready To Transfer (R2T): yes
Max Burst Length: 262144
Max Outstanding R2T: 1
Max Receive Data Segment Length: 16384
Max Connections: 1
Header Digest: NONE
Data Digest: NONE
paistab, et multipath käivitatakse automaatselt
root@omnios-02:~# mpathadm list lu
/dev/rdsk/c0t600000E00D300000003008EC00040000d0s2
Total Path Count: 4
Operational Path Count: 4
ning
root@omnios-02:~# mpathadm show lu /dev/rdsk/c0t600000E00D300000003008EC00040000d0s2
Logical Unit: /dev/rdsk/c0t600000E00D300000003008EC00040000d0s2
mpath-support: libmpscsi_vhci.so
Vendor: FUJITSU
Product: ETERNUS_DXM
Revision: 0000
Name Type: unknown type
Name: 600000e00d300000003008ec00040000
Asymmetric: yes
Current Load Balance: round-robin
Logical Unit Group ID: NA
Auto Failback: on
Auto Probing: NA
Paths:
Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff
Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111,12
Override Path: NA
Path State: OK
Disabled: no
Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff
Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010,9
Override Path: NA
Path State: OK
Disabled: no
Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff
Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011,10
Override Path: NA
Path State: OK
Disabled: no
Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff
Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110,11
Override Path: NA
Path State: OK
Disabled: no
Target Port Groups:
ID: 32917
Explicit Failover: no
Access State: active optimized
Target Ports:
Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111,12
Relative ID: 16533
ID: 32900
Explicit Failover: no
Access State: active optimized
Target Ports:
Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010,9
Relative ID: 16516
ID: 32901
Explicit Failover: no
Access State: active optimized
Target Ports:
Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011,10
Relative ID: 16517
ID: 32916
Explicit Failover: no
Access State: active optimized
Target Ports:
Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110,11
Relative ID: 16532
ressursi enda vaatlemiseks sobib nt format käsk
root@omnios-02:~# format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
0. c0t600000E00D300000003008EC00040000d0 <FUJITSU-ETERNUS_DXM-0000-1.00TB>
/scsi_vhci/disk@g600000e00d300000003008ec00040000
1. c2t1d0 <HPE-LOGICAL VOLUME-7.11-3.49TB>
/pci@7a,0/pci8086,347a@2/pci103c,600@0/disk@1,0
Specify disk (enter its number): ^C
root@omnios-02:~#
ressursi kasutamiseks sobib öelda nt kusjuures eemaldamiseks tuleb esmalt teha 'zpool destory ...' ja seejärel eemaldada iscsi ressurss
root@omnios-02:~# zpool create zp_eternus_02 c0t600000E00D300000003008EC00040000d0 root@omnios-02:~# iscsiadm remove discovery-address 10.8.4.131 iscsiadm: Logical unit in use iscsiadm: Unable to complete operation
napp-it lahenduse kasutamine
napp-it tarkvara paigaldamine
- https://www.illumos.org/hcl/
- https://illumos.org/man/4D/qede
- https://docs.oracle.com/cd/E88353_01/html/E37851/qede-4d.html
- https://github.com/omniosorg/omnios-wiki/blob/master/GeneralAdministration.md
- https://docs.brconsulting.info/en/docs/infrastructure/storage/napp-it/02-nappit-comstarsetup/
root@omnios:~# wget -O - www.napp-it.org/nappit | perl root@omnios:~# beadm BE Active Mountpoint Space Policy Created omnios-r151046an NR / 1.78G static 2024-12-21 18:09 pre_napp-it-22.03 - - 164K static 2024-12-21 18:30 omnios-r151046an-backup-1 - - 109K static 2024-12-21 18:30 omnios-r151046an-backup-2 - - 233K static 2024-12-21 18:31 omnios-r151046an-backup-3 - - 289K static 2024-12-21 18:33
iscsi teenuse seadistamine
Lähtepunktiks on töötav OmniOS operatsioonisüsteem, millele on paigaldatud napp-it tarkvara.
'iscsi target service' käivitamine, valida napp-it webgui liidesest
Services -> COMSTAR -> ISCSI target service -> online
Tundub, et sellele tegevusele vastab
root@omnios-02:~# svcs svc:/network/iscsi/target:default STATE STIME FMRI disabled 0:05:25 svc:/network/iscsi/target:default
muutumine
root@omnios-02:~# svcs svc:/network/iscsi/target:default STATE STIME FMRI online 0:05:25 svc:/network/iscsi/target:default
LUN tekitamiseks sobib webgui liideses öelda
Comstar -> Logical Units -> create volume LU
Käsureal vastab midagi sellist
root@omnios-02:~# stmfadm list-lu -v
LU Name: 600144F0650F1E060000676DEE2D0001
Operational Status: Online
Provider Name : sbd
Alias : /dev/zvol/rdsk/zp_eternus_02/zvol_ers_01
View Entry Count : 0
Data File : /dev/zvol/rdsk/zp_eternus_02/zvol_ers_01
Meta File : not set
Size : 429496729600
Block Size : 512
Management URL : not set
Vendor ID : SUN
Product ID : COMSTAR
Serial Num : not set
Write Protect : Disabled
Writeback Cache : Disabled
Access State : Active
Target tekitamiseks sobib öelda
Comstar -> Targets -> ++add target
PILT
kus
- Target name: iqn.2010-09.org.zfs-san:1735257824
käsureal vastab midagi sellist
root@omnios-02:~# itadm list-target -v
TARGET NAME STATE SESSIONS
iqn.2010-09.org.zfs-san:1735257824 online 0
alias: omnios-02
auth: none
targetchapuser: -
targetchapsecret: unset
tpg-tags: default
host group tekitamine
Comstar -> Host-Groups -> name of Host Group -> hg_moraal_pve
ning add members
- Select host group: hg_adala_pve
- Members: iqn.2004-10.com.ubuntu:01:863b8b3dace pve node iscsi initiator)
käsureal vastab midagi sellist
root@omnios-02:~# stmfadm list-hg -v
Host Group: hg_adala_pve
Member: iqn.2004-10.com.ubuntu:01:863b8b3dace
target group tekitamine
Comstar -> Target-Groups -> name of new Target Group - tg_luns_for_adala_pve_initiators
ning seejärel lisada konkreetne 'target' 'target group' sisse
Comstar -> Target-Groups -> add targets
- select target: iqn.2010-09.org.zfs-san:1735257824
- add to target group: tg_luns_for_adala_pve_initiators
Käsurealt vastab midagi sellist
root@omnios-02:~# stmfadm list-tg -v
Target Group: tg_luns_for_adala_pve_initiators
Member: iqn.2010-09.org.zfs-san:1735257824
View tekitamiseks sobib öelda
Comstar ->
- select LOgical Unit GUID: 600144F0650F1E060000676DEE2D0001(zp_eternus_02/zvol_ers_01)
- and to host group: hg_moraal_pve
- add to target group: tg_luns_for_moraal_pve_initiators
käsurealt vastab sellele midagi
TODO
Target Portal Group tekitamiseks sobib öelda
Comstar -> Target Portal Groups
- name of portal group: tpg_luns_for_adala_pve_initiators
- select ip address for this portal - nt 10.106.2.22 (q2602)
repo paketihalduse kasutamine
repo lisamine
# pkg set-publisher -g http://pkg.cs.umd.edu/ cs.umd.edu # pkg publisher PUBLISHER TYPE STATUS P LOCATION omnios origin online F http://pkg.omniti.com/omnios/r151020/ cs.umd.edu origin online F http://pkg.cs.umd.edu/
kasutamine
# pkg search postfix # pkg install -nv postfix # pkg contents postfix # svcadm enable postfix # svcadm restart ssh
# svcs -l postfix fmri svc:/network/smtp/postfix:default name Postfix Mail server enabled true state online next_state none state_time Tue Jan 10 03:53:40 2017 logfile /var/svc/log/network-smtp-postfix:default.log restarter svc:/system/svc/restarter:default contract_id 88 dependency require_all/error svc:/milestone/network:default (online) dependency require_all/error svc:/system/filesystem/local (online)
pkgsrc
CSW
# pkgadd -d http://get.opencsw.org/now # /opt/csw/bin/pkgutil -a joe # /opt/csw/bin/pkgutil -y -i joe # vi /etc/opt/csw/joe/joerc