OmniOS kasutamine: erinevus redaktsioonide vahel
(Uus lehekülg: '===Sissejuhatus=== TODO ===repo paketihalduse kasutamine=== repo lisamine # pkg set-publisher -g http://pkg.cs.umd.edu/ cs.umd.edu # pkg publisher PUBLISHER TYPE STATUS P LOCATION omnios origin online F http://pkg.omniti.com/omnios/r151020/ cs.umd.edu origin online F http://pkg.cs.umd.edu/ kasutamine # pkg search postfix # pkg install -nv postfix # pkg contents postfix # svcadm enable postfix <p...') |
|||
(ei näidata sama kasutaja 37 vahepealset redaktsiooni) | |||
2. rida: | 2. rida: | ||
TODO |
TODO |
||
+ | |||
+ | ===20241221 kogemus=== |
||
+ | |||
+ | ====Tööpõhimõte==== |
||
+ | |||
+ | Väited |
||
+ | |||
+ | * omnios puhul rakendub paljuski solarise praktika, aga on ka asju mis on oluliselt erinevad, nt dns kliendiks olemine |
||
+ | * süsteemi seadistusi hoitakse smf (Service Management Facility) keskkonnas, see on tõenäoliselt mingi nö binary laadse andmebaasi moodi nähtus - binari sisu alusel genereeritakse legacy /etc/xxx.conf failie (erandiks on omnios puhul nt /etc/resolv.conf fail, tundub, et see ei tule nö binari allikast, aga on ise tavalisel viisil kohal) |
||
+ | * arvuti ip konf on kuskil binaarses allikas, tundub |
||
+ | * paketihalduse teostamiseks on erinevaid võimalusi, nad natuke eksitavad, nt 'pkg info' vs 'pkginfo' (vastaval uus ja vana) ning ka seadistuse tegemine svccfg-svcs-svcadm utiliitidega (õige komplekt) |
||
+ | * iseloomulik on et ühe muudatuse ütlemine käivitab terve ahela muudatuste juhtumise, kusjuures üllatavalt ootuspäraselt, nt iscsi klient poolse discoverdamise käivitamine lõpeb multipath ressurssi moodustamisega |
||
+ | * tundub, et omnios draiverite koosseis on ahtam võrreldes nö kommerts-solarisega (nt qlc vs qlc+qlt - qlc on qlogic fc initiator draiver; qlt on qlogic fc target draiver; omnios puhul qlt puudub üldse) |
||
+ | |||
+ | ====boot keskkondadega opereerimine==== |
||
+ | |||
+ | Boot Environment keskkondade nimekirja esitamine |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~/20241224# beadm |
||
+ | BE Active Mountpoint Space Policy Created |
||
+ | omnios-r151052 - - 4.27M static 2024-12-24 21:44 |
||
+ | omnios-r151052f NR / 1.55G static 2024-12-24 21:57 |
||
+ | pre_napp-it-22.03 - - 201K static 2024-12-24 23:02 |
||
+ | </pre> |
||
+ | |||
+ | boot env vahel liikumine |
||
+ | |||
+ | <pre> |
||
+ | beadm create be-imretest-1 |
||
+ | beadm activate be-imretest-1 |
||
+ | |||
+ | root@omnios-02:~# beadm list -s |
||
+ | BE/Snapshot Space Policy Created |
||
+ | omnios-r151052 |
||
+ | omnios-r151052f |
||
+ | pre_napp-it-22.03 |
||
+ | omnios-r151052f-1 |
||
+ | omnios-r151052f-2 |
||
+ | omnios-r151052f-3 |
||
+ | omnios-r151052f-3@2024-12-24-19:57:01 104.50K static 2024-12-24 21:57 |
||
+ | omnios-r151052f-3@2024-12-24-19:57:44 33.81M static 2024-12-24 21:57 |
||
+ | omnios-r151052f-3@2024-12-24-21:02:49 78.00M static 2024-12-24 23:02 |
||
+ | omnios-r151052f-3@2024-12-24-21:29:33 352.50K static 2024-12-24 23:29 |
||
+ | omnios-r151052f-3@2024-12-24-21:30:32 341.50K static 2024-12-24 23:30 |
||
+ | omnios-r151052f-3@2024-12-24-23:26:09 71.72M static 2024-12-25 01:26 |
||
+ | imretest-1 |
||
+ | |||
+ | root@omnios-02:~# beadm activate imretest-1 |
||
+ | Activated successfully |
||
+ | root@omnios-02:~# beadm list -s |
||
+ | BE/Snapshot Space Policy Created |
||
+ | omnios-r151052 |
||
+ | omnios-r151052f |
||
+ | pre_napp-it-22.03 |
||
+ | omnios-r151052f-1 |
||
+ | omnios-r151052f-2 |
||
+ | omnios-r151052f-3 |
||
+ | imretest-1@2024-12-24-19:57:01 104.50K static 2024-12-24 21:57 |
||
+ | imretest-1@2024-12-24-19:57:44 33.81M static 2024-12-24 21:57 |
||
+ | imretest-1@2024-12-24-23:26:09 318.50K static 2024-12-25 01:26 |
||
+ | imretest-1@2024-12-24-21:29:33 352.50K static 2024-12-24 23:29 |
||
+ | imretest-1@2024-12-24-21:30:32 341.50K static 2024-12-24 23:30 |
||
+ | imretest-1@2024-12-25-12:08:23 52K static 2024-12-25 14:08 |
||
+ | imretest-1@2024-12-24-21:02:49 78.00M static 2024-12-24 23:02 |
||
+ | imretest-1 |
||
+ | |||
+ | root@omnios-02:~# beadm list |
||
+ | BE Active Mountpoint Space Policy Created |
||
+ | omnios-r151052 - - 4.27M static 2024-12-24 21:44 |
||
+ | omnios-r151052f - - 8.19M static 2024-12-24 21:57 |
||
+ | pre_napp-it-22.03 - - 201K static 2024-12-24 23:02 |
||
+ | omnios-r151052f-1 - - 69.23M static 2024-12-24 23:29 |
||
+ | omnios-r151052f-2 N / 173.50K static 2024-12-24 23:30 |
||
+ | omnios-r151052f-3 - - 69.10M static 2024-12-25 01:26 |
||
+ | imretest-1 R - 1.63G static 2024-12-25 14:08 |
||
+ | |||
+ | root@omnios-02:~# reboot |
||
+ | </pre> |
||
+ | |||
+ | ====Võrgu seadistamine==== |
||
+ | |||
+ | Füüsiliste võrguseadmete esitamine |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# dladm show-phys |
||
+ | LINK MEDIA STATE SPEED DUPLEX DEVICE |
||
+ | qede0 Ethernet up 25000 full qede0 |
||
+ | qede1 Ethernet up 25000 full qede1 |
||
+ | </pre> |
||
+ | |||
+ | teine variant |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# dladm show-link |
||
+ | LINK CLASS MTU STATE BRIDGE OVER |
||
+ | qede0 phys 1500 up -- -- |
||
+ | qede1 phys 9000 up -- -- |
||
+ | q4062 vlan 1500 up -- qede0 |
||
+ | q84 vlan 9000 up -- qede1 |
||
+ | q88 vlan 9000 up -- qede1 |
||
+ | q2602 vlan 1500 up -- qede0 |
||
+ | </pre> |
||
+ | |||
+ | draiveri info esitamine, 'pkg info -r xxx' aitab kui pole paigaldatud, nö remote küsimine |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~/20241224# pkg info qede |
||
+ | Name: driver/network/qede |
||
+ | Summary: QLogic FastLinQ QL45xxx Ethernet Driver |
||
+ | Description: QLogic FastLinQ QL45xxx Ethernet Driver |
||
+ | Category: Drivers/Networking |
||
+ | State: Installed (Manually installed) |
||
+ | Publisher: omnios |
||
+ | Version: 0.5.11 |
||
+ | Branch: 151052.0 |
||
+ | Packaging Date: October 17, 2024 at 09:00:37 PM |
||
+ | Last Install Time: December 24, 2024 at 08:50:18 PM |
||
+ | Size: 1.84 MB |
||
+ | FMRI: pkg://omnios/driver/network/qede@0.5.11-151052.0:20241017T210037Z |
||
+ | </pre> |
||
+ | |||
+ | Võrgunduse draiverite nimekirja küsimine |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# pkg list | grep 'driver/network' |
||
+ | driver/network/afe 0.5.11-151052.0 i-- |
||
+ | driver/network/amd8111s 0.5.11-151052.0 i-- |
||
+ | driver/network/atge 0.5.11-151052.0 i-- |
||
+ | driver/network/bfe 0.5.11-151052.0 i-- |
||
+ | driver/network/bge 0.5.11-151052.0 i-- |
||
+ | driver/network/bnx 0.5.11-151052.0 i-- |
||
+ | ... |
||
+ | </pre> |
||
+ | |||
+ | kui paketihaldusega proovida eemaldada midagi põhikoosseisust, siis saab teate |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# pkg uninstall e1000g |
||
+ | Creating Plan (Solver setup): / |
||
+ | pkg uninstall: Unable to remove 'driver/network/e1000g@0.5.11-151052.0' due to the following packages that depend on it: |
||
+ | entire@11-151052.0 |
||
+ | |||
+ | root@omnios-02:~# pkg info entire |
||
+ | Name: entire |
||
+ | Summary: Minimal set of core system packages |
||
+ | Description: Meta package to specify the minimum OmniOS software set |
||
+ | State: Installed |
||
+ | Publisher: omnios |
||
+ | Version: 11 |
||
+ | Branch: 151052.0 |
||
+ | Packaging Date: October 17, 2024 at 08:27:13 PM |
||
+ | Last Install Time: November 18, 2024 at 10:02:49 AM |
||
+ | Size: 1.79 kB |
||
+ | FMRI: pkg://omnios/entire@11-151052.0:20241017T202713Z |
||
+ | </pre> |
||
+ | |||
+ | Draiveri paigaldamine ilma võrguühenduseta arvutisse, https://illumos.topicbox.com/groups/discuss/T9a8038eb86649ccd |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~/20241224# pkgrecv -s https://pkg.omnios.org/r151052/core -d /tmp/qede.p5p.storage/qede -a qede |
||
+ | |||
+ | root@omnios-02:~/20241224# pkg install --no-refresh -g /tmp/qede.p5p.storage/qede qede |
||
+ | </pre> |
||
+ | |||
+ | vlan kasutamine |
||
+ | |||
+ | <pre> |
||
+ | # dladm create-vlan -l qede0 -v 4062 q4062 |
||
+ | # dladm create-ip q4062 |
||
+ | root@omnios-02:~# dladm show-vlan |
||
+ | LINK VID OVER FLAGS |
||
+ | q4062 4062 qede0 ----- |
||
+ | |||
+ | # ipadm create-addr -T static -a 172.31.181.22/24 q4062/v4static |
||
+ | root@omnios-02:~# route add default 172.31.181.1 |
||
+ | </pre> |
||
+ | |||
+ | eheda riistvara nimekirja küsimine, ei eelda, et draiverid oleksid olemas vms |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# prtconf -d | grep -i qlogi |
||
+ | pci1077,73 (pciex1077,8070) [QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller], instance #0 |
||
+ | pci1077,73 (pciex1077,8070) [QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller], instance #1 |
||
+ | pci1590,2d4 (pciex1077,2281) [QLogic Corp. ISP2812-based 64/32G Fibre Channel to PCIe Controller] (driver not attached) |
||
+ | pci1590,2d4 (pciex1077,2281) [QLogic Corp. ISP2812-based 64/32G Fibre Channel to PCIe Controller] (driver not attached) |
||
+ | </pre> |
||
+ | |||
+ | ====dns kliendi seadistamine==== |
||
+ | |||
+ | dns kliendi seadistuse muutmine, tundub, et omnios puhul on see väga erinev solaris-proper juhtumist |
||
+ | |||
+ | * solaris-proper puhul svccfg ja co abil tehtud muudatuste tulemusena moodustatakse sobiva sisuga failid /etc/resolv.conf ja /etc/nsswitch.conf |
||
+ | * omnios puhul failide /etc/resolv.conf ja /etc/nsswitch.conf sättimise tulemusena läheb 'svcs -l dns/client' state=online asendisse |
||
+ | |||
+ | Olgu lähtepunktiks /etc/resolv.conf puudumine |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# ls -ld /etc/resolv.conf |
||
+ | /etc/resolv.conf: No such file or directory |
||
+ | |||
+ | root@omnios-02:~# svcs -l dns/client |
||
+ | fmri svc:/network/dns/client:default |
||
+ | name DNS resolver |
||
+ | enabled true |
||
+ | state offline |
||
+ | next_state none |
||
+ | state_time December 25, 2024 at 08:11:44 PM EET |
||
+ | restarter svc:/system/svc/restarter:default |
||
+ | dependency optional_all/none svc:/network/dns/install (disabled) |
||
+ | dependency require_all/none svc:/system/filesystem/minimal (online) |
||
+ | dependency require_all/none svc:/network/service (online) |
||
+ | dependency require_all/none file://localhost/etc/resolv.conf (online) |
||
+ | dependency require_any/error svc:/network/loopback (online) |
||
+ | dependency optional_all/error svc:/milestone/network (online) |
||
+ | dependency optional_all/refresh svc:/network/location:default (disabled) |
||
+ | |||
+ | root@omnios-02:~# svcs -a | grep dns |
||
+ | disabled 20:11:44 svc:/network/dns/install:default |
||
+ | disabled 20:11:45 svc:/network/dns/multicast:default |
||
+ | offline 20:11:44 svc:/network/dns/client:default |
||
+ | root@omnios-02:~# |
||
+ | </pre> |
||
+ | |||
+ | ning faili /etc/resolv.conf käsitsi tekitamine ning faili /etc/nsswitch.conf asendamine .dns variatsiooniga paneb svc osakonnas asjad korda |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# cat /etc/resolv.conf |
||
+ | domain auul.pri.ee |
||
+ | nameserver 10.192.0.53 |
||
+ | |||
+ | root@omnios-02:~# cp /etc/nsswitch.conf /etc/nsswitch.bak |
||
+ | root@omnios-02:~# cp /etc/nsswitch.dns /etc/nsswitch.conf |
||
+ | |||
+ | root@omnios-02:~# svcadm refresh dns/client |
||
+ | root@omnios-02:~# svcadm disable dns/client |
||
+ | root@omnios-02:~# svcadm enable dns/client |
||
+ | root@omnios-02:~# svcadm restart dns/client |
||
+ | </pre> |
||
+ | |||
+ | Peale rebooti dns nimelahendus toimib |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# svcs -a | grep dns |
||
+ | disabled 20:19:08 svc:/network/dns/install:default |
||
+ | disabled 20:19:09 svc:/network/dns/multicast:default |
||
+ | online 20:19:11 svc:/network/dns/client:default |
||
+ | |||
+ | root@omnios-02:~# dig +short neti.auul.pri.ee a |
||
+ | 10.154.221.184 |
||
+ | 10.154.221.183 |
||
+ | |||
+ | root@omnios-02:~# ping neti.ee |
||
+ | neti.ee is alive |
||
+ | </pre> |
||
+ | |||
+ | ====iscsi kliendi kasutamine==== |
||
+ | |||
+ | Arvuti iscsi initiator nime küsimine |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# iscsiadm list initiator-node |
||
+ | Initiator node name: iqn.1986-03.com.sun:01:982f79dec5fd.676c184c |
||
+ | Initiator node alias: - |
||
+ | Login Parameters (Default/Configured): |
||
+ | Header Digest: NONE/NONE |
||
+ | Data Digest: NONE/NONE |
||
+ | Authentication Type: NONE |
||
+ | RADIUS Server: NONE |
||
+ | RADIUS Access: disabled |
||
+ | Tunable Parameters (Default/Configured): |
||
+ | Session Login Response Time: 60/- |
||
+ | Maximum Connection Retry Time: 180/- |
||
+ | Login Retry Time Interval: 60/- |
||
+ | Configured Sessions: 1 |
||
+ | </pre> |
||
+ | |||
+ | iscsi kliendiks olemise eelduseks on '/network/iscsi/initiator' teenuse käimine |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# svcs svc:/network/iscsi/initiator:default |
||
+ | STATE STIME FMRI |
||
+ | disabled 22:41:41 svc:/network/iscsi/initiator:default |
||
+ | |||
+ | root@omnios-02:~# iscsiadm add discovery-address 10.8.4.131 |
||
+ | iSCSI Initiator Service is disabled, try 'svcadm enable network/iscsi/initiator' to enable the service. |
||
+ | For more information, please refer to iscsi(4D). |
||
+ | |||
+ | root@omnios-02:~# svcadm enable svc:/network/iscsi/initiator:default |
||
+ | |||
+ | root@omnios-02:~# svcs svc:/network/iscsi/initiator:default |
||
+ | STATE STIME FMRI |
||
+ | online 22:47:36 svc:/network/iscsi/initiator:default |
||
+ | </pre> |
||
+ | |||
+ | targeti kasutamise alustamiseks ja lõpetamiseks sobib öelda vastavalt, paistab, et automaatselt tegeldakse ka multipath teemadega |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# iscsiadm add discovery-address 10.8.4.131 |
||
+ | root@omnios-02:~# dmesg |
||
+ | ... |
||
+ | Dec 26 22:36:13 localhost genunix: [ID 936769 kern.info] sd1 is /scsi_vhci/disk@g600000e00d300000003008ec00040000 |
||
+ | Dec 26 22:36:13 localhost genunix: [ID 408114 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) online |
||
+ | Dec 26 22:36:13 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: degraded: path 5 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110000B,0 is online |
||
+ | Dec 26 22:36:14 localhost genunix: [ID 530209 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 2 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111000C,0 is online: Load balancing: round-robin |
||
+ | Dec 26 22:36:14 localhost genunix: [ID 530209 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 4 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011000A,0 is online: Load balancing: round-robin |
||
+ | Dec 26 22:36:15 localhost genunix: [ID 530209 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 3 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:00100009,0 is online: Load balancing: round-robin |
||
+ | |||
+ | root@omnios-02:~# iscsiadm remove discovery-address 10.8.4.131 |
||
+ | root@omnios-02:~# dmesg |
||
+ | ... |
||
+ | Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 2 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111000C,0 is offline |
||
+ | Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(293) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 offline#012 |
||
+ | Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 5 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110000B,0 is offline |
||
+ | Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(290) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110 offline#012 |
||
+ | Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: degraded: path 4 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011000A,0 is offline |
||
+ | Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(287) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011 offline#012 |
||
+ | Dec 26 22:37:37 localhost genunix: [ID 408114 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) offline |
||
+ | Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: failed: path 3 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:00100009,0 is offline |
||
+ | Dec 26 22:37:37 localhost genunix: [ID 408114 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) offline |
||
+ | Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(284) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010 offline#012 |
||
+ | |||
+ | </pre> |
||
+ | |||
+ | discovery puntide nimekirja esitamine |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# iscsiadm list discovery-address |
||
+ | Discovery Address: 10.8.4.131:3260 |
||
+ | </pre> |
||
+ | |||
+ | iscsi targets |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# iscsiadm list target |
||
+ | Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 |
||
+ | Alias: - |
||
+ | TPGT: 12 |
||
+ | ISID: 4000002a0000 |
||
+ | Connections: 1 |
||
+ | Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110 |
||
+ | Alias: - |
||
+ | TPGT: 11 |
||
+ | ISID: 4000002a0000 |
||
+ | Connections: 1 |
||
+ | Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011 |
||
+ | Alias: - |
||
+ | TPGT: 10 |
||
+ | ISID: 4000002a0000 |
||
+ | Connections: 1 |
||
+ | Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010 |
||
+ | Alias: - |
||
+ | TPGT: 9 |
||
+ | ISID: 4000002a0000 |
||
+ | Connections: 1 |
||
+ | </pre> |
||
+ | |||
+ | target omadused |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# iscsiadm list target -v iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 |
||
+ | Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 |
||
+ | Alias: - |
||
+ | TPGT: 12 |
||
+ | ISID: 4000002a0000 |
||
+ | Connections: 1 |
||
+ | CID: 0 |
||
+ | IP address (Local): 10.8.8.22:49993 |
||
+ | IP address (Peer): 10.8.8.132:3260 |
||
+ | Discovery Method: SendTargets |
||
+ | Login Parameters (Negotiated): |
||
+ | Data Sequence In Order: yes |
||
+ | Data PDU In Order: yes |
||
+ | Default Time To Retain: 20 |
||
+ | Default Time To Wait: 2 |
||
+ | Error Recovery Level: 0 |
||
+ | First Burst Length: 65536 |
||
+ | Immediate Data: no |
||
+ | Initial Ready To Transfer (R2T): yes |
||
+ | Max Burst Length: 262144 |
||
+ | Max Outstanding R2T: 1 |
||
+ | Max Receive Data Segment Length: 16384 |
||
+ | Max Connections: 1 |
||
+ | Header Digest: NONE |
||
+ | Data Digest: NONE |
||
+ | </pre> |
||
+ | |||
+ | paistab, et multipath käivitatakse automaatselt |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# mpathadm list lu |
||
+ | /dev/rdsk/c0t600000E00D300000003008EC00040000d0s2 |
||
+ | Total Path Count: 4 |
||
+ | Operational Path Count: 4 |
||
+ | </pre> |
||
+ | |||
+ | ning |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# mpathadm show lu /dev/rdsk/c0t600000E00D300000003008EC00040000d0s2 |
||
+ | Logical Unit: /dev/rdsk/c0t600000E00D300000003008EC00040000d0s2 |
||
+ | mpath-support: libmpscsi_vhci.so |
||
+ | Vendor: FUJITSU |
||
+ | Product: ETERNUS_DXM |
||
+ | Revision: 0000 |
||
+ | Name Type: unknown type |
||
+ | Name: 600000e00d300000003008ec00040000 |
||
+ | Asymmetric: yes |
||
+ | Current Load Balance: round-robin |
||
+ | Logical Unit Group ID: NA |
||
+ | Auto Failback: on |
||
+ | Auto Probing: NA |
||
+ | |||
+ | Paths: |
||
+ | Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff |
||
+ | Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111,12 |
||
+ | Override Path: NA |
||
+ | Path State: OK |
||
+ | Disabled: no |
||
+ | |||
+ | Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff |
||
+ | Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010,9 |
||
+ | Override Path: NA |
||
+ | Path State: OK |
||
+ | Disabled: no |
||
+ | |||
+ | Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff |
||
+ | Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011,10 |
||
+ | Override Path: NA |
||
+ | Path State: OK |
||
+ | Disabled: no |
||
+ | |||
+ | Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff |
||
+ | Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110,11 |
||
+ | Override Path: NA |
||
+ | Path State: OK |
||
+ | Disabled: no |
||
+ | |||
+ | Target Port Groups: |
||
+ | ID: 32917 |
||
+ | Explicit Failover: no |
||
+ | Access State: active optimized |
||
+ | Target Ports: |
||
+ | Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111,12 |
||
+ | Relative ID: 16533 |
||
+ | |||
+ | ID: 32900 |
||
+ | Explicit Failover: no |
||
+ | Access State: active optimized |
||
+ | Target Ports: |
||
+ | Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010,9 |
||
+ | Relative ID: 16516 |
||
+ | |||
+ | ID: 32901 |
||
+ | Explicit Failover: no |
||
+ | Access State: active optimized |
||
+ | Target Ports: |
||
+ | Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011,10 |
||
+ | Relative ID: 16517 |
||
+ | |||
+ | ID: 32916 |
||
+ | Explicit Failover: no |
||
+ | Access State: active optimized |
||
+ | Target Ports: |
||
+ | Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110,11 |
||
+ | Relative ID: 16532 |
||
+ | </pre> |
||
+ | |||
+ | ressursi enda vaatlemiseks sobib nt format käsk |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# format |
||
+ | Searching for disks...done |
||
+ | |||
+ | |||
+ | AVAILABLE DISK SELECTIONS: |
||
+ | 0. c0t600000E00D300000003008EC00040000d0 <FUJITSU-ETERNUS_DXM-0000-1.00TB> |
||
+ | /scsi_vhci/disk@g600000e00d300000003008ec00040000 |
||
+ | 1. c2t1d0 <HPE-LOGICAL VOLUME-7.11-3.49TB> |
||
+ | /pci@7a,0/pci8086,347a@2/pci103c,600@0/disk@1,0 |
||
+ | Specify disk (enter its number): ^C |
||
+ | root@omnios-02:~# |
||
+ | </pre> |
||
+ | |||
+ | ressursi kasutamiseks sobib öelda nt kusjuures eemaldamiseks tuleb esmalt teha 'zpool destory ...' ja seejärel eemaldada iscsi ressurss |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# zpool create zp_eternus_02 c0t600000E00D300000003008EC00040000d0 |
||
+ | root@omnios-02:~# iscsiadm remove discovery-address 10.8.4.131 |
||
+ | iscsiadm: Logical unit in use |
||
+ | iscsiadm: Unable to complete operation |
||
+ | </pre> |
||
+ | |||
+ | ===napp-it lahenduse kasutamine=== |
||
+ | |||
+ | ====napp-it tarkvara paigaldamine==== |
||
+ | |||
+ | * https://www.illumos.org/hcl/ |
||
+ | * https://illumos.org/man/4D/qede |
||
+ | * https://docs.oracle.com/cd/E88353_01/html/E37851/qede-4d.html |
||
+ | * https://github.com/omniosorg/omnios-wiki/blob/master/GeneralAdministration.md |
||
+ | * https://docs.brconsulting.info/en/docs/infrastructure/storage/napp-it/02-nappit-comstarsetup/ |
||
+ | |||
+ | <pre> |
||
+ | root@omnios:~# wget -O - www.napp-it.org/nappit | perl |
||
+ | |||
+ | root@omnios:~# beadm |
||
+ | BE Active Mountpoint Space Policy Created |
||
+ | omnios-r151046an NR / 1.78G static 2024-12-21 18:09 |
||
+ | pre_napp-it-22.03 - - 164K static 2024-12-21 18:30 |
||
+ | omnios-r151046an-backup-1 - - 109K static 2024-12-21 18:30 |
||
+ | omnios-r151046an-backup-2 - - 233K static 2024-12-21 18:31 |
||
+ | omnios-r151046an-backup-3 - - 289K static 2024-12-21 18:33 |
||
+ | </pre> |
||
+ | |||
+ | ====iscsi teenuse seadistamine==== |
||
+ | |||
+ | Lähtepunktiks on töötav OmniOS operatsioonisüsteem, millele on paigaldatud napp-it tarkvara. |
||
+ | |||
+ | 'iscsi target service' käivitamine, valida napp-it webgui liidesest |
||
+ | |||
+ | Services -> COMSTAR -> ISCSI target service -> online |
||
+ | |||
+ | Tundub, et sellele tegevusele vastab |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# svcs svc:/network/iscsi/target:default |
||
+ | STATE STIME FMRI |
||
+ | disabled 0:05:25 svc:/network/iscsi/target:default |
||
+ | </pre> |
||
+ | |||
+ | muutumine |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# svcs svc:/network/iscsi/target:default |
||
+ | STATE STIME FMRI |
||
+ | online 0:05:25 svc:/network/iscsi/target:default |
||
+ | </pre> |
||
+ | |||
+ | LUN tekitamiseks sobib webgui liideses öelda |
||
+ | |||
+ | Comstar -> Logical Units -> create volume LU |
||
+ | |||
+ | Käsureal vastab midagi sellist |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# stmfadm list-lu -v |
||
+ | LU Name: 600144F0650F1E060000676DEE2D0001 |
||
+ | Operational Status: Online |
||
+ | Provider Name : sbd |
||
+ | Alias : /dev/zvol/rdsk/zp_eternus_02/zvol_ers_01 |
||
+ | View Entry Count : 0 |
||
+ | Data File : /dev/zvol/rdsk/zp_eternus_02/zvol_ers_01 |
||
+ | Meta File : not set |
||
+ | Size : 429496729600 |
||
+ | Block Size : 512 |
||
+ | Management URL : not set |
||
+ | Vendor ID : SUN |
||
+ | Product ID : COMSTAR |
||
+ | Serial Num : not set |
||
+ | Write Protect : Disabled |
||
+ | Writeback Cache : Disabled |
||
+ | Access State : Active |
||
+ | </pre> |
||
+ | |||
+ | Target tekitamiseks sobib öelda |
||
+ | |||
+ | Comstar -> Targets -> ++add target |
||
+ | |||
+ | PILT |
||
+ | |||
+ | kus |
||
+ | |||
+ | * Target name: iqn.2010-09.org.zfs-san:1735257824 |
||
+ | |||
+ | käsureal vastab midagi sellist |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# itadm list-target -v |
||
+ | TARGET NAME STATE SESSIONS |
||
+ | iqn.2010-09.org.zfs-san:1735257824 online 0 |
||
+ | alias: omnios-02 |
||
+ | auth: none |
||
+ | targetchapuser: - |
||
+ | targetchapsecret: unset |
||
+ | tpg-tags: default |
||
+ | </pre> |
||
+ | |||
+ | host group tekitamine |
||
+ | |||
+ | Comstar -> Host-Groups -> name of Host Group -> hg_moraal_pve |
||
+ | |||
+ | ning add members |
||
+ | |||
+ | * Select host group: hg_adala_pve |
||
+ | * Members: iqn.2004-10.com.ubuntu:01:863b8b3dace pve node iscsi initiator) |
||
+ | |||
+ | käsureal vastab midagi sellist |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# stmfadm list-hg -v |
||
+ | Host Group: hg_adala_pve |
||
+ | Member: iqn.2004-10.com.ubuntu:01:863b8b3dace |
||
+ | </pre> |
||
+ | |||
+ | target group tekitamine |
||
+ | |||
+ | Comstar -> Target-Groups -> name of new Target Group - tg_luns_for_adala_pve_initiators |
||
+ | |||
+ | ning seejärel lisada konkreetne 'target' 'target group' sisse |
||
+ | |||
+ | Comstar -> Target-Groups -> add targets |
||
+ | |||
+ | * select target: iqn.2010-09.org.zfs-san:1735257824 |
||
+ | * add to target group: tg_luns_for_adala_pve_initiators |
||
+ | |||
+ | Käsurealt vastab midagi sellist |
||
+ | |||
+ | <pre> |
||
+ | root@omnios-02:~# stmfadm list-tg -v |
||
+ | Target Group: tg_luns_for_adala_pve_initiators |
||
+ | Member: iqn.2010-09.org.zfs-san:1735257824 |
||
+ | </pre> |
||
+ | |||
+ | View tekitamiseks sobib öelda |
||
+ | |||
+ | Comstar -> |
||
+ | |||
+ | * select LOgical Unit GUID: 600144F0650F1E060000676DEE2D0001(zp_eternus_02/zvol_ers_01) |
||
+ | * and to host group: hg_moraal_pve |
||
+ | * add to target group: tg_luns_for_moraal_pve_initiators |
||
+ | |||
+ | käsurealt vastab sellele midagi |
||
+ | |||
+ | <pre> |
||
+ | TODO |
||
+ | </pre> |
||
+ | |||
+ | Target Portal Group tekitamiseks sobib öelda |
||
+ | |||
+ | Comstar -> Target Portal Groups |
||
+ | |||
+ | * name of portal group: tpg_luns_for_adala_pve_initiators |
||
+ | * select ip address for this portal - nt 10.106.2.22 (q2602) |
||
===repo paketihalduse kasutamine=== |
===repo paketihalduse kasutamine=== |
||
19. rida: | 663. rida: | ||
# pkg contents postfix |
# pkg contents postfix |
||
# svcadm enable postfix |
# svcadm enable postfix |
||
+ | # svcadm restart ssh |
||
<pre> |
<pre> |
Viimane redaktsioon: 27. detsember 2024, kell 17:22
Sissejuhatus
TODO
20241221 kogemus
Tööpõhimõte
Väited
- omnios puhul rakendub paljuski solarise praktika, aga on ka asju mis on oluliselt erinevad, nt dns kliendiks olemine
- süsteemi seadistusi hoitakse smf (Service Management Facility) keskkonnas, see on tõenäoliselt mingi nö binary laadse andmebaasi moodi nähtus - binari sisu alusel genereeritakse legacy /etc/xxx.conf failie (erandiks on omnios puhul nt /etc/resolv.conf fail, tundub, et see ei tule nö binari allikast, aga on ise tavalisel viisil kohal)
- arvuti ip konf on kuskil binaarses allikas, tundub
- paketihalduse teostamiseks on erinevaid võimalusi, nad natuke eksitavad, nt 'pkg info' vs 'pkginfo' (vastaval uus ja vana) ning ka seadistuse tegemine svccfg-svcs-svcadm utiliitidega (õige komplekt)
- iseloomulik on et ühe muudatuse ütlemine käivitab terve ahela muudatuste juhtumise, kusjuures üllatavalt ootuspäraselt, nt iscsi klient poolse discoverdamise käivitamine lõpeb multipath ressurssi moodustamisega
- tundub, et omnios draiverite koosseis on ahtam võrreldes nö kommerts-solarisega (nt qlc vs qlc+qlt - qlc on qlogic fc initiator draiver; qlt on qlogic fc target draiver; omnios puhul qlt puudub üldse)
boot keskkondadega opereerimine
Boot Environment keskkondade nimekirja esitamine
root@omnios-02:~/20241224# beadm BE Active Mountpoint Space Policy Created omnios-r151052 - - 4.27M static 2024-12-24 21:44 omnios-r151052f NR / 1.55G static 2024-12-24 21:57 pre_napp-it-22.03 - - 201K static 2024-12-24 23:02
boot env vahel liikumine
beadm create be-imretest-1 beadm activate be-imretest-1 root@omnios-02:~# beadm list -s BE/Snapshot Space Policy Created omnios-r151052 omnios-r151052f pre_napp-it-22.03 omnios-r151052f-1 omnios-r151052f-2 omnios-r151052f-3 omnios-r151052f-3@2024-12-24-19:57:01 104.50K static 2024-12-24 21:57 omnios-r151052f-3@2024-12-24-19:57:44 33.81M static 2024-12-24 21:57 omnios-r151052f-3@2024-12-24-21:02:49 78.00M static 2024-12-24 23:02 omnios-r151052f-3@2024-12-24-21:29:33 352.50K static 2024-12-24 23:29 omnios-r151052f-3@2024-12-24-21:30:32 341.50K static 2024-12-24 23:30 omnios-r151052f-3@2024-12-24-23:26:09 71.72M static 2024-12-25 01:26 imretest-1 root@omnios-02:~# beadm activate imretest-1 Activated successfully root@omnios-02:~# beadm list -s BE/Snapshot Space Policy Created omnios-r151052 omnios-r151052f pre_napp-it-22.03 omnios-r151052f-1 omnios-r151052f-2 omnios-r151052f-3 imretest-1@2024-12-24-19:57:01 104.50K static 2024-12-24 21:57 imretest-1@2024-12-24-19:57:44 33.81M static 2024-12-24 21:57 imretest-1@2024-12-24-23:26:09 318.50K static 2024-12-25 01:26 imretest-1@2024-12-24-21:29:33 352.50K static 2024-12-24 23:29 imretest-1@2024-12-24-21:30:32 341.50K static 2024-12-24 23:30 imretest-1@2024-12-25-12:08:23 52K static 2024-12-25 14:08 imretest-1@2024-12-24-21:02:49 78.00M static 2024-12-24 23:02 imretest-1 root@omnios-02:~# beadm list BE Active Mountpoint Space Policy Created omnios-r151052 - - 4.27M static 2024-12-24 21:44 omnios-r151052f - - 8.19M static 2024-12-24 21:57 pre_napp-it-22.03 - - 201K static 2024-12-24 23:02 omnios-r151052f-1 - - 69.23M static 2024-12-24 23:29 omnios-r151052f-2 N / 173.50K static 2024-12-24 23:30 omnios-r151052f-3 - - 69.10M static 2024-12-25 01:26 imretest-1 R - 1.63G static 2024-12-25 14:08 root@omnios-02:~# reboot
Võrgu seadistamine
Füüsiliste võrguseadmete esitamine
root@omnios-02:~# dladm show-phys LINK MEDIA STATE SPEED DUPLEX DEVICE qede0 Ethernet up 25000 full qede0 qede1 Ethernet up 25000 full qede1
teine variant
root@omnios-02:~# dladm show-link LINK CLASS MTU STATE BRIDGE OVER qede0 phys 1500 up -- -- qede1 phys 9000 up -- -- q4062 vlan 1500 up -- qede0 q84 vlan 9000 up -- qede1 q88 vlan 9000 up -- qede1 q2602 vlan 1500 up -- qede0
draiveri info esitamine, 'pkg info -r xxx' aitab kui pole paigaldatud, nö remote küsimine
root@omnios-02:~/20241224# pkg info qede Name: driver/network/qede Summary: QLogic FastLinQ QL45xxx Ethernet Driver Description: QLogic FastLinQ QL45xxx Ethernet Driver Category: Drivers/Networking State: Installed (Manually installed) Publisher: omnios Version: 0.5.11 Branch: 151052.0 Packaging Date: October 17, 2024 at 09:00:37 PM Last Install Time: December 24, 2024 at 08:50:18 PM Size: 1.84 MB FMRI: pkg://omnios/driver/network/qede@0.5.11-151052.0:20241017T210037Z
Võrgunduse draiverite nimekirja küsimine
root@omnios-02:~# pkg list | grep 'driver/network' driver/network/afe 0.5.11-151052.0 i-- driver/network/amd8111s 0.5.11-151052.0 i-- driver/network/atge 0.5.11-151052.0 i-- driver/network/bfe 0.5.11-151052.0 i-- driver/network/bge 0.5.11-151052.0 i-- driver/network/bnx 0.5.11-151052.0 i-- ...
kui paketihaldusega proovida eemaldada midagi põhikoosseisust, siis saab teate
root@omnios-02:~# pkg uninstall e1000g Creating Plan (Solver setup): / pkg uninstall: Unable to remove 'driver/network/e1000g@0.5.11-151052.0' due to the following packages that depend on it: entire@11-151052.0 root@omnios-02:~# pkg info entire Name: entire Summary: Minimal set of core system packages Description: Meta package to specify the minimum OmniOS software set State: Installed Publisher: omnios Version: 11 Branch: 151052.0 Packaging Date: October 17, 2024 at 08:27:13 PM Last Install Time: November 18, 2024 at 10:02:49 AM Size: 1.79 kB FMRI: pkg://omnios/entire@11-151052.0:20241017T202713Z
Draiveri paigaldamine ilma võrguühenduseta arvutisse, https://illumos.topicbox.com/groups/discuss/T9a8038eb86649ccd
root@omnios-02:~/20241224# pkgrecv -s https://pkg.omnios.org/r151052/core -d /tmp/qede.p5p.storage/qede -a qede root@omnios-02:~/20241224# pkg install --no-refresh -g /tmp/qede.p5p.storage/qede qede
vlan kasutamine
# dladm create-vlan -l qede0 -v 4062 q4062 # dladm create-ip q4062 root@omnios-02:~# dladm show-vlan LINK VID OVER FLAGS q4062 4062 qede0 ----- # ipadm create-addr -T static -a 172.31.181.22/24 q4062/v4static root@omnios-02:~# route add default 172.31.181.1
eheda riistvara nimekirja küsimine, ei eelda, et draiverid oleksid olemas vms
root@omnios-02:~# prtconf -d | grep -i qlogi pci1077,73 (pciex1077,8070) [QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller], instance #0 pci1077,73 (pciex1077,8070) [QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller], instance #1 pci1590,2d4 (pciex1077,2281) [QLogic Corp. ISP2812-based 64/32G Fibre Channel to PCIe Controller] (driver not attached) pci1590,2d4 (pciex1077,2281) [QLogic Corp. ISP2812-based 64/32G Fibre Channel to PCIe Controller] (driver not attached)
dns kliendi seadistamine
dns kliendi seadistuse muutmine, tundub, et omnios puhul on see väga erinev solaris-proper juhtumist
- solaris-proper puhul svccfg ja co abil tehtud muudatuste tulemusena moodustatakse sobiva sisuga failid /etc/resolv.conf ja /etc/nsswitch.conf
- omnios puhul failide /etc/resolv.conf ja /etc/nsswitch.conf sättimise tulemusena läheb 'svcs -l dns/client' state=online asendisse
Olgu lähtepunktiks /etc/resolv.conf puudumine
root@omnios-02:~# ls -ld /etc/resolv.conf /etc/resolv.conf: No such file or directory root@omnios-02:~# svcs -l dns/client fmri svc:/network/dns/client:default name DNS resolver enabled true state offline next_state none state_time December 25, 2024 at 08:11:44 PM EET restarter svc:/system/svc/restarter:default dependency optional_all/none svc:/network/dns/install (disabled) dependency require_all/none svc:/system/filesystem/minimal (online) dependency require_all/none svc:/network/service (online) dependency require_all/none file://localhost/etc/resolv.conf (online) dependency require_any/error svc:/network/loopback (online) dependency optional_all/error svc:/milestone/network (online) dependency optional_all/refresh svc:/network/location:default (disabled) root@omnios-02:~# svcs -a | grep dns disabled 20:11:44 svc:/network/dns/install:default disabled 20:11:45 svc:/network/dns/multicast:default offline 20:11:44 svc:/network/dns/client:default root@omnios-02:~#
ning faili /etc/resolv.conf käsitsi tekitamine ning faili /etc/nsswitch.conf asendamine .dns variatsiooniga paneb svc osakonnas asjad korda
root@omnios-02:~# cat /etc/resolv.conf domain auul.pri.ee nameserver 10.192.0.53 root@omnios-02:~# cp /etc/nsswitch.conf /etc/nsswitch.bak root@omnios-02:~# cp /etc/nsswitch.dns /etc/nsswitch.conf root@omnios-02:~# svcadm refresh dns/client root@omnios-02:~# svcadm disable dns/client root@omnios-02:~# svcadm enable dns/client root@omnios-02:~# svcadm restart dns/client
Peale rebooti dns nimelahendus toimib
root@omnios-02:~# svcs -a | grep dns disabled 20:19:08 svc:/network/dns/install:default disabled 20:19:09 svc:/network/dns/multicast:default online 20:19:11 svc:/network/dns/client:default root@omnios-02:~# dig +short neti.auul.pri.ee a 10.154.221.184 10.154.221.183 root@omnios-02:~# ping neti.ee neti.ee is alive
iscsi kliendi kasutamine
Arvuti iscsi initiator nime küsimine
root@omnios-02:~# iscsiadm list initiator-node Initiator node name: iqn.1986-03.com.sun:01:982f79dec5fd.676c184c Initiator node alias: - Login Parameters (Default/Configured): Header Digest: NONE/NONE Data Digest: NONE/NONE Authentication Type: NONE RADIUS Server: NONE RADIUS Access: disabled Tunable Parameters (Default/Configured): Session Login Response Time: 60/- Maximum Connection Retry Time: 180/- Login Retry Time Interval: 60/- Configured Sessions: 1
iscsi kliendiks olemise eelduseks on '/network/iscsi/initiator' teenuse käimine
root@omnios-02:~# svcs svc:/network/iscsi/initiator:default STATE STIME FMRI disabled 22:41:41 svc:/network/iscsi/initiator:default root@omnios-02:~# iscsiadm add discovery-address 10.8.4.131 iSCSI Initiator Service is disabled, try 'svcadm enable network/iscsi/initiator' to enable the service. For more information, please refer to iscsi(4D). root@omnios-02:~# svcadm enable svc:/network/iscsi/initiator:default root@omnios-02:~# svcs svc:/network/iscsi/initiator:default STATE STIME FMRI online 22:47:36 svc:/network/iscsi/initiator:default
targeti kasutamise alustamiseks ja lõpetamiseks sobib öelda vastavalt, paistab, et automaatselt tegeldakse ka multipath teemadega
root@omnios-02:~# iscsiadm add discovery-address 10.8.4.131 root@omnios-02:~# dmesg ... Dec 26 22:36:13 localhost genunix: [ID 936769 kern.info] sd1 is /scsi_vhci/disk@g600000e00d300000003008ec00040000 Dec 26 22:36:13 localhost genunix: [ID 408114 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) online Dec 26 22:36:13 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: degraded: path 5 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110000B,0 is online Dec 26 22:36:14 localhost genunix: [ID 530209 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 2 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111000C,0 is online: Load balancing: round-robin Dec 26 22:36:14 localhost genunix: [ID 530209 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 4 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011000A,0 is online: Load balancing: round-robin Dec 26 22:36:15 localhost genunix: [ID 530209 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 3 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:00100009,0 is online: Load balancing: round-robin root@omnios-02:~# iscsiadm remove discovery-address 10.8.4.131 root@omnios-02:~# dmesg ... Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 2 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111000C,0 is offline Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(293) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 offline#012 Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: optimal: path 5 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110000B,0 is offline Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(290) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110 offline#012 Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: degraded: path 4 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011000A,0 is offline Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(287) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011 offline#012 Dec 26 22:37:37 localhost genunix: [ID 408114 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) offline Dec 26 22:37:37 localhost genunix: [ID 483743 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) multipath status: failed: path 3 iscsi0/disk@0000iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:00100009,0 is offline Dec 26 22:37:37 localhost genunix: [ID 408114 kern.info] /scsi_vhci/disk@g600000e00d300000003008ec00040000 (sd1) offline Dec 26 22:37:37 localhost iscsi: [ID 732673 kern.info] NOTICE: iscsi session(284) iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010 offline#012
discovery puntide nimekirja esitamine
root@omnios-02:~# iscsiadm list discovery-address Discovery Address: 10.8.4.131:3260
iscsi targets
root@omnios-02:~# iscsiadm list target Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 Alias: - TPGT: 12 ISID: 4000002a0000 Connections: 1 Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110 Alias: - TPGT: 11 ISID: 4000002a0000 Connections: 1 Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011 Alias: - TPGT: 10 ISID: 4000002a0000 Connections: 1 Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010 Alias: - TPGT: 9 ISID: 4000002a0000 Connections: 1
target omadused
root@omnios-02:~# iscsiadm list target -v iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 Target: iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111 Alias: - TPGT: 12 ISID: 4000002a0000 Connections: 1 CID: 0 IP address (Local): 10.8.8.22:49993 IP address (Peer): 10.8.8.132:3260 Discovery Method: SendTargets Login Parameters (Negotiated): Data Sequence In Order: yes Data PDU In Order: yes Default Time To Retain: 20 Default Time To Wait: 2 Error Recovery Level: 0 First Burst Length: 65536 Immediate Data: no Initial Ready To Transfer (R2T): yes Max Burst Length: 262144 Max Outstanding R2T: 1 Max Receive Data Segment Length: 16384 Max Connections: 1 Header Digest: NONE Data Digest: NONE
paistab, et multipath käivitatakse automaatselt
root@omnios-02:~# mpathadm list lu /dev/rdsk/c0t600000E00D300000003008EC00040000d0s2 Total Path Count: 4 Operational Path Count: 4
ning
root@omnios-02:~# mpathadm show lu /dev/rdsk/c0t600000E00D300000003008EC00040000d0s2 Logical Unit: /dev/rdsk/c0t600000E00D300000003008EC00040000d0s2 mpath-support: libmpscsi_vhci.so Vendor: FUJITSU Product: ETERNUS_DXM Revision: 0000 Name Type: unknown type Name: 600000e00d300000003008ec00040000 Asymmetric: yes Current Load Balance: round-robin Logical Unit Group ID: NA Auto Failback: on Auto Probing: NA Paths: Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111,12 Override Path: NA Path State: OK Disabled: no Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010,9 Override Path: NA Path State: OK Disabled: no Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011,10 Override Path: NA Path State: OK Disabled: no Initiator Port Name: iqn.1986-03.com.sun:01:ffffffffffff.676d79a8,4000002a00ff Target Port Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110,11 Override Path: NA Path State: OK Disabled: no Target Port Groups: ID: 32917 Explicit Failover: no Access State: active optimized Target Ports: Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0111,12 Relative ID: 16533 ID: 32900 Explicit Failover: no Access State: active optimized Target Ports: Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0010,9 Relative ID: 16516 ID: 32901 Explicit Failover: no Access State: active optimized Target Ports: Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0011,10 Relative ID: 16517 ID: 32916 Explicit Failover: no Access State: active optimized Target Ports: Name: 4000002a0000,iqn.2000-09.com.fujitsu:storage-system.eternus-dxm:003008ec:0110,11 Relative ID: 16532
ressursi enda vaatlemiseks sobib nt format käsk
root@omnios-02:~# format Searching for disks...done AVAILABLE DISK SELECTIONS: 0. c0t600000E00D300000003008EC00040000d0 <FUJITSU-ETERNUS_DXM-0000-1.00TB> /scsi_vhci/disk@g600000e00d300000003008ec00040000 1. c2t1d0 <HPE-LOGICAL VOLUME-7.11-3.49TB> /pci@7a,0/pci8086,347a@2/pci103c,600@0/disk@1,0 Specify disk (enter its number): ^C root@omnios-02:~#
ressursi kasutamiseks sobib öelda nt kusjuures eemaldamiseks tuleb esmalt teha 'zpool destory ...' ja seejärel eemaldada iscsi ressurss
root@omnios-02:~# zpool create zp_eternus_02 c0t600000E00D300000003008EC00040000d0 root@omnios-02:~# iscsiadm remove discovery-address 10.8.4.131 iscsiadm: Logical unit in use iscsiadm: Unable to complete operation
napp-it lahenduse kasutamine
napp-it tarkvara paigaldamine
- https://www.illumos.org/hcl/
- https://illumos.org/man/4D/qede
- https://docs.oracle.com/cd/E88353_01/html/E37851/qede-4d.html
- https://github.com/omniosorg/omnios-wiki/blob/master/GeneralAdministration.md
- https://docs.brconsulting.info/en/docs/infrastructure/storage/napp-it/02-nappit-comstarsetup/
root@omnios:~# wget -O - www.napp-it.org/nappit | perl root@omnios:~# beadm BE Active Mountpoint Space Policy Created omnios-r151046an NR / 1.78G static 2024-12-21 18:09 pre_napp-it-22.03 - - 164K static 2024-12-21 18:30 omnios-r151046an-backup-1 - - 109K static 2024-12-21 18:30 omnios-r151046an-backup-2 - - 233K static 2024-12-21 18:31 omnios-r151046an-backup-3 - - 289K static 2024-12-21 18:33
iscsi teenuse seadistamine
Lähtepunktiks on töötav OmniOS operatsioonisüsteem, millele on paigaldatud napp-it tarkvara.
'iscsi target service' käivitamine, valida napp-it webgui liidesest
Services -> COMSTAR -> ISCSI target service -> online
Tundub, et sellele tegevusele vastab
root@omnios-02:~# svcs svc:/network/iscsi/target:default STATE STIME FMRI disabled 0:05:25 svc:/network/iscsi/target:default
muutumine
root@omnios-02:~# svcs svc:/network/iscsi/target:default STATE STIME FMRI online 0:05:25 svc:/network/iscsi/target:default
LUN tekitamiseks sobib webgui liideses öelda
Comstar -> Logical Units -> create volume LU
Käsureal vastab midagi sellist
root@omnios-02:~# stmfadm list-lu -v LU Name: 600144F0650F1E060000676DEE2D0001 Operational Status: Online Provider Name : sbd Alias : /dev/zvol/rdsk/zp_eternus_02/zvol_ers_01 View Entry Count : 0 Data File : /dev/zvol/rdsk/zp_eternus_02/zvol_ers_01 Meta File : not set Size : 429496729600 Block Size : 512 Management URL : not set Vendor ID : SUN Product ID : COMSTAR Serial Num : not set Write Protect : Disabled Writeback Cache : Disabled Access State : Active
Target tekitamiseks sobib öelda
Comstar -> Targets -> ++add target
PILT
kus
- Target name: iqn.2010-09.org.zfs-san:1735257824
käsureal vastab midagi sellist
root@omnios-02:~# itadm list-target -v TARGET NAME STATE SESSIONS iqn.2010-09.org.zfs-san:1735257824 online 0 alias: omnios-02 auth: none targetchapuser: - targetchapsecret: unset tpg-tags: default
host group tekitamine
Comstar -> Host-Groups -> name of Host Group -> hg_moraal_pve
ning add members
- Select host group: hg_adala_pve
- Members: iqn.2004-10.com.ubuntu:01:863b8b3dace pve node iscsi initiator)
käsureal vastab midagi sellist
root@omnios-02:~# stmfadm list-hg -v Host Group: hg_adala_pve Member: iqn.2004-10.com.ubuntu:01:863b8b3dace
target group tekitamine
Comstar -> Target-Groups -> name of new Target Group - tg_luns_for_adala_pve_initiators
ning seejärel lisada konkreetne 'target' 'target group' sisse
Comstar -> Target-Groups -> add targets
- select target: iqn.2010-09.org.zfs-san:1735257824
- add to target group: tg_luns_for_adala_pve_initiators
Käsurealt vastab midagi sellist
root@omnios-02:~# stmfadm list-tg -v Target Group: tg_luns_for_adala_pve_initiators Member: iqn.2010-09.org.zfs-san:1735257824
View tekitamiseks sobib öelda
Comstar ->
- select LOgical Unit GUID: 600144F0650F1E060000676DEE2D0001(zp_eternus_02/zvol_ers_01)
- and to host group: hg_moraal_pve
- add to target group: tg_luns_for_moraal_pve_initiators
käsurealt vastab sellele midagi
TODO
Target Portal Group tekitamiseks sobib öelda
Comstar -> Target Portal Groups
- name of portal group: tpg_luns_for_adala_pve_initiators
- select ip address for this portal - nt 10.106.2.22 (q2602)
repo paketihalduse kasutamine
repo lisamine
# pkg set-publisher -g http://pkg.cs.umd.edu/ cs.umd.edu # pkg publisher PUBLISHER TYPE STATUS P LOCATION omnios origin online F http://pkg.omniti.com/omnios/r151020/ cs.umd.edu origin online F http://pkg.cs.umd.edu/
kasutamine
# pkg search postfix # pkg install -nv postfix # pkg contents postfix # svcadm enable postfix # svcadm restart ssh
# svcs -l postfix fmri svc:/network/smtp/postfix:default name Postfix Mail server enabled true state online next_state none state_time Tue Jan 10 03:53:40 2017 logfile /var/svc/log/network-smtp-postfix:default.log restarter svc:/system/svc/restarter:default contract_id 88 dependency require_all/error svc:/milestone/network:default (online) dependency require_all/error svc:/system/filesystem/local (online)
pkgsrc
CSW
# pkgadd -d http://get.opencsw.org/now # /opt/csw/bin/pkgutil -a joe # /opt/csw/bin/pkgutil -y -i joe # vi /etc/opt/csw/joe/joerc