Proxmox v. 8 kasutamine: erinevus redaktsioonide vahel
| (ei näidata sama kasutaja 13 vahepealset redaktsiooni) | |||
| 3. rida: | 3. rida: | ||
TODO | TODO | ||
===proxmox-boot-tool kasutamine=== | ===proxmox-boot-tool kasutamine - bootctl=== | ||
<pre> | |||
root@pve-svc-02:~# cat /etc/kernel/cmdline | |||
root=ZFS=rpool/ROOT/pve-1 boot=zfs pcie_aspm=off pcie_port_pm=off nvme_core.default_ps_max_latency_us=0 nvme_core.apst=0 | |||
root@pve-svc-02:~# proxmox-boot-tool refresh | |||
</pre> | |||
===proxmox-boot-tool kasutamine - grub=== | |||
Vajadusel --force suvand | Vajadusel --force suvand | ||
| 12. rida: | 21. rida: | ||
grup tekitamine | grup tekitamine | ||
# proxmox-boot-tool init /dev/sda1 grub | |||
# proxmox-boot-tool init /dev/sdb1 grub | # proxmox-boot-tool init /dev/sdb1 grub | ||
| 32. rida: | 42. rida: | ||
</pre> | </pre> | ||
ning | Selliselt käivitatud süsteemi edasiseks haldamiseks sobib öelda | ||
<pre> | |||
# proxmox-boot-tool status | |||
# proxmox-boot-tool refresh | |||
</pre> | |||
Kusjuures nö klassikalise update-grub ütlemine kutsub välja sama 'proxmox-boot-tool refresh' | |||
<pre> | |||
# update-grub | |||
Generating grub configuration file ... | |||
W: This system is booted via proxmox-boot-tool: | |||
W: Executing 'update-grub' directly does not update the correct configs! | |||
W: Running: 'proxmox-boot-tool refresh' | |||
No /etc/kernel/cmdline found - falling back to /proc/cmdline | |||
Copying and configuring kernels on /dev/disk/by-uuid/17BA-8F03 | |||
Copying kernel 6.5.11-7-pve | |||
Generating grub configuration file ... | |||
Found linux image: /boot/vmlinuz-6.5.11-7-pve | |||
Found initrd image: /boot/initrd.img-6.5.11-7-pve | |||
Adding boot menu entry for UEFI Firmware Settings ... | |||
done | |||
Copying and configuring kernels on /dev/disk/by-uuid/EDA2-7AC7 | |||
Copying kernel 6.5.11-7-pve | |||
Generating grub configuration file ... | |||
Found linux image: /boot/vmlinuz-6.5.11-7-pve | |||
Found initrd image: /boot/initrd.img-6.5.11-7-pve | |||
Adding boot menu entry for UEFI Firmware Settings ... | |||
done | |||
Found linux image: /boot/vmlinuz-6.5.11-7-pve | |||
Found initrd image: /boot/initrd.img-6.5.11-7-pve | |||
Adding boot menu entry for UEFI Firmware Settings ... | |||
done | |||
</pre> | |||
efibootmgr ja uuid osakond | |||
<pre> | |||
# efibootmgr -v | |||
BootCurrent: 0006 | |||
Timeout: 10 seconds | |||
BootOrder: 0006,0005,0000,0003,0004,0002 | |||
Boot0000 proxmox HD(1,GPT,7c575bd3-de2d-4d57-b344-be7529331560,0x800,0x1dc800)/File(\EFI\PROXMOX\SHIMX64.EFI) | |||
Boot0002* refind VenHw(99e275e7-75a0-4b37-a2e6-c5385e6c00cb) | |||
Boot0003 debian HD(1,GPT,7c575bd3-de2d-4d57-b344-be7529331560,0x800,0x1dc800)/File(\EFI\DEBIAN\SHIMX64.EFI) | |||
Boot0004 debian HD(1,GPT,7c575bd3-de2d-4d57-b344-be7529331560,0x800,0x1dc800)/File(\EFI\DEBIAN\GRUBX64.EFI)..BO | |||
Boot0005* UEFI OS HD(1,GPT,d240f095-7252-4a51-8480-77d19650cb3f,0x800,0x1dc800)/File(\EFI\BOOT\BOOTX64.EFI)..BO | |||
Boot0006* UEFI OS HD(1,GPT,7c575bd3-de2d-4d57-b344-be7529331560,0x800,0x1dc800)/File(\EFI\BOOT\BOOTX64.EFI)..BO | |||
# blkid /dev/sda1 | |||
/dev/sda1: UUID="17BA-8F03" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="7c575bd3-de2d-4d57-b344-be7529331560" | |||
# blkid /dev/sdb1 | |||
/dev/sdb1: UUID="EDA2-7AC7" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="d240f095-7252-4a51-8480-77d19650cb3f" | |||
</pre> | |||
kus | |||
* efibootmgr väljundis ei ole esitatud otseselt kõvakette number (mis väljendab nt sata ketta puhul millisesse sata porti on kaabel kinnitatud) | |||
* HD(1,GPT) väljendab et tegu on mingi süsteemi kõvakette esimese partitsiooniga ning et kasutusel on gpt partitsioonitabel, vfat failisüsteemi uuid, ning milline efi rakendus käivitatakse sellelt vfat partitsioonilt | |||
* kinnitatud portide kohta saab teada 'lsscsi -v' või 'lshw -c storage -c disk' väljundist | |||
Secure Boot osakond | |||
<pre> | <pre> | ||
| 47. rida: | 121. rida: | ||
... | ... | ||
</pre> | </pre> | ||
===proxmox-boot-tool kasutamine - bootctl -> grub=== | |||
Selleks, et süsteem lülitada käima grub asjakorraldusega, tuleb lihtsalt sooritada punktis 'proxmox-boot-tool kasutamine - grub' esitatud tegevused. Ning eemaldada uuid failist kaks esimest sissekannet, st et alles jääb | |||
<pre> | |||
root@pve-svc-02:~# cat /etc/kernel/proxmox-boot-uuids | |||
F5E8-BD97 | |||
F649-D031 | |||
root@pve-svc-02:~# blkid /dev/sda2 | |||
/dev/sda2: UUID="F5E8-BD97" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="965e6433-d985-450c-8519-4124b9f2daa6" | |||
root@pve-svc-02:~# blkid /dev/sdb2 | |||
/dev/sdb2: UUID="F649-D031" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="51a297f3-64bc-4ce7-8f01-6daf0b11b7f7" | |||
</pre> | |||
===Storage - host: nvme -> zfs ja guest: lvm -> ext4=== | |||
====host nvme -> zfs seadistus==== | |||
TODO | |||
host juures sobib kasutada | |||
TODO | |||
====guest lvm -> ext4 seadistus==== | |||
Virtuaalse arvuti seadistustes sobib kasutada | |||
* cache - none | |||
* bus/device - SCSI VirtIO | |||
* ssd emulation - jah | |||
* io thread - eeldusel et on üks virtuaalne plokkseade pole vajadust | |||
üldine soovitus | |||
* bus/device - SCSI VirtIO single | |||
* IO therad - jah | |||
====Kasulikud lisamaterjalid==== | |||
* https://forum.proxmox.com/threads/pve-7-1-with-zfs-best-practices-for-windows-vm-hard-disk.106101/ | |||
* https://forum.proxmox.com/threads/questions-about-disk-config.137724/ | |||
===NUMA - non-uniform memory access=== | |||
Väited | |||
* kasutamine praktiliselt eeldab, et PVE node on füüsiliselt enam kui ühe füüsilise cpu'ga arvuti, nt dual-socket | |||
* NUMA lubaduseks on et virtuaalse arvuti protsessorid seostatakse sobivalt füüsiliste protsessoritega, ning vastava füüsilise mäluga | |||
Kasutamiseks tuleb PVE webgui keskkonnas valida | |||
* Hardware -> Processors -> Sockets - 2 | |||
* Hardware -> Processors -> Cores - 4 | |||
* Hardware -> Processors -> VCPUSs - 8 (kujuneb ise socket ja cores korrutiseks) | |||
* Hardware -> Processors -> Enable NUMA - linnutada | |||
Tulemusena on virtuaalses arvutis selline väljund | |||
<pre> | |||
root@pbs:~# lscpu | grep NUMA | |||
NUMA node(s): 2 | |||
NUMA node0 CPU(s): 0,1 | |||
NUMA node1 CPU(s): 2,3 | |||
</pre> | |||
ning | |||
<pre> | |||
root@pbs:~# numactl --hardware | |||
available: 2 nodes (0-1) | |||
node 0 cpus: 0 1 | |||
node 0 size: 1901 MB | |||
node 0 free: 46 MB | |||
node 1 cpus: 2 3 | |||
node 1 size: 2014 MB | |||
node 1 free: 1014 MB | |||
node distances: | |||
node 0 1 | |||
0: 10 20 | |||
1: 20 10 | |||
</pre> | |||
ning | |||
<pre> | |||
root@pbs:~# numastat | |||
node0 node1 | |||
numa_hit 592792 2138996 | |||
numa_miss 0 462989 | |||
numa_foreign 462989 0 | |||
interleave_hit 586 597 | |||
local_node 591816 2137704 | |||
other_node 976 464281 | |||
</pre> | |||
===Kasutajate haldamine=== | |||
====PVE osakond==== | |||
Väited | |||
* paroolide hashid - /etc/pve/priv/shadow.cfg | |||
* kasutajate nimed - /etc/pve/user.cfg | |||
Kasutaja lisamine | |||
pveum user add testuser@pve -comment "Just a test" | |||
Kasuta parooli sättimine | |||
pveum passwd testuser@pve | |||
Kasutaja lisamine admin gruppi eesmärgiga, et kasutajal oleks nö enam privileege | |||
pveum user modify testuser@pve -group admin | |||
Kasutajate nimekirja küsimine | |||
pveum user list | |||
Gruppide nimekirja küsimine | |||
pveum group list | |||
===2-node klaster=== | |||
TODO | |||
===Kasulikud lisamaterjalid=== | ===Kasulikud lisamaterjalid=== | ||
* https://pve.proxmox.com/wiki/Host_Bootloader | * https://pve.proxmox.com/wiki/Host_Bootloader | ||
Viimane redaktsioon: 5. mai 2026, kell 04:23
Sissejuhatus
TODO
proxmox-boot-tool kasutamine - bootctl
root@pve-svc-02:~# cat /etc/kernel/cmdline root=ZFS=rpool/ROOT/pve-1 boot=zfs pcie_aspm=off pcie_port_pm=off nvme_core.default_ps_max_latency_us=0 nvme_core.apst=0 root@pve-svc-02:~# proxmox-boot-tool refresh
proxmox-boot-tool kasutamine - grub
Vajadusel --force suvand
# proxmox-boot-tool format /dev/sda1 --force # proxmox-boot-tool format /dev/sdb1 --force
grup tekitamine
# proxmox-boot-tool init /dev/sda1 grub # proxmox-boot-tool init /dev/sdb1 grub
tulemuse kontrollimiseks
# proxmox-boot-tool status Re-executing '/usr/sbin/proxmox-boot-tool' in new private mount namespace.. System currently booted with uefi 0426-0BDE is configured with: grub (versions: 6.5.11-7-pve) FB90-E8DA is configured with: grub (versions: 6.5.11-7-pve)
ning
# cat /etc/kernel/proxmox-boot-uuids 0426-0BDE FB90-E8DA
Selliselt käivitatud süsteemi edasiseks haldamiseks sobib öelda
# proxmox-boot-tool status # proxmox-boot-tool refresh
Kusjuures nö klassikalise update-grub ütlemine kutsub välja sama 'proxmox-boot-tool refresh'
# update-grub Generating grub configuration file ... W: This system is booted via proxmox-boot-tool: W: Executing 'update-grub' directly does not update the correct configs! W: Running: 'proxmox-boot-tool refresh' No /etc/kernel/cmdline found - falling back to /proc/cmdline Copying and configuring kernels on /dev/disk/by-uuid/17BA-8F03 Copying kernel 6.5.11-7-pve Generating grub configuration file ... Found linux image: /boot/vmlinuz-6.5.11-7-pve Found initrd image: /boot/initrd.img-6.5.11-7-pve Adding boot menu entry for UEFI Firmware Settings ... done Copying and configuring kernels on /dev/disk/by-uuid/EDA2-7AC7 Copying kernel 6.5.11-7-pve Generating grub configuration file ... Found linux image: /boot/vmlinuz-6.5.11-7-pve Found initrd image: /boot/initrd.img-6.5.11-7-pve Adding boot menu entry for UEFI Firmware Settings ... done Found linux image: /boot/vmlinuz-6.5.11-7-pve Found initrd image: /boot/initrd.img-6.5.11-7-pve Adding boot menu entry for UEFI Firmware Settings ... done
efibootmgr ja uuid osakond
# efibootmgr -v BootCurrent: 0006 Timeout: 10 seconds BootOrder: 0006,0005,0000,0003,0004,0002 Boot0000 proxmox HD(1,GPT,7c575bd3-de2d-4d57-b344-be7529331560,0x800,0x1dc800)/File(\EFI\PROXMOX\SHIMX64.EFI) Boot0002* refind VenHw(99e275e7-75a0-4b37-a2e6-c5385e6c00cb) Boot0003 debian HD(1,GPT,7c575bd3-de2d-4d57-b344-be7529331560,0x800,0x1dc800)/File(\EFI\DEBIAN\SHIMX64.EFI) Boot0004 debian HD(1,GPT,7c575bd3-de2d-4d57-b344-be7529331560,0x800,0x1dc800)/File(\EFI\DEBIAN\GRUBX64.EFI)..BO Boot0005* UEFI OS HD(1,GPT,d240f095-7252-4a51-8480-77d19650cb3f,0x800,0x1dc800)/File(\EFI\BOOT\BOOTX64.EFI)..BO Boot0006* UEFI OS HD(1,GPT,7c575bd3-de2d-4d57-b344-be7529331560,0x800,0x1dc800)/File(\EFI\BOOT\BOOTX64.EFI)..BO # blkid /dev/sda1 /dev/sda1: UUID="17BA-8F03" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="7c575bd3-de2d-4d57-b344-be7529331560" # blkid /dev/sdb1 /dev/sdb1: UUID="EDA2-7AC7" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="d240f095-7252-4a51-8480-77d19650cb3f"
kus
- efibootmgr väljundis ei ole esitatud otseselt kõvakette number (mis väljendab nt sata ketta puhul millisesse sata porti on kaabel kinnitatud)
- HD(1,GPT) väljendab et tegu on mingi süsteemi kõvakette esimese partitsiooniga ning et kasutusel on gpt partitsioonitabel, vfat failisüsteemi uuid, ning milline efi rakendus käivitatakse sellelt vfat partitsioonilt
- kinnitatud portide kohta saab teada 'lsscsi -v' või 'lshw -c storage -c disk' väljundist
Secure Boot osakond
# mokutil --sb-state SecureBoot enabled # efibootmgr -v BootCurrent: 0002 Timeout: 3 seconds BootOrder: 0003,0002,0001,0000,0007,0004,0005,0006,0008 Boot0000* UiApp FvVol(7cb8bdc9-f8eb-4f34-aaea-3ee4af6516a1)/FvFile(462caa21-7614-4503-836e-8ab6f4662331) Boot0001* UEFI QEMU HARDDISK QM00015 PciRoot(0x0)/Pci(0x1e,0x0)/Pci(0x1,0x0)/Pci(0x7,0x0)/Sata(1,65535,0)N.....YM....R,Y. Boot0002* UEFI QEMU HARDDISK QM00013 PciRoot(0x0)/Pci(0x1e,0x0)/Pci(0x1,0x0)/Pci(0x7,0x0)/Sata(0,65535,0)N.....YM....R,Y. ...
proxmox-boot-tool kasutamine - bootctl -> grub
Selleks, et süsteem lülitada käima grub asjakorraldusega, tuleb lihtsalt sooritada punktis 'proxmox-boot-tool kasutamine - grub' esitatud tegevused. Ning eemaldada uuid failist kaks esimest sissekannet, st et alles jääb
root@pve-svc-02:~# cat /etc/kernel/proxmox-boot-uuids F5E8-BD97 F649-D031 root@pve-svc-02:~# blkid /dev/sda2 /dev/sda2: UUID="F5E8-BD97" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="965e6433-d985-450c-8519-4124b9f2daa6" root@pve-svc-02:~# blkid /dev/sdb2 /dev/sdb2: UUID="F649-D031" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="51a297f3-64bc-4ce7-8f01-6daf0b11b7f7"
Storage - host: nvme -> zfs ja guest: lvm -> ext4
host nvme -> zfs seadistus
TODO
host juures sobib kasutada
TODO
guest lvm -> ext4 seadistus
Virtuaalse arvuti seadistustes sobib kasutada
- cache - none
- bus/device - SCSI VirtIO
- ssd emulation - jah
- io thread - eeldusel et on üks virtuaalne plokkseade pole vajadust
üldine soovitus
- bus/device - SCSI VirtIO single
- IO therad - jah
Kasulikud lisamaterjalid
- https://forum.proxmox.com/threads/pve-7-1-with-zfs-best-practices-for-windows-vm-hard-disk.106101/
- https://forum.proxmox.com/threads/questions-about-disk-config.137724/
NUMA - non-uniform memory access
Väited
- kasutamine praktiliselt eeldab, et PVE node on füüsiliselt enam kui ühe füüsilise cpu'ga arvuti, nt dual-socket
- NUMA lubaduseks on et virtuaalse arvuti protsessorid seostatakse sobivalt füüsiliste protsessoritega, ning vastava füüsilise mäluga
Kasutamiseks tuleb PVE webgui keskkonnas valida
- Hardware -> Processors -> Sockets - 2
- Hardware -> Processors -> Cores - 4
- Hardware -> Processors -> VCPUSs - 8 (kujuneb ise socket ja cores korrutiseks)
- Hardware -> Processors -> Enable NUMA - linnutada
Tulemusena on virtuaalses arvutis selline väljund
root@pbs:~# lscpu | grep NUMA NUMA node(s): 2 NUMA node0 CPU(s): 0,1 NUMA node1 CPU(s): 2,3
ning
root@pbs:~# numactl --hardware available: 2 nodes (0-1) node 0 cpus: 0 1 node 0 size: 1901 MB node 0 free: 46 MB node 1 cpus: 2 3 node 1 size: 2014 MB node 1 free: 1014 MB node distances: node 0 1 0: 10 20 1: 20 10
ning
root@pbs:~# numastat
node0 node1
numa_hit 592792 2138996
numa_miss 0 462989
numa_foreign 462989 0
interleave_hit 586 597
local_node 591816 2137704
other_node 976 464281
Kasutajate haldamine
PVE osakond
Väited
- paroolide hashid - /etc/pve/priv/shadow.cfg
- kasutajate nimed - /etc/pve/user.cfg
Kasutaja lisamine
pveum user add testuser@pve -comment "Just a test"
Kasuta parooli sättimine
pveum passwd testuser@pve
Kasutaja lisamine admin gruppi eesmärgiga, et kasutajal oleks nö enam privileege
pveum user modify testuser@pve -group admin
Kasutajate nimekirja küsimine
pveum user list
Gruppide nimekirja küsimine
pveum group list
2-node klaster
TODO