o w7e8T @s>UdZddlZddlZddlZddlZddlZddlZddlZddlm Z m Z ddl m Z ddl mZddlmZddlmZddlmZdd lmZmZmZdd lmZdd lmZdd lmZmZdd l m!Z!m"Z"ddl#m$Z$dZ%e$Z&ddde%e!ge&ededggdZ'ee(d<ee'ZddgddZ)edZ*GdddZ+e,e-Z.de/de"d e0fd!d"Z1Gd#d$d$e2Z3Gd%d&d&e Z4Gd'd(d(e4Z5Gd)d*d*e4Z6Gd+d,d,e4Z7d-d.Z8d/d0Z9d1d2Z:d3d4Z;d5ed5ee/e/ffd:d;Z?de/d?ed@edAe0d5df dBdCZAdDe5fdEe6fdFe7ffZBdS)GzGrowpart: Grow partitionsN)ABCabstractmethod)suppress)Path)dedent)Tuple)log)subp temp_utilsutil)Cloud)Config) MetaSchema get_meta_doc) ALL_DISTROSDistro) PER_ALWAYSa6Growpart resizes partitions to fill the available disk space. This is useful for cloud instances with a larger amount of disk space available than the pristine image uses, as it allows the instance to automatically make use of the extra space. Note that this only works if the partition to be resized is the last one on a disk with classic partitioning scheme (MBR, BSD, GPT). LVM, Btrfs and ZFS have no such restrictions. The devices on which to run growpart are specified as a list under the ``devices`` key. There is some functionality overlap between this module and the ``growroot`` functionality of ``cloud-initramfs-tools``. However, there are some situations where one tool is able to function and the other is not. The default configuration for both should work for most cloud instances. To explicitly prevent ``cloud-initramfs-tools`` from running ``growroot``, the file ``/etc/growroot-disabled`` can be created. By default, both ``growroot`` and ``cc_growpart`` will check for the existence of this file and will not run if it is present. However, this file can be ignored for ``cc_growpart`` by setting ``ignore_growroot_disabled`` to ``true``. For more information on ``cloud-initramfs-tools`` see: https://launchpad.net/cloud-initramfs-tools On FreeBSD, there is also the ``growfs`` service, which has a lot of overlap with ``cc_growpart`` and ``cc_resizefs``, but only works on the root partition. In that configuration, we use it, otherwise, we fall back to ``gpart``. Note however, that ``growfs`` may insert a swap partition, if none is present, unless instructed not to via ``growfs_swap_size=0`` in either ``kenv(1)``, or ``rc.conf(5)``. Growpart is enabled by default on the root partition. The default config for growpart is:: growpart: mode: auto devices: ["/"] ignore_growroot_disabled: false cc_growpartGrowpartzGrow partitionsz growpart: mode: auto devices: ["/"] ignore_growroot_disabled: false z growpart: mode: growpart devices: - "/" - "/dev/vdb1" ignore_growroot_disabled: true )idnametitle descriptiondistros frequencyexamplesactivate_by_schema_keysmetaauto/F)modedevicesignore_growroot_disabledz/cc_growpart_keydatac@seZdZdZdZdZdZdS)RESIZESKIPPEDCHANGEDNOCHANGEFAILEDN)__name__ __module__ __qualname__r$r%r&r'r+r+>/usr/lib/python3/dist-packages/cloudinit/config/cc_growpart.pyr#os r#r distror!c Csd}|dkr#tD]\}}||}|j|dr|}nq|s!td|Si}tD]\}} | ||<q'||vr:td||||} | j|drH| }|sPtd||S)Nr)r!zNo resizers availablezunknown resize mode %szmode %s not available)RESIZERS available ValueError TypeError) r r-r! resize_class_nameresizercurmmapkvmclassr+r+r,resizer_factoryys,        r:c@s eZdZdS)ResizeFailedExceptionN)r(r)r*r+r+r+r,r;sr;c@s<eZdZdefddZededefddZedd Z d S) Resizerr-cCs ||_dSN)_distro)selfr-r+r+r,__init__s zResizer.__init__r!returncCdSr=r+r?r!r+r+r,r/zResizer.availablecCrBr=r+)r?diskdevpartnumpartdevr+r+r,resizerDzResizer.resizeN) r(r)r*rr@rlistboolr/rHr+r+r+r,r<s r<c@"eZdZdefddZddZdS)ResizeGrowPartr!cCsXtj}d|d<ztjddg|d\}}td|rWdSWdStjy+YdSw) NCLANGgrowpartz--helpenvz --update\s+TFosenvironcopyr researchProcessExecutionError)r?r!myenvout_errr+r+r,r/s  zResizeGrowPart.availablec CsVtj}d|d<t|}|j}tj|dd}tj |d}tj |s-t |d||d<z t j dd||g|d Wn0t j yn} z#| jd krYttd ||t| | ||fWYd} ~ WdSd} ~ wwz t j d||g|d Wnt j y} z ttd ||t| | d} ~ wwWdn1swY|t|fS) NrMrNT)dir needs_exerOiTMPDIRz --dry-runrPz&Failed growpart --dry-run for (%s, %s)zFailed: growpart %s %s)rSrTrUget_sizer>get_tmp_exec_pathr tempdirpathjoinexistsmkdirr rX exit_coder logexcLOGr;) r?rErFrGrYbeforetmp_dirtmpd growpart_tmper+r+r,rHsH            zResizeGrowPart.resizeNr(r)r*rIr/rHr+r+r+r,rL rLc@s&eZdZdZdefddZddZdS) ResizeGrowFSa Use FreeBSD ``growfs`` service to grow root partition to fill available space, optionally adding a swap partition at the end. Note that the service file warns us that it uses ``awk(1)``, and as such requires ``/usr`` to be present. However, cloud-init is installed into ``/usr/local``, so we should be fine. We invoke the ``growfs`` with ``service growfs onestart``, so it doesn't need to be enabled in ``rc.conf``. r!cCstjdo |dgkS)z'growfs only works on the root partitionz/etc/rc.d/growfsr)rSrcisfilerCr+r+r,r/szResizeGrowFS.availablec CsZt|}z |jjdddWntjy&}z ttdt||d}~ww|t|fS)Nonestartgrowfs)actionservicezFailed: service growfs onestart) r`r>manage_servicer rXr rhrir;)r?rErFrGrjrnr+r+r,rHs   zResizeGrowFS.resizeN)r(r)r*__doc__rIr/rHr+r+r+r,rqs rqc@rK) ResizeGpartr!cCs^tj}d|d<ztjddg|ddgd\}}td|r!Wd SWd Stjy.Yd Sw) NrMrNgparthelprr_)rQrcszgpart recover TFrR)r?r!rY_outerrr+r+r,r/s  zResizeGpart.availablec Csz tdd|gWn$tjy.}z|jdkr$ttd|t||WYd}~nd}~wwt|}z tddd||gWntjyY}z ttd||t||d}~ww|t|fS) a9 GPT disks store metadata at the beginning (primary) and at the end (secondary) of the disk. When launching an image with a larger disk compared to the original image, the secondary copy is lost. Thus, the metadata will be marked CORRUPT, and need to be recovered. rzrecoverrzFailed: gpart recover %sNrHz-izFailed: gpart resize -i %s %s)r rXrgr rhrir;r`)r?rErFrGrnrjr+r+r,rHs$     zResizeGpart.resizeNror+r+r+r,ryrpryc Cs8t|tj}zt|dtjWt|St|w)Nr)rSopenO_RDONLYlseekSEEK_ENDclose)filenamefdr+r+r,r`sr`c Cstj|}tj|}d|}tr+dt|}td|}|r+|d|dfStj |s9t d||ftj |d}tj |sLt d|t |}tj|}tj|} t tj | d} tjd | } | |fS) Nz/sys/class/block/%s/dev/z/^(?P/dev/.+)[sp](?P\d+[a-z]*)$dev part_slicez%s had no syspath (%s) partitionz%s not a partitionz /dev/block/%s)rSrcrealpathbasenamer is_BSDfind_freebsd_partrVrWrer0rdr1 load_filerstripdirname) devpathrpathbnamesyspathfpartmptpathptnumrsyspath disksyspath diskmajmin diskdevpathr+r+r,device_part_info&s*       rcCsr|dr|St|}|std|d}t}|dkr7|s7tt}|dur7tj |r3|Std|S)Nrz,Could not determine device of '%s' % dev_entrz /dev/rootz!Unable to find device '/dev/root') startswithr get_mount_infor0 is_containerrootdev_from_cmdline get_cmdlinerSrcre)deventresultr containerr+r+r, devent2devQs    rcCs,tj|}|drtd|||SdS)aReturns underlying block device for a mapped device. If it is mapped, blockdev will usually take the form of /dev/mapper/some_name If blockdev is a symlink pointing to a /dev/dm-* device, return the device pointed to. Otherwise, return None. z/dev/dm-z$%s is a mapped device pointing to %sN)rSrcrrridebug)blockdevrr+r+r,get_mapped_devicehs rrAc Cstds tddSz tdd|gWn'tjy=}z|jdkr+td|ntd|jWYd}~dSd}~wwttjtdd |gtd | Wdd S1s^wYdS) z Check if a device is an encrypted device. blockdev should have a /dev/dm-* path whereas partition is something like /dev/sda1. cryptsetupz6cryptsetup not found. Assuming no encrypted partitionsFstatusz#Determined that %s is not encryptedzZReceived unexpected exit code %s from cryptsetup status. Assuming no encrypted partitions.NisLukszDetermined that %s is encryptedT)r whichrirrXrgwarningr)rrrnr+r+r, is_encryptedxs*      rc Csddd|g}t|d}|dstd|zd|dd d dWStyA}z td |d |d |d}~ww)Ndmsetupdepsz--options=devnamerz1 dependz5Expecting '1 dependencies' from 'dmsetup'. Received: rz: (r_)zRan `z$`, but received unexpected stdout: ``)r r RuntimeErrorsplit IndexError)rcommanddeprnr+r+r,get_underlying_partitions   rcCsts tjdfSz(t }t|}Wdn1swY|d}t|}|d}Wnt yB}zt d|d}~wwzKt j dddd |g|d Wzt dd d |t |gWnt j yx}z td |WYd}~nd}~wwztWnMt yttdYn?wzt dd d |t |gWnt j y}z td |WYd}~nd}~wwztWwt yttdYwwtjd|dfS)zUse 'cryptsetup resize' to resize LUKS volume. The loaded keyfile is json formatted with 'key' and 'slot' keys. key is base64 encoded. Example: {"key":"XFmCwX2FHIQp0LBWaLEMiHIyfxt1SGm16VvUAVledlY=","slot":5} zNo encryption keyfile foundNkeyslotzZCould not load encryption key. This is expected if the volume has been previously resized.rz --key-file-rH)data luksKillSlotz --batch-modez sz"resize_devices..zResizing mapped device (z!) skipped as it is not encrypted.zResizing encrypted device (z ) failed: zdevice_part_info(%s) failed: %szno change necessary (%s, %s)zchanged (%s, %s) from %s to %sz'failed to resize: disk=%s, ptnum=%s: %s)rUpoprr0appendr#r$rSstatOSErrorS_ISBLKst_modeS_ISCHRrrrinsertrrr'rr1rHr&r%r;)r4r!inforrrnstatretunderlying_blockdevrrmessagediskroldnewr+r+r,resize_devicess                    {rrcfgcloudargsc Csd|vrtdtt|d<|d}t|tstddS|dd}t|r>|dkr6tj ddd d td |dSt|d d rYt j drYtdtddSt |ddg}t|sltddSz t||j|d}Wn"ttfy}ztd|||dkr|WYd}~dSd}~wwtjtjdt||fd} | D]\} } } | tjkrtd| | qtd| | | qdS)NrOz.No 'growpart' entry in cfg. Using default: %sz#'growpart' in config was not a dictr roffz)Growpart's 'mode' key with value '{mode}'z22.2zUse 'off' instead.) deprecateddeprecated_version extra_messagezgrowpart disabled: mode=%sr"Fz/etc/growroot-disabledz0growpart disabled: /etc/growroot-disabled existsz&use ignore_growroot_disabled to ignorer!rzgrowpart: empty device list)r-r!z,growpart unable to find resizer for '%s': %sr)logfuncmsgfuncrz'%s' resized: %sz '%s' %s: %s)rirDEFAULT_CONFIGget isinstancedictrr is_false deprecaterSrcrrget_cfg_option_listlenr:r-r0r1log_timerr#r%r) rrrrmycfgr r!r4rnresizedentryrurr+r+r,handle^s`           rrOrtrz)CrxrrUrrSos.pathrVrabcrr contextlibrpathlibrtextwraprtypingr cloudinitrloggingr r r cloudinit.cloudr cloudinit.configr cloudinit.config.schemarrcloudinit.distrosrrcloudinit.settingsrMODULE_DESCRIPTIONrr__annotations__rrr# getLoggerr(rirrIr:rr;r<rLrqryr`rrrrJrrrrrr.r+r+r+r,s        &  3'+78