o w7er'@sdZddlZddlZddlZddlZddlZddlmZddlmZddl m Z ddl m Z ddl mZddlmZmZdd lmZdd lmZmZmZmZd d gZd ZGddde ZeddeddeddgZeddeddeddeddedded d!ed"d#ed$d%ed&d'ed(d)ed*d)ed+d,g Zd-efd.d/Zd-efd0d1Z dHd2d3Z!d4d5Z"d6d7Z#d8d9Z$d:d;Z%dd?Z'dId@e(fdAdBZ)dCdDZ*dEdFZ+e,dGkre-e+dSdS)JzGDefine 'collect-logs' utility and handler to include in cloud-init cmd.N)datetime)Path) NamedTuple)read_cfg_paths)Paths)ProcessExecutionErrorsubp)tempdir)chdircopy ensure_dir write_filez/var/log/cloud-init.logz/var/log/cloud-init-output.logz/run/cloud-initc@seZdZUeed<eed<dS) ApportFilepathlabelN)__name__ __module__ __qualname__str__annotations__rr:/usr/lib/python3/dist-packages/cloudinit/cmd/devel/logs.pyrs  rz(/var/log/installer/autoinstall-user-dataAutoInstallUserDataz/autoinstall.yamlAutoInstallYAMLz'/etc/cloud/cloud.cfg.d/99-installer.cfgInstallerCloudCfgz//var/log/installer/ubuntu_desktop_installer.logUdiLogz-/var/log/installer/subiquity-server-debug.logSubiquityServerDebugz-/var/log/installer/subiquity-client-debug.logSubiquityClientDebugz%/var/log/installer/curtin-install.log CurtinLogz0/var/log/installer/subiquity-curtin-install.confCurtinInstallConfigz8/var/log/installer/curtin-install/subiquity-initial.confCurtinConfigInitialz:/var/log/installer/curtin-install/subiquity-curthooks.confCurtinConfigCurtHooksz8/var/log/installer/curtin-install/subiquity-extract.confCurtinConfigExtractz=/var/log/installer/curtin-install/subiquity-partitioning.confCurtinConfigPartitioningz(/var/log/installer/curtin-error-logs.tar CurtinErrorz$/var/log/installer/curtin-errors.tarz(/var/log/installer/block/probe-data.json ProbeDatareturncCt}|dS)N userdata_raw)r get_ipath_curpathsrrr_get_user_data_fileN r,cCr')Ndata)r get_cpathr*rrr_get_cloud_data_pathSr-r0c Cs`|s tjddd}|jdddddd d |jd d d ddt}|jdddddd|d|S)a2Build or extend and arg parser for collect-logs utility. @param parser: Optional existing ArgumentParser instance representing the collect-logs subcommand which will be extended to support the args of this utility. @returns: ArgumentParser with proper argument configuration. collect-logsz)Collect and tar all cloud-init debug info)prog descriptionz --verbosez-vcountr verbosityzBe more verbose.)actiondefaultdesthelpz --tarfilez-tzcloud-init.tar.gzzOThe tarfile to create containing all collected logs. Default: cloud-init.tar.gz)r7r9z--include-userdataz-uF store_trueuserdatazPOptionally include user-data from {0} which could contain sensitive information.)r7r6r8r9)argparseArgumentParser add_argumentr,format)parseruser_data_filerrr get_parserXs<   rBcCs*dg}tdkr|tijd|S)z>Return a list of files to ignore for /run/cloud-init directoryzhook-hotplug-cmdrinstance_data_sensitive)osgetuidappendrlookups)curdirfiles ignored_filesrrr_copytree_rundir_ignore_filess  rKc Csttj|zt|j}Wn"ty1}zt|t|t d|d|WYd}~dSd}~wwt||t d|d||S)CHelper which runs a command and writes output or error to filename.collecting %s failed. N collected %s ) r rDrdirnamerstdoutrr r_debug)cmdfilenamemsgr5outputerrr_write_command_output_to_files rXc Csttj|zt|d}tj|||dWdn1s!wYWn"tyI}zt|t |t d|d|WYd}~dSd}~wwt d|d|dS)rLw)rQstderrNrMrNrO) r rDrrPopen subprocesscallOSErrorr rrR)rSrTrUr5frWrrr_stream_command_output_to_files r`cCs||kr tj|dSdSN)sysrZwrite)rUlevelr5rrrrRsrRcCs>tj|rt||td|d|dStd|d|dS)Nzcollected file: %s rNzfile %s did not exist )rDrisfiler rR)rout_dirr5rrr _collect_files  rhcCstD]}t||jj}|stt|t|jt||q|rBtD]}t||jj}|s8tt|t|jt||q$dSdS)z'Obtain subiquity logs and config files.N) INSTALLER_APPORT_FILESrrparentexistsr rrh INSTALLER_APPORT_SENSITIVE_FILES)log_dirinclude_userdatar5src_filedestination_dirrrrcollect_installer_logss  rqrnc Cs|rtdkrtjddStj|}t d}t dd}tj ||}t ddgtj |d d |d }t gd tj |d d|d }|sS|rQ|nd}td|td|d|tdgtj |dd|d tgdtj |dd|d tD]}t|||q|rt}t|||t|||tj |d} t| tjtrztjttj | dtdWn#tjy} ztjdtjt| dWYd} ~ nd} ~ wwtdtd|ntdtd|tjtj tdrtt} | rtt| t|t| t|t d d!||!|d"d#gWdn 1s0wYWdn 1s@wYtjd$|dS)%zCollect all cloud-init logs and tar them up into the provided tarfile. @param tarfile: The path of the tar-gzipped file to create. @param include_userdata: Boolean, true means include user-data. rzMTo include userdata, root user is required. Try sudo cloud-init collect-logs rNzcloud-init-logs-%Y-%m-%dz/tmp)dir cloud-initz --versionversionzcloud-init --version)rSrTrUr5)z dpkg-queryz--showz-f=${Version} rsz dpkg-versionz dpkg versionz not-availablez version: z!collected cloud-init version: %s dmesgz dmesg.txtz dmesg output) journalctlz--boot=0z-oz short-precisez journal.txtzsystemd journal of current bootrun)ignorez(Failed collecting file(s) due to error:  Nzcollected dir %s zdirectory '%s' did not exist disabledtarczvf/z Wrote %s )"rDrErbrZrcrabspathrutcnowdatestrftimer joinrXprintrRr`CLOUDINIT_LOGSrhr,rqr rkCLOUDINIT_RUN_DIRshutilcopytreerKErrorrrr0r rreplace) tarfilernr5rmtmp_dirrtdpkg_verlogrArun_dirrWcloud_data_dirrrr collect_logss                 CrcCst|j|j|jS)z:Handle calls to 'cloud-init collect-logs' as a subcommand.)rrr;r5)nameargsrrrhandle_collect_logs_argssrcCst}td|S)z4Tool to collect and tar all cloud-init related logs.r1)rBr parse_args)r@rrrmain"sr__main__ra)r).__doc__r<rDrr\rbrpathlibrtypingrcloudinit.cmd.develrcloudinit.helpersrcloudinit.subprrcloudinit.temp_utilsr cloudinit.utilr r r r rrrrlrirr,r0rBrKrXr`rRrhrqboolrrrrexitrrrrs       % .  U