o w7e9@sddlZddlZddlZddlmZddlmZmZmZe e Z dZ gdZ GdddejZdd Zd d Zd d Zdde ddfddZddZGdddeZGdddeZeejejffgZddZe dkrtddZedSdS)N)log)sources url_helperutilz 2012-03-01))meta-data/instance-idrFF)meta-data/local-hostnamerFF)meta-data/public-keysrFT)zmeta-data/vendor-data vendor-dataTT) user-datar TTc@s`eZdZdZdZdZdZddZeddZ dd Z d d Z d d Z ddZ ddZddZdS)DataSourceMAASz DataSourceMAAS reads instance information from MAAS. Given a config metadata_url, and oauth tokens, it expects to find files under the root named: instance-id user-data hostname vendor-data MAASNcCs:tj||||d|_tj|jd|_t|j |_ dS)Nmaas) r DataSource__init__base_urlospathjoinseed_dirget_id_from_ds_cfgds_cfgid_hash)selfsys_cfgdistropathsrB/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceMAAS.pyr,szDataSourceMAAS.__init__cCs|js t|j|_|jSN) _oauth_helperget_oauth_helperrrrrr oauth_helper2s zDataSourceMAAS.oauth_helpercCstj|}d||jfS)Nz%s [%s])rr__str__r)rrootrrrr#8s zDataSourceMAAS.__str__c Cs|j}z ||jt|jWdStyYnty-}z td|j|d}~ww|dd}|s8dSz| |sAWdS||t ||j j |j ddWdStycttd|YdSw)NTz%s was malformed: %s metadata_urlF)read_file_or_urlrretriesz$Failed fetching metadata from url %s)r _set_datarread_maas_seed_dirMAASSeedDirNoneMAASSeedDirMalformedLOGwarninggetwait_for_metadata_serviceread_maas_seed_urlr"readurlr Exceptionrlogexc)rmcfgexcurlrrr _get_data<s>    zDataSourceMAAS._get_datac Csv||_|\}}}||_||_||_|r9z t||_WdSty8}zt d|d|_WYd}~dSd}~wwdS)Nz"Invalid content in vendor-data: %s) r userdata_rawmetadatavendordata_purerconvert_vendordatavendordata_raw ValueErrorr-r.)rr7dataudmdvderrrr)cs  zDataSourceMAAS._set_datacCs d|jS)z/Return the subplatform metadata source details.z seed-dir (%s))rr!rrr_get_subplatformqs zDataSourceMAAS._get_subplatformc Cs |j}d}z t|d|}Wntyttd|Ynw|dkr&dSd}z||vr5t|d|}WntyEtd|Ynwt}| d rU|dd }d |t f}|g}|j j |||d \}}|rut d |t|Std|tt|t|S)Nxmax_waitz Failed to get max wait. using %srF2timeoutzFailed to get timeout, using %s/z%s/%s/meta-data/instance-id)urlsrFrHzUsing metadata source: '%s'z(Giving up on md from %s after %i seconds)rintr/r3rr4r-r.timeendswith MD_VERSIONr" wait_for_urldebugcriticalbool) rr7r5rFrH starttime check_urlrK _responserrrr0usD       z(DataSourceMAAS.wait_for_metadata_servicecCs0|jdurdSt|d|jfi}|jt|kS)alocally check if the current system is the same instance. MAAS doesn't provide a real instance-id, and if it did, it is still only available over the network. We need to check based only on local resources. So compute a hash based on Oauth tokens.NF datasource)rrget_cfg_by_pathdsnamer)rrncfgrrrcheck_instance_ids z DataSourceMAAS.check_instance_id)__name__ __module__ __qualname____doc__rYrrrpropertyr"r#r8r)rDr0r[rrrrr s  ' &r cs*d}tfdd|D}tjdi|S)zReturn an oauth helper instance for values in cfg. @raises ValueError from OauthUrlHelper if some required fields have true-ish values but others do not.) consumer_keyconsumer_secret token_key token_secretcsg|] }||fqSrr/).0rcfgrr sz$get_oauth_helper..Nr)dictrOauthUrlHelper)rikeyskwargsrrhrr sr cs4d}dfdd|D}dt|dS)z;Given a config, generate a unique identifier for this node.)rarcrdcsg|]}|dqS)re)rffrrrrjsz&get_id_from_ds_cfg..zv1:zutf-8)rhashlibsha256encode hexdigest)rfieldsidstrrrrrrsrcCsL|dr |dd}tj|rtt|dkrtdtd|ddS)Nfile://rz%s: not a directoryz file://%s)version) startswithrrisdirlenlistdirr+r1)seed_drrrr*s  r*c Cs|durtj}|dr|dd}i}tD]n\}}} } |dur'd||f} nd|||f} z,t|} || ||| d} | rQ| rH| j||<nt| j||<nt d| | j Wqtj y}z|j dkrs| sst d ||f||j dkrz|WYd}~qd}~wwt||S) a Read the maas datasource at seed_url. read_file_or_url is a method that should provide an interface like util.read_file_or_url Expected format of seed_url is are the following files: * //meta-data/instance-id * //meta-data/local-hostname * //user-data If version is None, then / will not be used. NrIrJz%s/%sz%s/%s/%s)r(rH ssl_detailsz4Fetching from %s resulted in an invalid http code %sizMissing required %s: %s)rr'rN DS_FIELDSrfetch_ssl_detailsokcontents decode_binaryr-r.codeUrlErrorr,check_seed_contents)seed_urlr'rHr{rr(rAr _dictnamebinaryoptionalr7rresprCrrrr1sJ        r1c Csi}g}tD]5\}}}}||vr|s||qd|vr5|d\}} } ||vr,i||<||||| <q||||<qt|dkrHtd||rRtd||fd} |drot} tj |d| td} | | urotd|d |d | fS) zValidate if dictionary content valid as a return for a datasource. Either return a (userdata, metadata, vendordata) tuple or Raise MAASSeedDirMalformed or MAASSeedDirNone rIrz%s: no data files foundz%s: missing files %sNr )defaultallowedz%vendor-data was not loadable as yaml.r meta-data) rappend partitionr~r+r,r/objectr load_yaml) contentseedretmissingspathdpath_binaryrtop_pvd_dataerrrrrrs4     rc@ eZdZdS)r+Nr\r]r^rrrrr+%r+c@r)r,Nrrrrrr,)rr,cCs t|tSr)rlist_from_depends datasources)dependsrrrget_datasource_list4s r__main__csddl}ddl}ddl}|jdd}|jddddd|jd d d dd|jd d d dd|jddddd|jddddd|jdddtd|jddd}dD]\}}|j||d}|jdddddqQ|}|j |j |j |j d } |j durd!D] } d"| d#} tj| rt| tjr|jd$| | |_ q||j rt|j } d%| vr| d%d&} | D]} | | vr| | dur| | | | <q|jdurd'| vr| d'|_|jdur|jd(|d)t| fd*d+fd,d-fd.d/|jd0krc|jd1|jj}|jdd2ks|jd3r't|j\}}}n t|j|j |d4d5\}}}t!d6t!|dur@d7n|"t!d8||t!d9||dur^d7dS|dS|jd:krp|jdS|jd;kr|j#d2sd<|j|_|jdSdS)=z Call with single argument of directory or http or https url. If url is given additional arguments are allowed, which will be interpreted as consumer_key, token_key, token_secret, consumer_secret rNzInteract with MAAS DS) descriptionz--configfilezspecify DS config file)metavarhelprz--ckeykeyzthe consumer key to auth withz--tkeyzthe token key to auth withz--csecsecretzthe consumer secret (likely '')rpz--tseczthe token secret to auth withz--apiverr{z the apiver to use ( can be used) subcommandssubcmd)titledest))crawlzcrawl the datasource)r/zdo a single GET of provided url) check-seedzread and verify seed at url)rr7zthe datasource url?)rnargsr)rarcrdrb)91_kernel_cmdline_url 90_dpkg_maasz/etc/cloud/cloud.cfg.d/z.cfgzUsed config in %s. rWr r%z)Must provide a url or a config with url. r&csj|ddjS)Nr&)r()r2rr7)r"rrgeturlszmain..geturlcstd||fdS)Nz == %s == %s )printdecoder)rrrprinturlszmain..printurlcsv|dr5|D]%}|drd||fq |dkr*d|dfq d||fq dS|dS)NrIz%s%srz meta-data/)rNr splitlines)r7line)rrrrrrs   zmain..crawlrzChecking seed at %s rIry)r{r'r(z=== user-data ===zN/Az=== meta-data ===z=== vendor-data ===r/rz%s/)$argparsepprintsysArgumentParser add_argumentrOadd_subparsers add_parser parse_argsckeytkeytseccsecconfigrrexistsaccessR_OKstderrwriter read_confrmr7exitr rr2r|r*r1apiverrrrN)rrrparsersubcmdsnamerrargscredsfnamefpathrirr2userdatar:rBr)rrr"rrmain:s                 "   r)rsrrM cloudinitrloggingrrr getLoggerr\r-rOrrr r rr*r1rr3r+r,DEP_FILESYSTEM DEP_NETWORKrrrrrrrs>        :'