o w7e=@s:ddlZddlZddlZddlZddlmZddlZddlmZddl m Z ddl m Z ddl mZddl mZddl mZmZmZmZdd lmZmZdd lmZdd lmZmZdd lmZdd lm Z e!e"Z#ddgZ$dZ%dZ&dZ'Gdddej(j)Z*ddZ+ddZ,Gdddej-Z.e.ej/ffgZ0ddZ1dS)N)urlparse)ConnectionError)HTTPConnection) PoolManager)dmi)log)netsources url_helperutil) EventScope EventType)NoDHCPLeaseError)EphemeralDHCPv4EphemeralIPv6Network)DataSourceHostname)ProcessExecutionErrorzhttp://169.254.42.42zhttp://[fd00:42::42] cs*eZdZdZfddZdddZZS)SourceAddressAdapterzF Adapter for requests to choose the local address to bind to. c s ||_tt|jdi|dS)N)source_addresssuperr__init__)selfrkwargs __class__rF/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceScaleway.pyr,szSourceAddressAdapter.__init__FcCs0tjtjtjdfg}t||||j|d|_dS)N) num_poolsmaxsizeblockrsocket_options)rdefault_socket_optionssocket SOL_SOCKET SO_REUSEPORTrr poolmanager)r connectionsr"r#r$rrrinit_poolmanager0s  z%SourceAddressAdapter.init_poolmanager)F)__name__ __module__ __qualname____doc__rr+ __classcell__rrrrr's rc Cs^ztj|d|d|ddd}t|jWStjy.}z |jdkr)WYd}~dSd}~ww)aQ Retrieve user data or vendor data. Scaleway user/vendor data API returns HTTP/404 if user/vendor data is not set. This function calls `url_helper.readurl` but instead of considering HTTP/404 as an error that requires a retry, it considers it as empty user/vendor data. Also, be aware the user data/vendor API requires the source port to be below 1024 to ensure the client is root (since non-root users can't bind ports below 1024). If requests raises ConnectionError (EADDRINUSE), the caller should retry to call this function on an other port. NrcSs|jdko t|jtjj S)N)code isinstancecauserequests exceptionsr)_excrrrXs z%query_data_api_once..)datatimeoutretriessession exception_cbr1)r readurlr decode_binarycontentsUrlErrorr2) api_addressr;requests_sessionrespr8rrrquery_data_api_once=s  rFc Cstdt|dD]}z]td||t}d}z)t|j}|}|ddkr,|dd}tj |dtj d dd} | tj kr@d }Wn t yJYnw| d t||fd t|||d } td|| WStjy} ztd|| td| } WYd} ~ qd} ~ ww| )a/Get user or vendor data. Handle the retrying logic in case the source port is used. Scaleway metadata service requires the source port of the client to be a privileged port (<1024). This is done to ensure that only a privileged user on the system can access the metadata service. r rz*Trying to get %s data (bind on port %d)...z0.0.0.0r[Nprotoz0::zhttp://)r)r;rDz%s-data downloadedz%Error while trying to get %s data: %s)rangemaxLOGdebugr5Sessionrnetlocr& getaddrinfo IPPROTO_TCPAF_INET6 ValueErrormountrrFr rBwarningtimesleep) api_typerCr<r;portrD localhost url_addressaddress addr_protor:r8last_excrrrquery_data_apiesT           racseZdZdZejejejej hiZ fddZ ddZ ddZ edd Zd d Zd d ZeddZeddZddZddZdddZeddZeddZZS)DataSourceScalewayScalewaycstt||||tt|ddgig|_t|jdt |_ t|jdt |_ t|jdt |_d|_tj|_t|_d|_d|_d|_d|_d|jvr_|j|jd7_dSdS)N datasourcercr<r;max_waitT metadata_urls)rrbrr mergemanydictget_cfg_by_pathds_cfgintgetDEF_MD_RETRIESr<DEF_MD_TIMEOUTr;DEF_MD_MAX_WAITre_fallback_interfacer UNSET_network_config DS_BASE_URLSrf userdata_urlvendordata_urlephemeral_fixed_addresshas_ipv4keys)rsys_cfgdistropathsrrrrs$zDataSourceScaleway.__init__cCsxt}tj||j|jdd\}}|r-td||d|_|d|_|d|_ dStd|t t|t ) zO Define metadata_url based upon api-metadata URL availability. F)urlsrer;connect_synchronouslyz%s is reachablez/conf?format=jsonz/user_data/cloud-initz/vendor_data/cloud-initNz3Unable to reach api-metadata at %s after %s seconds) rXr wait_for_urlrer;rNrO metadata_urlrsrtrjr)rr{ start_time avail_urlr7rrr_set_metadata_urls&     z$DataSourceScaleway._set_metadata_urlcCsZtj|j|j|jd}tt|j |_ t d|j |j|j|_ t d|j|j|j|_dS)N)r;r<z user-dataz vendor-data)r r?r~r;r<jsonloadsr r@rAmetadatarars userdata_rawrtvendordata_raw)rrErrr_crawl_metadatas  z"DataSourceScaleway._crawl_metadatacCs>td}|dkr dStjdrdSt}d|vrdSdS)a  There are three ways to detect if you are on Scaleway: * check DMI data: not yet implemented by Scaleway, but the check is made to be future-proof. * the initrd created the file /var/run/scaleway. * "scaleway" is in the kernel cmdline. zsystem-manufacturerrcTz/var/run/scalewayscalewayN)r read_dmi_dataospathexistsr get_cmdline) vendor_namecmdlinerrr ds_detects  zDataSourceScaleway.ds_detectcCs|dvr td|gSg}|D]>}t|j}|ddkr#|dd}tj|dtjddd}|tjkr?|dkr?||g7}q|tjkrN|d krN||g7}qq|S) N)ipv4ipv6zInvalid IP version : %srrGr rHrIrr) rNrOrrQr&rRrSAF_INETrT)rrJr{ filtered_urlsurlr^r_rrr_set_urls_on_ip_versions.      z*DataSourceScaleway._set_urls_on_ip_versionc Cs`|jdur t|_|jrhz:t|j|j)}tjtj d|j |j fdtjtj d|j d|d|_ d|jd<Wdn1sAwYWn tttfyg}zttt|d|_WYd}~nd}~ww|jsz8t|j|j&tjtj d |j |j fdtjtj d|j dd |jd<WdWd S1swYWd StyYdSwd S) Nz3Set api-metadata URL depending on IPv4 availability)logfuncmsgfuncargszCrawl of metadata service)rrrz fixed-addressr net_in_useFz3Set api-metadata URL depending on IPv6 availabilityrT)rorfind_fallback_nicrvrryr log_timerNrOrrfrrurrrrlogexcstrr)rrerrr _get_data sv         zDataSourceScaleway._get_datac Cs|jdurtdtjtj|_|jtjkr|jS|jdur#t|_|jdduri}i}|jdD]_}|d|j krId|d<dd d g|d <q3d | vrb|d |dd |df7<n|dd |df|d <|ddkr|ddd}d | vr|d |g7<q3|g|d <q3|||j<d|d|_nAdd|jd}ddig}|jdr|dd|jddd|jddddd|jdddgdg7}||d <d!|gd"|_t d#|j|jS)$z` Configure networking according to data received from the metadata API. Nz5Found None as cached _network_config. Resetting to %s private_ip public_ipsr^Tdhcp4z169.254.42.42/32z 62.210.0.1)toviaroutes addresses/netmaskfamilyinet6gatewayz::/0)rrr)version ethernetsphysicalz%s)typenamerrstaticz::0)networkprefixr)rr^rrsubnetsr )rconfigznetwork_config : %s) rqrNrWr rprorrrrurwrO)rnetcfgip_cfgiprouterrrrnetwork_configNsl             z!DataSourceScaleway.network_configcCdSNrrrrr launch_indexzDataSourceScaleway.launch_indexcCs |jdS)Nid)rrrrrget_instance_ids z"DataSourceScaleway.get_instance_idcCs^dd|jdD}d}t|}|jdgD]}||sq|||dddq|S)NcSsg|]}|dqS)keyr).0rrrr sz:DataSourceScaleway.get_public_ssh_keys..ssh_public_keyszAUTHORIZED_KEY=tagsr7 )rlenrk startswithappendreplace)rssh_keysakeypreplentagrrrget_public_ssh_keyss z&DataSourceScaleway.get_public_ssh_keysFcCst|jddS)NhostnameF)rr)rfqdn resolve_ip metadata_onlyrrr get_hostnameszDataSourceScaleway.get_hostnamecCrrrrrrravailability_zonerz$DataSourceScaleway.availability_zonecCrrrrrrrregionrzDataSourceScaleway.region)FFF)r,r-r.dsnamer NETWORKr BOOT_NEW_INSTANCEBOOT BOOT_LEGACYdefault_update_eventsrrr staticmethodrrrpropertyrrrrrrrr0rrrrrbs4  A L   rbcCs t|tSr)r list_from_depends datasources)dependsrrrget_datasource_lists r)2rrr&rX urllib.parserr5requests.exceptionsrurllib3.connectionrurllib3.poolmanagerr cloudinitrrloggingrr r r cloudinit.eventr r cloudinit.net.dhcprcloudinit.net.ephemeralrrcloudinit.sourcesrcloudinit.subpr getLoggerr,rNrrrlrnrmadapters HTTPAdapterrrFra DataSourcerbDEP_FILESYSTEMrrrrrrs>          (4 $