vKgISrSSKrSSKrSSKJr SSKJrJrJr SSK J r J r SSK J r S\0r\(a SSKJr \\S '\R$"\5rS r"S S 5rSS jr"SS5r"SS5rg)a Module for loading various model files. This module provides the classes that are used to load models used by botocore. This can include: * Service models (e.g. the model for EC2, S3, DynamoDB, etc.) * Service model extras which customize the service models * Other models associated with a service (pagination, waiters) * Non service-specific config (Endpoint data, retry config) Loading a module is broken down into several steps: * Determining the path to load * Search the data_path for files to load * The mechanics of loading the file * Searching for extras and applying them to the loaded file The last item is used so that other faster loading mechanism besides the default JSON loader can be used. The Search Path =============== Similar to how the PATH environment variable is to finding executables and the PYTHONPATH environment variable is to finding python modules to import, the botocore loaders have the concept of a data path exposed through AWS_DATA_PATH. This enables end users to provide additional search paths where we will attempt to load models outside of the models we ship with botocore. When you create a ``Loader``, there are two paths automatically added to the model search path: * /data/ * ~/.aws/models The first value is the path where all the model files shipped with botocore are located. The second path is so that users can just drop new model files in ``~/.aws/models`` without having to mess around with the AWS_DATA_PATH. The AWS_DATA_PATH using the platform specific path separator to separate entries (typically ``:`` on linux and ``;`` on windows). Directory Layout ================ The Loader expects a particular directory layout. In order for any directory specified in AWS_DATA_PATH to be considered, it must have this structure for service models:: | |-- servicename1 | |-- 2012-10-25 | |-- service-2.json |-- ec2 | |-- 2014-01-01 | | |-- paginators-1.json | | |-- service-2.json | | |-- waiters-2.json | |-- 2015-03-01 | |-- paginators-1.json | |-- service-2.json | |-- waiters-2.json | |-- service-2.sdk-extras.json That is: * The root directory contains sub directories that are the name of the services. * Within each service directory, there's a sub directory for each available API version. * Within each API version, there are model specific files, including (but not limited to): service-2.json, waiters-2.json, paginators-1.json The ``-1`` and ``-2`` suffix at the end of the model files denote which version schema is used within the model. Even though this information is available in the ``version`` key within the model, this version is also part of the filename so that code does not need to load the JSON model in order to determine which version to use. The ``sdk-extras`` and similar files represent extra data that needs to be applied to the model after it is loaded. Data in these files might represent information that doesn't quite fit in the original models, but is still needed for the sdk. For instance, additional operation parameters might be added here which don't represent the actual service api. N) BOTOCORE_ROOT)HAS_GZIP OrderedDictjson)DataNotFoundErrorUnknownServiceError deep_mergez.json)openz.json.gzc^U4SjnU$)zCache the result of a method on a per instance basis. This is not a general purpose caching decorator. In order for this to be used, it must be used on methods on an instance, and that instance *must* provide a ``self._cache`` dictionary. c>TR4U-n[UR55HnX4- nM X0R;aURU$T"U/UQ70UD6nXPRU'U$N)__name__sorteditems_cache)selfargskwargskeypairdatafuncs P/var/www/highfloat_scraper/venv/lib/python3.13/site-packages/botocore/loaders.py_wrapper instance_cache.._wrappersn}}%6<<>*D KC+ ++ ;;s# #D*4*6* C )rrs` rinstance_cachers Orc*\rSrSrSrSrSrSrSrg)JSONFileLoaderz]Loader JSON files. This class can load the default format of models, which is a JSON file. cn[H+n[RRX-5(dM+ g g)zChecks if the file exists. :type file_path: str :param file_path: The full path to the file to load without the '.json' extension. :return: True if file path exists, False otherwise. TF)_JSON_OPEN_METHODSospathisfile)r file_pathexts rexistsJSONFileLoader.existss+&Cww~~io..&rc.[RRU5(dgU"US5nUR5R S5nSSS5 [ R SU5 [R"W[S9$!,(df  N==f)Nrbzutf-8zLoading JSON file: %s)object_pairs_hook) r%r&r'readdecodeloggerdebugrloadsr)r full_path open_methodfppayloads r _load_fileJSONFileLoader._load_fileslww~~i(( D )Rggi&&w/G*  ,i8zz'[AA * )s B Bct[R5H up#URX-U5nUcMUs $ g)zAttempt to load the file path. :type file_path: str :param file_path: The full path to the file to load without the '.json' extension. :return: The loaded data if it exists, otherwise None. N)r$rr8)rr(r)r5rs r load_fileJSONFileLoader.load_files<!3 8 8 : C??9?K@D !;rrN) r __module__ __qualname____firstlineno____doc__r*r8r;__static_attributes__rrrr!r!s  Brr!cUc [5$/nUR[R5nUHPn[RR [RR U55nURU5 MR [US9$)ahCreate a Loader class. This factory function creates a loader given a search string path. :type search_string_path: str :param search_string_path: The AWS_DATA_PATH value. A string of data path values separated by the ``os.path.pathsep`` value, which is typically ``:`` on POSIX platforms and ``;`` on windows. :return: A ``Loader`` instance. )extra_search_paths)Loadersplitr%pathsepr& expanduser expandvarsappend)search_path_stringpaths extra_pathsr&s r create_loaderrMsp!x E$**2::6Kww!!"''"4"4T":; T U ++rcj\rSrSrSr\r\RR\ S5r \RR\RRS5SS5r S/rSS jr\S 5r\S 5r\S 5r\S 5r\S5r\SSj5rSr\S5rSrSSjrSrSrg)rDzFind and load data models. This class will handle searching for and loading data models. The main method used here is ``load_service_model``, which is a convenience method over ``load_data`` and ``determine_latest_version``. r~z.awsmodelssdkNcZ0UlUcUR5nX lUbXlO/UlU(a1URR UR UR /5 /UlU(a%URR UR5 [5Ul gr) rFILE_LOADER_CLASS file_loader _search_pathsextendCUSTOMER_DATA_PATHBUILTIN_DATA_PATH _extras_typesBUILTIN_EXTRAS_TYPESExtrasProcessor_extras_processor)rrCrUcacheinclude_default_search_pathsinclude_default_extrass r__init__Loader.__init__s  002K&  )!3 !#D  '    % %(($*@*@A   !    % %d&?&? @!0!2rcUR$r)rVrs r search_pathsLoader.search_paths!!!rcUR$r)rZrds r extras_typesLoader.extras_typesrgrc n[5nUR5GHn[R"U5Vs/sHHn[RR [RR X455(dMFUPMJ nnUHn[RR X65n[R"U5nUHWn [RR XyU5n URRU 5(dMEURU5 M M GM [U5$s snf)aList all known services. This will traverse the search path and look for all known services. :type type_name: str :param type_name: The type of the service (service-2, paginators-1, waiters-2, etc). This is needed because the list of available services depends on the service type. For example, the latest API version available for a resource-1.json file may not be the latest API version available for a services-2.json file. :return: A list of all services. The list of services will be sorted. ) set_potential_locationsr%listdirr&isdirjoinrUr*addr) r type_nameservices possible_pathdpossible_services service_name full_dirname api_versions api_versionfull_load_paths rlist_available_servicesLoader.list_available_servicess&5!668MM2!2A77==m!?@2 ! !2 !ww||MH !zz,7 #/K%'WW\\$9&N''..~>> \2 $0!29*h!s AD2?D2c6[URX55$)aFind the latest API version available for a service. :type service_name: str :param service_name: The name of the service. :type type_name: str :param type_name: The type of the service (service-2, paginators-1, waiters-2, etc). This is needed because the latest API version available can depend on the service type. For example, the latest API version available for a resource-1.json file may not be the latest API version available for a services-2.json file. :rtype: str :return: The latest API version. If the service does not exist or does not have any available API data, then a ``DataNotFoundError`` exception will be raised. )maxlist_api_versions)rrwrrs rdetermine_latest_versionLoader.determine_latest_versionBs*4)),BCCrc\[5nURUSSS9Hsn[R"U5HVn[RR XEU5nUR RU5(dMEURU5 MX Mu U(d [US9e[U5$)a9List all API versions available for a particular service type :type service_name: str :param service_name: The name of the service :type type_name: str :param type_name: The type name for the service (i.e service-2, paginators-1, etc.) :rtype: list :return: A list of API version strings in sorted order. T) must_existis_dir data_path) rlrmr%rnr&rprUr*rqrr)rrwrrknown_api_versionsrtdirnamer4s rrLoader.list_api_versionsYs!U!66 T$7 M::m4GGLLK ##**955&**73 5 "#l; ;())rcZURU5nX;a"[USR[U55S9eUcUR X5n[ R RXU5nURU5nURXU5nURRXg5 U$)aLoad a botocore service model This is the main method for loading botocore models (e.g. a service model, pagination configs, waiter configs, etc.). :type service_name: str :param service_name: The name of the service (e.g ``ec2``, ``s3``). :type type_name: str :param type_name: The model type. Valid types include, but are not limited to: ``service-2``, ``paginators-1``, ``waiters-2``. :type api_version: str :param api_version: The API version to load. If this is not provided, then the latest API version will be used. :type load_extras: bool :param load_extras: Whether or not to load the tool extras which contain additional data to be added to the model. :raises: UnknownServiceError if there is no known service with the provided service_name. :raises: DataNotFoundError if no data could be found for the service_name/type_name/api_version. :return: The loaded data, as a python type (e.g. dict, list, etc). z, )rwknown_service_names) r|rrprrr%r& load_data _find_extrasr]process)rrwrrrzknown_servicesr4model extras_datas rload_service_modelLoader.load_service_modelws@55i@  -%)$(IIf^.D$E   77KGGLLIF y)'' M  &&u: rc## URH?nUSUS3n[RRXU5nUR U5v MA g![ a MQf=f7f)z-Creates an iterator over all the extras data..z-extrasN)rir%r&rprr)rrwrrrz extras_type extras_namer4s rrLoader._find_extrassb,,K&Kq W=K \ LI nnY// - %  s(8A$AA$ A!A$ A!!A$cURU5H&nURRU5nUcM#X24s $ [US9e)a:Same as ``load_data`` but returns file path as second return value. :type name: str :param name: The data path, i.e ``ec2/2015-03-01/service-2``. :return: Tuple of the loaded data and the path to the data file where the data was loaded from. If no data could be found then a DataNotFoundError is raised. r)rmrUr;r)rnamertfounds rload_data_with_pathLoader.load_data_with_pathsK"66tr?r@r!rTr%r&rprrYrGrXr[rapropertyrerirr|rrrrrrrmrrArrrrDrDs' ]F; 3"7 %)# 36""""( ( TDD,**:00d 00$&( 7rrDc$\rSrSrSrSrSrSrg)r\iz5Processes data from extras files into service models.c8UHnURX5 M g)zProcesses data from a list of loaded extras files into a model :type original_model: dict :param original_model: The service model to load all the extras into. :type extra_models: iterable of dict :param extra_models: A list of loaded extras models. N)_process)roriginal_model extra_modelsextrass rrExtrasProcessor.processs#F MM. 1#rc.SU;a[XS5 gg)z3Process a single extras model into a service model.mergeNr )rr extra_models rrExtrasProcessor._process s k ! u'2 3 "rrN)rr=r>r?r@rrrArrrr\r\s? 24rr\r)r@loggingr%botocorerbotocore.compatrrrbotocore.exceptionsrrbotocore.utilsr r r$gzip gzip_open getLoggerrr1rr!rMrDr\rrrrsZx "77F% T  &%.z"   8 $.00f,0W7W7t44r