vKg3O>SrSSKJr SSKJr SSKJr SrSrSr "SS \ 5r "S S \ 5r "S S \ 5r "SS\ 5r"SS\ 5r"SS\ 5r"SS5rS"Sjr"SS5r"SS5r"SS5r"SS5r"SS 5rg!)#zBinary Event Stream Decoding)crc32)unpack)EventStreamError iic\rSrSrSrSrg) ParserErrorz,Base binary flow encoding parsing exception.N)__name__ __module__ __qualname____firstlineno____doc____static_attributes__r T/var/www/highfloat_scraper/venv/lib/python3.13/site-packages/botocore/eventstream.pyrrs6rrc,^\rSrSrSrU4SjrSrU=r$)DuplicateHeader z$Duplicate header found in the event.c0>SUS3n[TU]U5 g)NzDuplicate header present: ""super__init__)selfheadermessage __class__s rrDuplicateHeader.__init__#s/xq9 !rr r r r rrrr __classcell__rs@rrr s.""rrc,^\rSrSrSrU4SjrSrU=r$)InvalidHeadersLength(z*Headers length is longer than the maximum.c<>SUS[3n[TU] U5 g)NzHeader length of  exceeded the maximum of )_MAX_HEADERS_LENGTHrrrlengthrrs rrInvalidHeadersLength.__init__+s%%fX-FGZF[\ !rr r r"s@rr$r$(4""rr$c,^\rSrSrSrU4SjrSrU=r$)InvalidPayloadLength0z*Payload length is longer than the maximum.c<>SUS[3n[TU] U5 g)NzPayload length of r')_MAX_PAYLOAD_LENGTHrrr)s rrInvalidPayloadLength.__init__3s%&vh.GH[G\] !rr r r"s@rr.r.0r,rr.c,^\rSrSrSrU4SjrSrU=r$)ChecksumMismatch8z8Calculated checksum did not match the expected checksum.c8>SUSSUS3n[TU]U5 g)NzChecksum mismatch: expected 0x08xz, calculated 0xr)rexpected calculatedrrs rrChecksumMismatch.__init__;s)28C.PZ[^O_` !rr r r"s@rr4r48sB""rr4c,^\rSrSrSrU4SjrSrU=r$)NoInitialResponseError@zAn event of type initial-response was not received. This exception is raised when the event stream produced no events or the first event in the stream was not of the initial-response type. c(>Sn[TU]U5 g)Nz0First event was not of the initial-response typer)rrrs rrNoInitialResponseError.__init__GsD !rr r r"s@rr<r<@s ""rr<c \rSrSrSrSrSrSrSrSr Sr S r S r \\\S .r \S 5r\S 5r\S5r\S5r\S5r\S5r\S5r\S5r\SSj5r\SSj5r\S5r\S5rSrg) DecodeUtilsLzUnpacking utility functions used in the decoder. All methods on this class take raw bytes and return a tuple containing the value parsed from the bytes and the number of bytes consumed to parse that value. z!Bz!Hz!Iz!bz!hz!iz!qz!III)cg)zThis method consumes none of the provided bytes and returns True. :type data: bytes :param data: The bytes to parse from. This is ignored in this method. :rtype: tuple :rtype: (bool, int) :returns: The tuple (True, 0) )Trr datas r unpack_trueDecodeUtils.unpack_truedsrcg)zThis method consumes none of the provided bytes and returns False. :type data: bytes :param data: The bytes to parse from. This is ignored in this method. :rtype: tuple :rtype: (bool, int) :returns: The tuple (False, 0) )Frr rGs r unpack_falseDecodeUtils.unpack_falseqsrcJ[[RUSS5SnUS4$)zParse an unsigned 8-bit integer from the bytes. :type data: bytes :param data: The bytes to parse from. :rtype: (int, int) :returns: A tuple containing the (parsed integer value, bytes consumed) NrCr)rrAUINT8_BYTE_FORMATrHvalues r unpack_uint8DecodeUtils.unpack_uint8~s*{44d2Ah?BaxrcJ[[RUSS5SnUS4$)zParse an unsigned 32-bit integer from the bytes. :type data: bytes :param data: The bytes to parse from. :rtype: (int, int) :returns: A tuple containing the (parsed integer value, bytes consumed) NrEr)rrAUINT32_BYTE_FORMATrPs r unpack_uint32DecodeUtils.unpack_uint32s*{55tBQx@CaxrcJ[[RUSS5SnUS4$)zParse a signed 8-bit integer from the bytes. :type data: bytes :param data: The bytes to parse from. :rtype: (int, int) :returns: A tuple containing the (parsed integer value, bytes consumed) NrCr)rrAINT8_BYTE_FORMATrPs r unpack_int8DecodeUtils.unpack_int8s*{33T"1X>qAaxrcJ[[RUSS5SnUS4$)zParse a signed 16-bit integer from the bytes. :type data: bytes :param data: The bytes to parse from. :rtype: tuple :rtype: (int, int) :returns: A tuple containing the (parsed integer value, bytes consumed) NrDr)rrAINT16_BYTE_FORMATrPs r unpack_int16DecodeUtils.unpack_int16*{44d2Ah?BaxrcJ[[RUSS5SnUS4$)zParse a signed 32-bit integer from the bytes. :type data: bytes :param data: The bytes to parse from. :rtype: tuple :rtype: (int, int) :returns: A tuple containing the (parsed integer value, bytes consumed) NrEr)rrAINT32_BYTE_FORMATrPs r unpack_int32DecodeUtils.unpack_int32r`rcJ[[RUSS5SnUS4$)zParse a signed 64-bit integer from the bytes. :type data: bytes :param data: The bytes to parse from. :rtype: tuple :rtype: (int, int) :returns: A tuple containing the (parsed integer value, bytes consumed) Nr)rrAINT64_BYTE_FORMATrPs r unpack_int64DecodeUtils.unpack_int64r`rc`[RUn[X SU5SnX1-nXUnXT4$)aCParse a variable length byte array from the bytes. The bytes are expected to be in the following format: [ length ][0 ... length bytes] where length is an unsigned integer represented in the smallest number of bytes to hold the maximum length of the array. :type data: bytes :param data: The bytes to parse from. :type length_byte_size: int :param length_byte_size: The byte size of the preceding integer that represents the length of the array. Supported values are 1, 2, and 4. :rtype: (bytes, int) :returns: A tuple containing the (parsed byte array, bytes consumed). Nr)rAUINT_BYTE_FORMATr)rHlength_byte_sizeuint_byte_formatr* bytes_end array_bytess runpack_byte_arrayDecodeUtils.unpack_byte_arraysJ&'778HI(/@0@*AB1E- I6 %%rcV[RX5up#URS5U4$)apParse a variable length utf-8 string from the bytes. The bytes are expected to be in the following format: [ length ][0 ... length bytes] where length is an unsigned integer represented in the smallest number of bytes to hold the maximum length of the array and the following bytes are a valid utf-8 string. :type data: bytes :param bytes: The bytes to parse from. :type length_byte_size: int :param length_byte_size: The byte size of the preceding integer that represents the length of the array. Supported values are 1, 2, and 4. :rtype: (str, int) :returns: A tuple containing the (utf-8 string, bytes consumed). zutf-8)rArpdecode)rHrlroconsumeds runpack_utf8_stringDecodeUtils.unpack_utf8_strings2(!, = = !  !!'*H44rcUSSS4$)zParse a 16-byte uuid from the bytes. :type data: bytes :param data: The bytes to parse from. :rtype: (bytes, int) :returns: A tuple containing the (uuid bytes, bytes consumed). Nr rGs r unpack_uuidDecodeUtils.unpack_uuidsCRy"}rcB[[RU5[4$)aMParse the prelude for an event stream message from the bytes. The prelude for an event stream message has the following format: [total_length][header_length][prelude_crc] where each field is an unsigned 32-bit integer. :rtype: ((int, int, int), int) :returns: A tuple of ((total_length, headers_length, prelude_crc), consumed) )rrAPRELUDE_BYTE_FORMAT_PRELUDE_LENGTHrGs runpack_preludeDecodeUtils.unpack_prelude s{66=OOrr N)rD)r r r rrrOUINT16_BYTE_FORMATrUrYr]rbrgr|rk staticmethodrIrLrRrVrZr^rcrhrpruryr~rr rrrArALs>                     &&0550   P PrrAc@[X5S-nX:wa [X5eg)Nl)rr4)rHchecksumcrccomputed_checksums r_validate_checksumrs*d(:5$x;;%rcN\rSrSrSrSr\S5r\S5r\S5r Sr g) MessagePreludei$z2Represents the prelude of an event stream message.c(XlX lX0lgN) total_lengthheaders_lengthr)rrrrs rrMessagePrelude.__init__'s(,rcHURUR- [- S- $)zCalculates the total payload length. The extra minus 4 bytes is for the message CRC. :rtype: int :returns: The total payload length. rE)rrr}rs rpayload_lengthMessagePrelude.payload_length,s%  4#6#66H1LLrc URS- $)zCalculates the byte offset for the end of the message payload. The extra minus 4 bytes is for the message CRC. :rtype: int :returns: The byte offset from the beginning of the event stream message to the end of the payload. rE)rrs r payload_endMessagePrelude.payload_end7s  1$$rc([UR-$)zCalculates the byte offset for the end of the message headers. :rtype: int :returns: The byte offset from the beginning of the event stream message to the end of the headers. )r}rrs r headers_endMessagePrelude.headers_endCs!4!444r)rrrN) r r r rrrpropertyrrrrr rrrr$sH< MM % %55rrc(\rSrSrSrSrSSjrSrg)EventStreamMessageiNz#Represents an event stream message.c4XlX lX0lX@lgr)preludeheaderspayloadr)rrrrrs rrEventStreamMessage.__init__Qs   rcURRS5nUS:XdUS:XaSnUURURS.$)Nz :message-typeerror exceptioni) status_coderbody)rgetr)rr message_types rto_response_dict#EventStreamMessage.to_response_dictWsE||''8 7 "lk&AK&||LL  r)rrrrN))r r r rrrrrr rrrrNs-  rrc *\rSrSrSr\R \R\R\R\R\R\R\R\R\RS. rSrSrSrSrSrS rS rS rS rg )EventStreamHeaderParseribzParses the event headers from an event stream message. Expects all of the header data upfront and creates a dictionary of headers to return. This object can be reused multiple times to parse the headers from multiple event stream messages. ) rrCrDrErf cSUlgr_datars rr EventStreamHeaderParser.__init__s  rc.XlUR5$)zParses the event stream headers from an event stream message. :type data: bytes :param data: The bytes that correspond to the headers section of an event stream message. :rtype: dict :returns: A dictionary of header key, value pairs. )r_parse_headersrrHs rparseEventStreamHeaderParser.parses ""$$rc0nUR(a9UR5up#X!;a [U5eX1U'UR(aM9U$r)r _parse_headerr)rrnamerQs rr&EventStreamHeaderParser._parse_headerssGjj,,.KD%d++!DM jjj rcHUR5nUR5nX4$r) _parse_name _parse_value)rrrQs rr%EventStreamHeaderParser._parse_headers&!!!#{rcl[RURS5upURU5 U$)NrC)rArur _advance_data)rrrts rr#EventStreamHeaderParser._parse_names-$77 AF 8$ rcj[RUR5upURU5 U$r)rArRrr)rtyperts r _parse_type#EventStreamHeaderParser._parse_types+$11$**= 8$ rcUR5nURUnU"UR5up4URU5 U$r)r_HEADER_TYPE_MAPrr)r header_typevalue_unpackerrQrts rr$EventStreamHeaderParser._parse_valuesC&&( ..{;(4 8$ rc,URUSUlgrr)rrts rr%EventStreamHeaderParser._advance_datasZZ * rrN)r r r rrrArIrLrZr^rcrhrpruryrrrrrrrrrrr rrrrbs  " "  # #  " "  # #  # #  # #  ( (  ) )  # #  " "). %   +rrcl\rSrSrSrSrSrSrSrSr Sr S r S r S r S rS rSrSrSrSrg)EventStreamBufferizStreaming based event stream buffer A buffer class that wraps bytes from an event stream providing parsed messages as they become available via an iterable interface. c>SUlSUl[5Ulg)Nr)r_preluder_header_parserrs rrEventStreamBuffer.__init__s  57rc.U=RU- slg)zoAdd data to the buffer. :type data: bytes :param data: The bytes to add to the buffer to be used when parsing Nrrs radd_dataEventStreamBuffer.add_datas d rcUR[:a[UR5eUR[:a[ UR5egr)rr(r$rr1r.)rrs r_validate_prelude#EventStreamBuffer._validate_preludesG  ! !$7 7&w'='=> >  ! !$7 7&w'='=> > 8rcURS[n[RU5up#[ U6n[ US[S- UR 5 URU5 U$NrE)rr}rAr~rrrr)r prelude_bytes raw_prelude_rs r_parse_prelude EventStreamBuffer._parse_preludes] #3O4 $33MB  +.=)>?Q+>?M w'rcUR[URRnURR U5$r)rr}rrrr)r header_bytess rr EventStreamBuffer._parse_headerss3zz/DMM4M4MN ""((66rcdURnURURURnU$r)rrrr)rr payload_bytess r_parse_payload EventStreamBuffer._parse_payloads--- 7#6#69L9LM rcURnURURURn[R U5up4U$r)rrrrrArV)rr crc_bytes message_crcrs r_parse_message_crc$EventStreamBuffer._parse_message_crcs?--JJw22W5I5IJ $229= rcZUR[S- URRnU$r)rr}rr)r message_bytess r_parse_message_bytes&EventStreamBuffer._parse_message_bytess, a $--";"; rcUR5nUR5n[X!URRS9 U$)N)r)rrrrr)rrrs r_validate_message_crc'EventStreamBuffer._validate_message_crcs8--/ 113 =4==;L;LMrcUR5nUR5nUR5n[URX#U5nUR 5 U$r)rrrrr_prepare_for_next_message)rrrrrs r_parse_message EventStreamBuffer._parse_messagesO((*%%'%%'$T]]GcJ &&(rcbURURRSUlSUlgr)rrrrs rr+EventStreamBuffer._prepare_for_next_messages&ZZ : : <=  rc"[UR5[:a [5eURcUR 5Ul[UR5URR :a [5eUR5$)zProvides the next available message parsed from the stream :rtype: EventStreamMessage :returns: The next event stream message )lenrr} StopIterationrrrrrs rnextEventStreamBuffer.nextsg tzz?_ ,/ ! ==  //1DM tzz?T]]77 7/ !""$$rc"UR5$r)rrs r__next__EventStreamBuffer.__next__syy{rcU$rr rs r__iter__EventStreamBuffer.__iter__s r)rrrN)r r r rrrrrrrrrrrrrrrrrr rrrrsM 8 ?7    %"rrc<\rSrSrSrSrSrSrSrSr Sr S r g ) EventStreamia<Wrapper class for an event stream body. This wraps the underlying streaming body, parsing it for individual events and yielding them as they come available through the iterator interface. The following example uses the S3 select API to get structured data out of an object stored in S3 using an event stream. **Example:** :: from botocore.session import Session s3 = Session().create_client('s3') response = s3.select_object_content( Bucket='bucketname', Key='keyname', ExpressionType='SQL', RequestProgress={'Enabled': True}, Expression="SELECT * FROM S3Object s", InputSerialization={'CSV': {}}, OutputSerialization={'CSV': {}}, ) # This is the event stream in the response event_stream = response['Payload'] end_event_received = False with open('output', 'wb') as f: # Iterate over events in the event stream as they come for event in event_stream: # If we received a records event, write the data to a file if 'Records' in event: data = event['Records']['Payload'] f.write(data) # If we received a progress event, print the details elif 'Progress' in event: print(event['Progress']['Details']) # End event indicates that the request finished successfully elif 'End' in event: print('Result is complete') end_event_received = True if not end_event_received: raise Exception("End event not received, request incomplete.") c^XlX lX@lX0lUR 5Ulgr) _raw_stream _output_shape_operation_name_parser_create_raw_event_generator_event_generator)r raw_stream output_shapeparseroperation_names rrEventStream.__init__Gs*%)- $ @ @ Brc#n# URH!nURU5nU(dMUv M# g7fr)r _parse_event)revent parsed_events rrEventStream.__iter__Ns0**E,,U3L|""+s&5 5c## [5nURR5HnURU5 UShvN M gN 7fr)rr streamr)revent_stream_bufferchunks rr'EventStream._create_raw_event_generatorTsA/1%%,,.E  ( ( /* * */ *s>A A  A cUR5nURRX R5nUSS:XaU$[ X0R 5e)Nrr)rr rr rr )rr response_dictparsed_responses rrEventStream._parse_eventZsN..0 ,,,,]r/s#0 " ) "k"";"";""{" "[ "MPMP`<'5'5T  (Q+Q+hbbJS!S!r