vKgURSSKrSSKrSSKrSSKrSSKJr SSKJr SSKJ r SSK J r J r SSK JrJr \R "\5r"SS5r"S S 5r"S S \5r"S S\5r"SS5r"SS5r"SS5r"SS5r"SS\5r"SS5r\"SS/5r\"S5r\"S5rg)N) namedtuple)futures)MAXINT)CancelledErrorTransferNotDoneError)FunctionContainer TaskSemaphorec6\rSrSr\S5rSrSrSrSr g)BaseTransferFuturec[S5e)z-The metadata associated to the TransferFuturemetaNotImplementedErrorselfs R/var/www/highfloat_scraper/venv/lib/python3.13/site-packages/s3transfer/futures.pyrBaseTransferFuture.metas"&))c[S5e)z]Determines if a TransferFuture has completed :returns: True if completed. False, otherwise. zdone()rrs rdoneBaseTransferFuture.done!s "(++rc[S5e)Waits until TransferFuture is done and returns the result If the TransferFuture succeeded, it will return the result. If the TransferFuture failed, it will raise the exception associated to the failure. zresult()rrs rresultBaseTransferFuture.result(s"*--rc[S5e)z6Cancels the request associated with the TransferFuturezcancel()rrs rcancelBaseTransferFuture.cancel1s !*--rN) __name__ __module__ __qualname____firstlineno__propertyrrrr__static_attributes__r rrr r s# **,..rr cD\rSrSr\S5r\S5r\S5rSrg)BaseTransferMeta6c[S5e)*The call args used in the transfer request call_argsrrs rr,BaseTransferMeta.call_args7s"+..rc[S5e)The unique id of the transfer transfer_idrrs rr0BaseTransferMeta.transfer_id<s"-00rc[S5e).A dictionary that requesters can store data in user_contextrrs rr4BaseTransferMeta.user_contextAs".11rr N) r!r"r#r$r%r,r0r4r&r rrr(r(6s< //1122rr(cF\rSrSrS Sjr\S5rSrSrSr Sr S r g) TransferFutureGNcfXlUc[5UlX lUc[5Ulgg)aJThe future associated to a submitted transfer request :type meta: TransferMeta :param meta: The metadata associated to the request. This object is visible to the requester. :type coordinator: TransferCoordinator :param coordinator: The coordinator associated to the request. This object is not visible to the requester. N)_meta TransferMeta _coordinatorTransferCoordinator)rr coordinators r__init__TransferFuture.__init__Hs3 <%DJ'   3 5D  rcUR$N)r:rs rrTransferFuture.meta[s zzrc6URR5$rB)r<rrs rrTransferFuture.done_s  %%''rcURR5$![anUR5 UeSnAff=frB)r<rKeyboardInterruptr)res rrTransferFuture.resultbs< $$++- -   KKMG s =8=c8URR5 grB)r<rrs rrTransferFuture.cancells   "rcxUR5(d [S5eURRUSS9 g)z!Sets the exception on the future.z?set_exception can only be called once the transfer is complete.T)overrideN)rrr< set_exception)r exceptions rrNTransferFuture.set_exceptionos:yy{{&  '' D'Ar)r<r:NN) r!r"r#r$r?r%rrrrrNr&r rrr7r7Gs06&(#Brr7ch\rSrSrSrS Sjr\S5r\S5r\S5r \S5r S r S r g) r;yz'Holds metadata about the TransferFutureNc8XlX lSUl0UlgrB) _call_args _transfer_id_size _user_context)rr,r0s rr?TransferMeta.__init__|s#' rcUR$)r+)rUrs rr,TransferMeta.call_argssrcUR$)r/)rVrs rr0TransferMeta.transfer_ids   rcUR$)z)The size of the transfer request if knownrWrs rsizeTransferMeta.sizeszzrcUR$)r3)rXrs rr4TransferMeta.user_contexts!!!rcXlg)zA method to provide the size of a transfer request By providing this value, the TransferManager will not try to call HeadObject or use the use OS to determine the size of the transfer. Nr_)rr`s rprovide_transfer_size"TransferMeta.provide_transfer_sizes  r)rUrWrVrXrQ) r!r"r#r$__doc__r?r%r,r0r`r4rer&r rrr;r;ys_1 !!""rr;c\rSrSrSrSSjrSr\S5r\S5r \S5r \S 5r S r SS jr S rS \4SjrSrSrSrSSjrSrSrSrSrSrSrSrSrSrSrSrg) r=z*A helper class for managing TransferFutureNcxXlSUlSUlSUl[ 5Ul/Ul/Ul[R"5Ul [R"5Ul [R"5Ul [R"5Ul[R"5Ulg)N not-started)r0_status_result _exceptionset_associated_futures_failure_cleanups_done_callbacks threadingEvent _done_eventLock_lock_associated_futures_lock_done_callbacks_lock_failure_cleanups_lock)rr0s rr?TransferCoordinator.__init__s&$  #&5 !#!$??,^^% (1(8%$-NN$4!&/nn&6#rcNURRSURS3$)Nz (transfer_id=)) __class__r!r0rs r__repr__TransferCoordinator.__repr__s'..))*-8H8H7IKKrcUR$rB)rnrs rrOTransferCoordinator.exceptions rcUR [R"UR5sSSS5 $!,(df  g=f)zThe list of futures associated to the inprogress TransferFuture Once the transfer finishes this list becomes empty as the transfer is considered done and there should be no running futures left. N)rxcopyrprs rassociated_futures&TransferCoordinator.associated_futuress- * *99T556 + * *s 7 AcUR$)z;The list of callbacks to call when the TransferFuture fails)rqrs rfailure_cleanups$TransferCoordinator.failure_cleanupss%%%rcUR$)aThe status of the TransferFuture The currently supported states are: * not-started - Has yet to start. If in this state, a transfer can be canceled immediately and nothing will happen. * queued - SubmissionTask is about to submit tasks * running - Is inprogress. In-progress as of now means that the SubmissionTask that runs the transfer is being executed. So there is no guarantee any transfer requests had been made to S3 if this state is reached. * cancelled - Was cancelled * failed - An exception other than CancelledError was thrown * success - No exceptions were thrown and is done. )rlrs rstatusTransferCoordinator.statuss ||rcxUR SUlXlSUlSSS5 g!,(df  g=f)aSet a result for the TransferFuture Implies that the TransferFuture succeeded. This will always set a result because it is invoked on the final task where there is only ever one final task and it is ran at the very end of a transfer process. So if a result is being set for this final task, the transfer succeeded even if something came a long and canceled the transfer on the final task. Nsuccess)rwrnrmrlrrs r set_resultTransferCoordinator.set_results(ZZ"DO!L$DLZZs+ 9cUR UR5(aU(a XlSUlSSS5 g!,(df  g=f)zSet an exception for the TransferFuture Implies the TransferFuture failed. :param exception: The exception that cause the transfer to fail. :param override: If True, override any existing state. failedN)rwrrnrl)rrOrMs rrN!TransferCoordinator.set_exceptions.ZZ99;;("+' ZZs *A AcURR[5 UR(a UReUR$)r)ruwaitrrnrmrs rrTransferCoordinator.results5 f% ??// !||rc$UR UR5(dUSn[RSX5 U"U5UlUR S:XaSnSUlU(aUR 5 SSS5 g!,(df  g=f)zCancels the TransferFuture :param msg: The message to attach to the cancellation :param exc_type: The type of exception to set for the cancellation Fz%s cancel(%s) calledrkT cancelledN)rwrloggerdebugrnrl announce_done)rmsgexc_typeshould_announce_dones rrTransferCoordinator.cancel sh ZZ99;;',$ 3T?"*3-<<=0+/(* '&&(ZZs A+B Bc&URS5 g)z+Sets the TransferFutrue's status to runningqueuedN_transition_to_non_done_staters rset_status_to_queued(TransferCoordinator.set_status_to_queueds **84rc&URS5 g)z+Sets the TransferFuture's status to runningrunningNrrs rset_status_to_running)TransferCoordinator.set_status_to_running s **95rcUR UR5(a[SURSUS35eXlSSS5 g!,(df  g=f)Nz%Unable to transition from done state z to non-done state .)rwr RuntimeErrorrrl)r desired_states rr1TransferCoordinator._transition_to_non_done_state$sO ZZyy{{";DKK=I*O1.)L ZZs 8A Ac [RSUSUSURS35 URX#S9nUR U5 UR [ URU55 U$)aSubmits a task to a provided executor :type executor: s3transfer.futures.BoundedExecutor :param executor: The executor to submit the callable to :type task: s3transfer.tasks.Task :param task: The task to submit to the executor :type tag: s3transfer.futures.TaskTag :param tag: A tag to associate to the submitted task :rtype: concurrent.futures.Future :returns: A future representing the submitted task zSubmitting task z to executor z for transfer request: r)tag)rrr0submitadd_associated_futureadd_done_callbackrremove_associated_future)rexecutortaskrfutures rrTransferCoordinator.submit-sy  tfM(;RSWScScRdde f / ""6*  d;;V D  rc URS;$)zDetermines if a TransferFuture has completed :returns: False if status is equal to 'failed', 'cancelled', or 'success'. True, otherwise )rrr)rrs rrTransferCoordinator.doneHs {{@@@rcUR URRU5 SSS5 g!,(df  g=f)z6Adds a future to be associated with the TransferFutureN)rxrpaddrrs rr)TransferCoordinator.add_associated_futurePs+  * *  $ $ ( ( 0+ * * 2 AcUR URRU5 SSS5 g!,(df  g=f)z4Removes a future's association to the TransferFutureN)rxrpremovers rr,TransferCoordinator.remove_associated_futureUs+  * *  $ $ + +F 3+ * *rcUR URR[U/UQ70UD65 SSS5 g!,(df  g=f)z7Add a done callback to be invoked when transfer is doneN)ryrrappendrrfunctionargskwargss rr%TransferCoordinator.add_done_callbackZs=  & &  ' '!(T"5$rBr )future_passed_to_callbackfns r done_callback7ExecutorFuture.add_done_callback..done_callbacks 4KrN)rr)rr r s ` rr ExecutorFuture.add_done_callbacks  &&}5rc6URR5$rB)rrrs rrExecutorFuture.dones||  ""rrN) r!r"r#r$r?rrrr&r rrrrs %6 #rrc2\rSrSrSrSSjrSrS SjrSrg) BaseExecutorizABase Executor class implementation needed to work with s3transferNcgrBr )rrs rr?BaseExecutor.__init__ rc[S5e)Nzsubmit()r)rr rrs rrBaseExecutor.submit s !*--rc[S5e)Nz shutdown()rrs rrBaseExecutor.shutdowns !,//rr rBr) r!r"r#r$rgr?rrr&r rrrrsK .0rrc(\rSrSrSrSrSSjrSrg)NonThreadedExecutoriz@A drop-in replacement non-threaded version of ThreadPoolExecutorc[5nU"U0UD6nURU5 U$![aG [R"5SSupg[ R SUUU5 URXg5 U$f=f)Nz0Setting exception for %s to %s with traceback %s)NonThreadedExecutorFuturerrsysrrrset_exception_info)rr rrrrrHtbs rrNonThreadedExecutor.submits*, -((F   f %  -LLN12&EA LLB    % %a ,  -s'A A87A8cgrBr rs rrNonThreadedExecutor.shutdown%rrr Nr)r!r"r#r$rgrrr&r rrrrsJ  rrcL\rSrSrSrSrSrSrS SjrSr S r S r S r S r g)ri)zThe Future returned from NonThreadedExecutor Note that this future is **not** thread-safe as it is being used from the context of a non-threaded environment. cJSUlSUlSUlSUl/Ulg)NF)rmrn _traceback_donerrrs rr?"NonThreadedExecutorFuture.__init__0s&  !rc0XlUR5 grB)rm _set_doners rr$NonThreadedExecutorFuture.set_result7s  rc<XlX lUR5 grB)rnr'r+)rrO tracebacks rr ,NonThreadedExecutorFuture.set_exception_info;s## rNcUR(a%URRUR5eUR$rB)rnwith_tracebackr'rm)rtimeouts rr NonThreadedExecutorFuture.result@s, ??//00A A||rchSUlURHnURU5 M /Ulgr)r(rr_invoke_done_callbackrr s rr+#NonThreadedExecutorFuture._set_doneEs/ !11M  & &} 52!rcU"U5$rBr r6s rr5/NonThreadedExecutorFuture._invoke_done_callbackKs T""rcUR$rB)r(rs rrNonThreadedExecutorFuture.doneNs zzrcUR(aURU5 gURRU5 grB)r(r5rrr)rr s rr+NonThreadedExecutorFuture.add_done_callbackQs+ ::  & &r *  ' ' +r)r(rrrnrmr'rB)r!r"r#r$rgr?rr rr+r5rrr&r rrrr)s/ "  " #,rrTaskTagnamein_memory_uploadin_memory_download) rloggingrrs collectionsr concurrentrs3transfer.compatrs3transfer.exceptionsrrs3transfer.utilsrr getLoggerr!rr r(r7r;r=rrrrrr>IN_MEMORY_UPLOAD_TAGIN_MEMORY_DOWNLOAD_TAGr rrrKs  "$F=   8 $..622"/B'/Bd$#$NoLoLdK&K&\"#"#J 0 0 , .,,,,^ Y )12 !56r