9Yf&BdZddlmZddlZddlmZddlZddlZddlZddlZddl Z ddl Z ddl m Z m Z mZddlmZdZdZd Zd ZGd d eZGd dej.ZdZdZdZdZdZGddej<ZddZ dZ!e"dk(r9ejFdjIdre jJde&e!yy)a Wraps shell commands and sends the result to Datadog as events. Ex: dogwrap -n test-job -k $API_KEY --submit_mode all "ls -lah" Note that you need to enclose your command in quotes to prevent python from thinking the command line arguments belong to the python command instead of the wrapped command. You can also have the script only send events if they fail: dogwrap -n test-job -k $API_KEY --submit_mode errors "ls -lah" And you can give the command a timeout too: dogwrap -n test-job -k $API_KEY --timeout=1 "sleep 3" )print_functionN)copy) initializeapi __version__)is_p3ksuccesserrorwarningi c eZdZy)TimeoutN)__name__ __module__ __qualname__U/var/www/highfloat_scraper/venv/lib/python3.12/site-packages/datadog/dogshell/wrap.pyr r /srr c.eZdZdZddZdZedZy) OutputReaderz Thread collecting the output of a subprocess, optionally forwarding it to a given file descriptor and storing it for further retrieval. Ncztjj|d|_d|_||_||_y)a Instantiates an OutputReader. :param proc_out: the output to read :type proc_out: file descriptor :param fwd_out: the output to forward to (None to disable forwarding) :type fwd_out: file descriptor or None TrN) threadingThread__init__daemon _out_content_out_fwd_out)selfproc_outfwd_outs rrzOutputReader.__init__9s5 !!$'   rct|jjdD]>}|j|jj ||xj |z c_@|jj y)z Thread's main loop: collects the output optionnally forwarding it to the file descriptor passed in the constructor. rN)iterrreadlinerwriterclose)rlines rrunzOutputReader.runGsa ++S1 &D}}( ##D)    %  & rc|jS)zW The content stored in out so far. (Not threadsafe, wait with .join()) )r)rs rcontentzOutputReader.contentRs    rN)rrr__doc__rr'propertyr)rrrrr3s%   !!rrctj}d}|L|j}tj|z |kDr ttj||L|S)zP Polls the process until it returns or a given timeout has been reached N)timepollr sleep)procsleep_intervaltimeout start_time returncodes r poll_procr6Zs[JJ  YY[ 99; #g -)O JJ~ &   rctj}d}d}d} tj|tjtjd} trtjjntj} trtjjntj} t| j|s| nd} t| j|s| nd}| j|jt| ||} j)j)| j*}|j*} tj|z }||| |fS#t$r)t dt |ztjwxYw#t$rOt}tj}t dtj|z ztj | j! t| ||n#t$rt d tj|z ztjtj}| j# t| ||nB#t$r6t d tj|z ztjYnwxYwYnwxYwn&#t$$r}|j&d k7rYd}~nd}~wwxYwYwxYw) z7 Launches the process and monitors its outputs rT)stdoutstderrshellzFailed to execute %sfileNz3Command timed out after %.2fs, killing with SIGTERMz8SIGTERM timeout failed after %.2fs, killing with SIGKILLz+SIGKILL timeout failed after %.2fs, exiting)r. subprocessPopenPIPE Exceptionprintreprsysr:rr9bufferrstartr6r terminatekillOSErrorerrnojoinr))cmd cmd_timeoutsigterm_timeoutsigkill_timeoutproc_poll_interval buffer_outsr4r5r9r:r1 stdout_buffer stderr_buffer out_reader err_reader sigterm_start sigkill_startedurations rexecuter[is`JJ F FJOOJOO[_`%.4X ))3:: -3X ))3:: !$++K}UYZ !$++K}UYZ t%7E :OOOO   F   Fyy{Z'H vvx //g  %c3#**E     Ctyy{U_G_`gjgqgqr  NN  $ 2OD NRVR[R[R]`mRmn!%  d$6HEWdIdelolvlv  ww!| +s5E0C F%02F"%AK>=K HKA K= J  K  K7K2-K>2K77K>=K>ct||kr|Sdj|d|dz|t|d|zdzz d}|S)z Trim input text to fit the `max_len` condition. If trim is needed: keep the first 1/3rd of the budget on the top, and the other 2 thirds on the bottom. z7{top_third} ``` *...trimmed...* ``` {bottom_two_third} Nr>) top_thirdbottom_two_third)lenformat)textmax_len trimmed_texts r trim_textresd 4yG  !'>W\*T#d)qSZ{_`N`B`Bb=c!'!  rcd}d}d}|r |r tdznt}|r,djt|jdd|}|r,djt|jdd|}|r6t |t r|jddn|}d j| }d j||||| S) za Format and return an event body. Note: do not exceed MAX_EVENT_BODY_LENGTH length. r]z'**>>>> STDOUT <<<<** ``` {stdout} ``` utf-8replace)r9z'**>>>> STDERR <<<<** ``` {stderr} ``` )r:z.**>>>> NOTIFICATIONS <<<<** {notifications} ) notificationszu%%% **>>>> CMD <<<<** ``` {command} ``` **>>>> EXIT CODE <<<<** {returncode} {stdout}{stderr}{notifications}%%% )commandr5r9r:rj)MAX_EVENT_BODY_LENGTHraredecode isinstancebytes) rMr5r9r:rj fmt_stdout fmt_stderrfmt_notifications max_lengths rbuild_event_bodyrts JJ/5&&!+F[J CJJV]]7I> KK CJJV]]7I> KK DN}^cDd ,,Wi@jw PWWfsWt  !+  rcz |jd}|S#t$rtjd|d|wxYw)N,zoption z": invalid warning codes value(s): )split ValueErroroptparseOptionValueError)optionoptoptions_warning warning_codess rgenerate_warning_codesrsIr(--c2  r''[^`o(pqqrs%:ceZdZejj dzZeejjZeed<y) DogwrapOption)r~r~N) rrrryOptionTYPESr TYPE_CHECKERrrrrrrs5 OO ! !$6 6E445L$:L!rrc "tjddjtt}|j ddddd |j d d ddd t jjd |j dddddd|j dddddgdd|j ddddd|j dd ddd!d"gd#$|j d%d&dd'd(d)|j d*dd'd+d,|j d-dd'd.d/|j d0dd1d2d3|j d4ddd5d6|j d7ddd5d8|j d9ddd5d:|j d;dd?d@A|j dBd=dCd?dDA|j dEdddFd5dGH|j|I\}}trdJj|}||fSdKj|jdL}||fS)Mzd Parse the raw command line options into an options object and the remaining command string a%prog -n [event_name] -k [api_key] --submit_mode [ all | errors | warnings] [options] "command". Note that you need to enclose your command in quotes to prevent python executing as soon as there is a space in your command. NOTICE: In normal mode, the whole stderr is printed before stdout, in flush_live mode they will be mixed but there is not guarantee that messages sent by the command on both stderr and stdout are printed in the order they were sent.z %prog {0})usageversion option_classz-nz--namestorestringz@the name of the event as it should appear on your Datadog stream)actiontypehelpz-kz --api_keyzyour DataDog API Key DD_API_KEY)rrrdefaultz-sz--site datadoghq.comzThe site to send data. Accepts us (datadoghq.com), eu (datadoghq.eu), us3 (us3.datadoghq.com), us5 (us5.datadoghq.com), or ap1 (ap1.datadoghq.com), gov (ddog-gov.com), or custom url. default: us)rrrrz-mz --submit_modechoiceerrors)rwarningsallz[ all | errors | warnings ] if set to error, an event will be sent only of the command exits with a non zero exit status or if it times out. If set to warning, a list of exit codes need to be provided)rrrchoicesrz--warning_codesr~z3comma separated list of warning codes, e.g: 127,255)rrdestrz-pz --prioritynormallowz-the priority of the event (default: 'normal'))rrrrz-tz --timeoutintiQz(in seconds) a timeout after which your command must be aborted. An event will be sent to your DataDog stream (default: 24hours)z--sigterm_timeoutxz(in seconds) When your command times out, the process it triggers is sent a SIGTERM. If this sigterm_timeout is reached, it will be sent a SIGKILL signal. (default: 2m)z--sigkill_timeout<zn(in seconds) how long to wait at most after SIGKILL has been sent (default: 60s)z--proc_poll_intervalfloatg?zL(in seconds). interval at which your command will be polled (default: 500ms)z--notify_successrgzQa message string and @people directives to send notifications in case of success.z--notify_errorzOa message string and @people directives to send notifications in case of error.z--notify_warningzUa message string and @people directives to send notifications in case of warning.z-bz --buffer_outs store_truerRFzdisplays the stderr and stdout of the command only once it has returned (the command outputs remains buffered in dogwrap meanwhile))rrrrz --send_metric send_metricz!sends a metric for event durationz--tagstagszcomma separated list of tags)rrrrr)args  rh) ry OptionParserrarr add_optionosenvironget parse_argsrrLrm)raw_argsparseroptionsrrMs r parse_optionsrs " " "";/" F   ,     # |,    0     -H     B    5! <    >      <                F    0  xfbOm%%8%4MGT xhhtn C<iio$$W- C<rct\}}t||j|j|j|j |j \}}}}|jdvrd}na|jdvrd}nP|jdvrd}n?|jdvrd}n.|jd vrd }n|jd vrd }n |j}t|j| tj}d}|jr#ttt|j}|dk(rt } d} d||j"|fz} n|dk7rp|j$dk(ra|s t'dt)j*nv||vrt,} d} d||j"|fz} nWt'dt)j*n7t.} d} |t0urd||j"|fz} d}nd||j"|fz} d}  t k(r|j2r |j2} nC| t.k(r|j4r |j4} n!| t,k(r|j6r |j6} |j8r7|j8j;dD cgc]} | j=}} nd}t?||||| }| |j"||j@xs |d}|j r~tCr"|jEd}|jEd}t'|j=t(jFt'|j=t(jH|j$dk(s|dk7rx|jJrJdjM|j"}|r||gz}n|g}tjNjQd||d !tjRjTd# |d"|t)j*|ycc} w)$N)ruszhttps://api.datadoghq.com)z datadoghq.eueuzhttps://api.datadoghq.eu)zus3.datadoghq.comus3zhttps://api.us3.datadoghq.com)zus5.datadoghq.comus5zhttps://api.us5.datadoghq.com)zap1.datadoghq.comap1zhttps://api.ap1.datadoghq.com)z ddog-gov.comgovzhttps://api.ddog-gov.com)api_keyapi_hostrrz[%s] %s succeeded in %.2fsrz8A comma separated list of exit codes need to be providedrz[%s] %s failed in %.2fszBCommand exited with a different exit code that the one(s) providedz[%s] %s timed out after %.2fsr8rgrv) alert_typeaggregation_keyhostpriorityrrhr<rz event_name:{}zdogwrap.durationgauge)metricpointsrr)titlerbr)+rr[r3rOrPrQrRsiterrr _host_namer~listmaprSUCCESSname submit_moderCrEexitWARNINGERRORr notify_success notify_errornotify_warningrrwstriprtrrrmr:r9rraMetricsendEventcreate)rrMr5r9r:rZrrr~revent_priority event_titlerjtr event_bodyeventevent_name_tag duration_tagss rmainrsu ?LGS ,3 "" ,(J||... / /- 5 52 5 52 5 52 0 0-<<w: >>DMSg&;&;<= Q 3tW\\86TT qW00J> L M HHJ = ( J%N4gllH7UUK V W HHJ !  :dGLLRZ=[[KJ4gllH7UUKMW!7!7.. u !5!5,, w 7#9#9.. ||#*<<#5#5c#:;a ;;!#z66=QJ!"<<$$6  E 8]]7+F]]7+F flln3::. flln3::.e#zQ   ,33GLLAN $'7 7 !/ 0 JJOO#5h]ahO i E{EuEHHZArs(&   10&   i $!9##$!N =0@.(Vr;HOO;Xvk\ z xx{I& XZstFr