ը f,dZddlZddlmZddlmZ ddlmZddl Z e je _ddlmZmZ ddlmZddlmZ dd lmZdd lmZmZm Z dd l!m"Z"m#Z#dd l$m%Z%Gdde Z&GddZ'Gdde'Z(Gdde'Z)Gdde'Z*y#eje dYxYw#e$rddlmZddlmZYwxYw#e$r dd lmZYwxYw)a! @brief WMS, WMTS and NASA OnEarth drivers implemented in GRASS using GDAL Python bindings. List of classes: - wms_drv::WMSDrv - wms_drv::BaseRequestMgr - wms_drv::WMSRequestMgr - wms_drv::WMTSRequestMgr - wms_drv::OnEarthRequestMgr (C) 2012 by the GRASS Development Team This program is free software under the GNU General Public License (>=v2). Read the file COPYING that comes with GRASS for details. @author Stepan Turek (Mentor: Martin Landa) N)sleep)gdalzTUnable to load GDAL Python bindings (requires package 'python-gdal' being installed))pifloor) HTTPError) HTTPException) ParseError) ExpatError)GetEpsgGetSRSParamValWMSBase)WMTSCapabilitiesTreeOnEarthCapabilitiesTree)SrsceZdZdZdZy)WMSDrvc tjtd|jd}d|jdvr|jdxxdz cc<n|jdxxdz cc<|jds!|j |j|_n|jd|_|jddk(rBt |j|j|j|j|j }n|jddk(rBt|j|j|j|j|j}nS|jdd k(rAt|j|j|j|j|j }j}d }d }d } |d k(r|j}sn|d }|d } tj|d |j!||jd|jd} |j1} t3| d} | j5 j7 jAd }tCjD| tBjF}|o t3| d}|j7}jA"tj,td|zntj,tdd }|jHd kr!tj,td|z|jHd k(rB|jKd jM#|j1}|jO| |}n|}|r|j1}tCjP|jR}|jU}tBjV|vs|tBjVdk(r+tj,td |jRz|jH|_,|j[||d!|d"|jX|jKd j\}d#}|j_d d | d$| d%| d$| d%}ja| d&| d'| d$| d%|d }d }tjb| tjb|'|s|Stjdd(d)tg|jd*+}|jid,}jk||d-|d.z tm|d!z }|d/|d0z tm|d"z }|d.|d1|d0d1|g}|jo|d }|S#t"t$f$r} t'| t(rI| j*dk(r:tj,td|jdt/| fzn9tj,td|jdt/| fzYd } ~ d } ~ wwxYw#t"$r} t'| t8j:rc| d dk(r[|dkrV|d z }|d k(rd}n|dk(rd}tj<tdzt?|Yd } ~  jAtj,tdt/| zYd } ~ d } ~ wwxYw# jAwxYw#t"$r5} tj,tdt/| zYd } ~ d } ~ wwxYw#jAwxYw)2zh!Downloads data from WMS server using own driver @return temp_map with downloaded data z#Downloading data from WMS server...url?&capfiledriver WMTS_GRASS WMS_GRASS OnEarth_GRASSTNrusernamepasswordiz3Authorization failed to '%s' when fetching data. %sz"Unable to fetch data from: '%s' %swbhzLServer refused to send data for a tile. Request will be repeated after %d s.z&Unable to write data into tempfile. %srbz%Unable to read data from tempfile. %szWMS server error: %szWMS server unknown errorzBWMS server error: no band(s) received. Is server URL correct? <%s>NOz+Driver %s does not supports Create() methodcolsrowsFsizeXsizeY t_cols_offset t_rows_offsetzg.projwfsrs)flagsepsg maxxminxminymaxyg)8grassmessage_params_fetchCapabilitiescap_fileWMTSRequestMgrbboxregionproj_srs WMSRequestMgr tile_sizeOnEarthRequestMgr GetMapRegion GetNextTiledebug_fetchDataFromServerIOErrorr isinstancercodefatalstr _tempfileopenwritereadsocketerrorwarningrcloserOpen GA_ReadOnly RasterCount GetRasterBandGetRasterColorTable_pct2rgbGetDriverByNamegdal_drv_format GetMetadata DCAP_CREATEtemp_map_bands_numCreateDataType ReadRaster WriteRaster try_remove read_commandr rstrip SetProjectionintSetGeoTransform)self server_urlreq_mgr map_regioninittemp_map fetch_trytile query_urltile_refwms_datae temp_tiletemp_tile_opened sleep_timetile_dataset_infoerror_xml_openederr_strtemp_tile_pct2rgb tile_datasetrmetadatatemp_map_datasettile_to_temp_map projectionpixel_x_lengthpixel_y_length geo_transforms (/usr/lib/grass83/etc/r.in.wms/wms_drv.py _downloadzWMSDrv._download;s  a=>?[[' $++e$ $ KK # %  KK # % {{9% 33DKK@DM KK 2DM ;;x L 0$ TYY T]]DMMG[[ "k 1# TYY T^^T]]G[[ "o 5' TYY T]]DMMG ))+  A~**,QIAwH KK 1 % 44t{{:6 J8O(I )#' 4#8  &&x}}74!&&(I $ )T5E5E F  (-'+It'<$.335G%**,&KK"8 9G CDKK"< => $  ,,q0 \!!"--2%33A6JJLX%)NN$4!#}}Y8IJ 0 >>+--d.B.BC!--/$$H4 0 01T9KKGH../+7*B*B'#)==v&v&++ ..q1:: $  ,66!!!!     ( ())!!   L $    Y '   . /ehO'' Dwt{{5/A'B  &&t, &&z2$V,z&/AAS v F  %V,z&/AAS v F   v    v      ((7w]+ a+# KKPQ;;u-s1v67 KK?@;;u-s1v67 $ W a.1Q43;9q=NI A~%& "a%' MMk%%*%!&&(KK"K LsSTv UVV/ W2!&&(VKK"J KcRSf TUUV%**,sz>-V<+Y \Y%BX==Y \A'[;5\ *[;5\;\\\ ]!*] ]]]]+cd}d}tj|}|!tjt d|z|j |}t jdt jdt jdt jddzg}|j}|Tttd|jD].} |j| } tdD] } | | || | <0tj|j} | j!||j"|j$|} t|j$D]p}|j'd||j"d}t|D]B}||}t j(||}| j |dzj+|d|Dr| S)z!Create new dataset with data in dst_filename with bands according to src_filename raster color table - modified code from gdal utility pct2rgb @return new dataset rzUnable to open %s r)rrSr5rIr7rVNumeric arrayrangeonesrWrangeminGetCount GetColorEntryrYrZr^ RasterXSize RasterYSize ReadAsArraytake WriteArray)rh src_filename dst_filename out_bands band_numbersrc_dssrc_bandlookupctientryc gtiff_drivertif_dsiYsrc_dataiBand band_lookupdst_datas rrXzWMSDrv._pct2rgbs   <( > KK.=> ?'' 4   s #   s #   s # LL  #   ) ) + >3sBKKM23 ,((+q,A#(8F1IaL, , ++D,@,@A $$ &,,f.@.@)  **+ LB++Ar63E3EqIHy) L$Um "<< X>$$UQY/::8QK  L L N)__name__ __module__ __qualname__rrXrrrr:sYv/rrceZdZdZdZdZy)BaseRequestMgrz!!Base class for request managers.c, d}i|_tt|d|dz |dz |z|jd<tt|d|dz |dz |z |jd<tt|d|dz |dz |z|jd <tt|d|d z |dz |z |jd <d |_d D]|}dD]u}|jd |j|ks#|j||d ks9|jd|j|ksY|j||dksod|_w~|js&t j t dd|_y|jd|dkrt|d|jd<|jd|dkDrt|d|jd<|jd |d krt|d |jd <|jd |d kDrt|d |jd <t jd|jd|jd|jd |jd fzd|jd|jdz dz|jd |jd z dzz} t jt d| |d|dfzi|_|jd|dz|dz|jd<|d|jd |dzz |jd<|jddz|dz|dz|jd<|d|jd dz|dzz |jd <t|d|jd|jdz dzz|jd<t|d|jd |jd z dzz|jd<|jd|_ |jd |_ |d|d|d|dz|d|dz d|_ |d|dd|_ y)zb!Initialize data needed for iteration through tiles. Used by WMTS_GRASS and OnEarth_GRASS drivers.V瞯 Q Q  #& cNy)DOOI,FFJ L# #& cNy)DOOI,FFJ L#  __Y/ __Y/ f%f%f% #6f% #6  #,C.9S>J rcV|jddk7s|jddk7ryy)z!Is it geographic projection?z +proj=latlongz +proj=longlatTF)find)rhprojs r _isGeoProjzBaseRequestMgr._isGeoProjs) 99_ % +tyy/IR/OrN)rrr__doc__rrrrrrrHs+mK^rrc,eZdZddZdZdZdZdZy)r?Nc|d|_|d|_|ddzt|dz}|dd|dd|dd |d d |d d |dd|d z|_|dr|xjd|dzz c_|xjd|zdzdz|dzz c_||_||_|d |_|d |_|ddk7r|xjd|dzz c_t|d }t|d } ||jz|_ ||jz|_ t|jt|z |jd|jdz z|_ d|_ |jdk7rd|_ |jdz|_ | |j z|_| |j z|_t|j t| z |jd|jdz z|_d|_|jdk7rd|_|jdz|_t%|j|_|jd|jz|j&d<d|_d|_|j|_||j,d <| |j,d <y )!4!Initialize data needed for iteration through tiles. wms_versionr- proj_name=rz#SERVICE=WMS&REQUEST=GetMap&VERSION=z&LAYERS=layersz&WIDTH=r&z&HEIGHT=r'z&STYLES=stylesz &TRANSPARENT= transparentbgcolorz &BGCOLOR=rzFORMAT=format urlparamsr1r2FrTrr4r3N)version srs_paramr rr<r> tile_rows tile_colsrf num_tiles_xlast_tile_x_sizefloat tile_length_x last_tile_x num_tiles_ylast_tile_y_size tile_length_y last_tile_ydict tile_bboxi_xi_yrk) rhr8r<r=r@r>r:rr&r's r__init__zWMSRequestMgr.__init__sm, k"S(>&-+HH%=}%x &!&!x }%    )  HH fY&77 7H C$J$y06(3CCC   "6*"6* + " $ HHf[11 1H6&>"6&>" 4>>1 $t~~ 5 $.. !Dk yy 499V#44 6  !  A %#D #//!3D 4>>1 $t~~ 5 $.. !Dk yy 499V#44 6  !  A %#D #//!3D dii!%6!2T5G5G!Gv))"&"&rc|jSzN!Get size in pixels and bounding box of raster where all tiles will be merged.rkrhs rrBzWMSRequestMgr.GetMapRegion  rc i}|j|jk\ry|j|d<|j|jdz k(r|jr|j|d<|j dk7rC|j dxx|jzcc<|j dxx|jzcc<nE|jd|j d<|jd|jz |j d<|j|d<|j |jdz k(r|jr|j|d<|j|j |j|j|j }|j"dzd |d d |dd |d d |dz}t%|j|jz|d <t%|j|j z|d<|j |jdz k\rbd|_|xjdz c_|j d xx|j&z cc<|j d xx|j&z cc<||fS|xj dz c_||fS)[!Get url for tile request from server and information for merging the tile with other tilesNr(rrr3r4r)rzBBOX=r2,r1r*r+)rrrrrrrrr<rrrr _getQueryBboxr>rrrrfr)rhrqrrps rrCzWMSRequestMgr.GetNextTile s= 88t'' ' NN 88t''!+ +0@0@ $ 5 5HW  88q= NN6 "d&8&8 8 " NN6 "d&8&8 8 "%)YYv%6DNN6 "%)YYv%69K9K%KDNN6 " NN 88t''!+ +0@0@ $ 5 5HW '' NNDMM4>>4<<  HH 6"6"6"6"   %((A$B!$'(A$B! 88t''!+ +DH HHMH NN6 "d&8&8 8 " NN6 "d&8&8 8 "("" HHMH(""rc|dvs|dk7r|Stt|jdk(r|j|S|S)z!Creates query bbox (used in request URL) Mostly bbox is not modified but if WMS standard is 1.3.0 and projection is geographic, the bbox x and y are in most cases flipped. )TSz1.3.0yx)rr axisorder _flipBbox)rhr<rrrs rrzWMSRequestMgr._getQueryBboxBsD  Gw$6K  * + 5 5 =>>$' ' rc`t|}i}|d|d<|d|d<|d|d<|d|d<|S)z Flips bbox values between this keys: maxy -> maxx maxx -> maxy miny -> minx minx -> miny @return copy of bbox with flipped coordinates r1r4r2r3)r)rhr< temp_bboxnew_bboxs rrzWMSRequestMgr._flipBboxPsSJ $V,$V,$V,$V,rN)rrrrrBrCrrrrrr?r?sE'N3#j rr?cDeZdZd dZdZdZdZdZdZdZ d Z d Z y) r;Nc ||_d|_d|_ t|}j|_ |j}|j||d|d} | dd} | dd} | j|jjdj|d <|j!| j#|jj%d ||} |j'| | } |j)| ||| |j+| y#t$r5}t j tdt|zYd}~0d}~wwxYw) 5!Initializes data needed for iteration through tiles.NgמY2?&Unable to parse tile service file. %s rr-rr Identifiertile_matrix_set TileMatrix)r>meters_per_unit pixel_sizerr r5rIr7rJgetxmlnshandlerxml_nsgetroot _getMatSetsrNsOwstext _findTileMatsfindallNsWmts _getMatSizer _getMatSetSrs)rhr8r<r=r>r:cap_treerProotmat_setsmat_set mat_set_linktile_matrs rrzWMTSRequestMgr.__init__esO! #" T,H5H..0 !##D&*:F5MJ1+a.{1~ $+LL1B1B<1P$Q$V$V !%% OODKK..|< =vt  '',?    fdL$2D2DW2M 1 T KKDEE R S S Ts D E"*EEc|jSrrrs rrBzWMTSRequestMgr.GetMapRegionrrc6|j|jjd}|j|jjd}d}|D]?}|j|jj dj }||k(s=|}n|!t jtd|z|j|jjd} g} |j|jjd} | D]} | j|jjdj } | D]}|j|jj dj }|| k7r=|j|}t|jt|jk(s| j|| g| s/t jtd|d t|zfz| S) zM!Get matrix sets which are available for chosen layer and have required EPSG.ContentsLayerNrz-Layer '%s' was not found in capabilities fileTileMatrixSetLink TileMatrixSetz)Layer '%s' is not available with %s code.zEPSG:)rrr r r r r5rIr7rrgetcoder upperappendrJ)rhr layer_namer-contentsrch_layerlayerlayer_id mat_set_linkssuitable_mat_setstileMatrixSetslinkmat_set_link_idr mat_set_id mat_set_srss rrzWMTSRequestMgr._getMatSetss99T[[// ;<!!$++"4"4W"=> Ezz$++"3"3L"ABGGH:%      KKIJZW X ((););D"ii (:(:?(KLQQO) >$\\$++*;*;L*IJOO 0"009 {#++-.2E1L1L1NN%,,gt_=  > >! KK=>wS123  ! rcj|j|jjdjS)N SupportedCRS)rrr r )rhrs rrzWMTSRequestMgr._getMatSetSrss&||DKK--n=>CCCrcg}|j|d|dz |dz |jz|jz |j|d|dz |dz |jz|jz t|}d}|D]l}t |j |j jdj}|r|} |} d }I |z } ||z } | | kr| d ks | | kDsc| d kDsi|} |} n S) z4!Find best tile matrix set for requested resolution.r4r3r'r1r2r&TScaleDenominatorFr) r_getMetersPerUnitrrrrrr r ) rh tile_matsr=r< scale_dens scale_denfirstt_mat mat_scale_denbest_scale_den best_t_mat best_diffmat_diffs rr zWMTSRequestMgr._findTileMatss?  &\DL (Vn $$& 'oo   &\DL (Vn $$& 'oo   O  /E! 4;;--.@ABGGM!." &2I$y0HH$AH$Q" !.! /$rc@|jr |jS|j|jrg|jjd}|D]%}d|vst |jdd}ndt zz}|dz |_|jSd|jvrd|jjd}|D]8}d|vsdt |jddz |_|jS|jSd|_|jS)zQ!Get coefficient which allows converting units of request projection into meters. z+arrrihz +to_meter)rrr>splitrr)rh proj_paramsparama equator_perims rr/z WMTSRequestMgr._getMetersPerUnits&   '' ' ??4== )----c2K$ 5=ekk#.q12A FQJM#03#6D ###DMM )----c2K$ %'+,uU[[5Ea5H/I+ID( ### ###$%D ###rci}dx|d<|d<t|j|jjdjdz |d<t|j|jjdjdz |d<|j|jjd }||S|j|jj d j}|j |jjd }|D]}|j|jjd }|j} | |k(s?dd gddgddgddgfD]c} |j|jj| d} t| j|| d<| ddvsS|| ddz || d<e|S|S)zW!Get rows and cols extend of data available on server for chosen layer and tile matrix.rrr MatrixWidthrr MatrixHeightrTileMatrixSetLimitsrTileMatrixLimitsr MinTileRow MaxTileRow MinTileCol MaxTileCol)rr)rfrrr r r r ) rhrrrtile_mat_set_limits tile_mat_idtile_mat_limitslimitlimit_tile_matlimit_idri_tags rrzWMTSRequestMgr._getMatSizes <== Y,y"9  dkk00?@EE F J Y  dkk00@AFF G! K Y +// [[   5 6   & mmDKK$5$5l$CDII -55 KK  1 2 % E"ZZ (:(:<(HIN%**H;& - - - -  DA "JJt{{'9'9!A$'?@E),UZZL1&t55-9!A$-?!-C QqT* D' &rct|j|jjdj}||j z|j z }|j|jjdjjd}i} t|d| d<t|d| d<t|} | jdk(r5| jd vr'tjd | d| dc| d<| d<ntjd i} i|_ t|j|jjd j|jd <||jd z| d <t|j|jjdj|jd<||jdz| d<|dd|dd|dd|dd|dd|j|jjdj z|_t"j%||| | |j|y)rr. TopLeftCornerr;rr2rr4z EPSG:4326)uriurnswitchz no switch TileWidthr TileHeightrrz1SERVICE=WMTS&REQUEST=GetTile&VERSION=1.0.0&LAYER=rz&STYLE=rz&FORMAT=rz&TILEMATRIXSET=rz &TILEMATRIX=rN)rrrr r rr/r<rrencodingr5rQr@rfr rrr) rhrr8r<rr*r2 pixel_spantl_strrsrs rrz"WMTSRequestMgr._computeRequestData0s(-- (:(:;M(NOTTU 043I3I3KK t{{11/BCHHNNsS !&), &!&), &    99;+ %!***F MM( #&!&! 3Yv  & 1 MM+ & !(-- 0B0B;0O"P"U"UVs#dnnS&99 #!(-- 0B0B<0P"Q"V"VWs#dnnS&99 #%=x x x () dkk// =>CC    ** $ 9dnnl rc|jr|j|jdkDry|jdt |jt |j fzz}t |j d|j|jdz z|jd<t |j d|j |jdz z|jd <|j |jd k\r*|jd|_|xjd z c_n|xj d z c_||jfS) z\!Get url for tile request from server and information for merging the tile with other tiles.rNz&TILECOL=%i&TILEROW=%irrr*rrr+rr)rrrrrfrr@rq)rhrps rrCzWMTSRequestMgr.GetNextTileds$**ty/I"IHH7  O  O;   *- NN3 4:: 0J#J K*  o&*- NN3 4:: 0J#J K*  o& ::3 33DJ JJ!OJ JJ!OJ$--''rr) rrrrrBrrr r/rrrCrrrr;r;ds5( T%!ND&P$:,\2 h(rr;c>eZdZdZdZdZd dZdZdZdZ d Z y) rAc t||_|jj}|j||||\}|_ } |_ ||_ |d|dz|jd<|j|| |j|jy#t$r4}tjt dt |zYd}~d}~wwxYw)rrNrr) rrr r5rIr7rJr_parseTileServicerr@rr) rhr8r<r=r> tile_servicerPrr t_patt_bboxs rrzOnEarthRequestMgr.__init__s T4LADM}}$$&<@;Q;Q $< 8T^[$.Umc!f,    {DNNDNNS T KKDEE R S S TsB C *CCc|jSrrrs rrBzOnEarthRequestMgr.GetMapRegionrrcD|jd}|j|}|s!tjt ddzd}|D])}|jd} | j |dk(s'|}n|$tjt d|dz|j d} |j| ||} | j jd } |d r|j|d | } n| d } | D] }d |vs|} |jj| \} }}}i}t|d |d z |d<t|d|dz |d<|jd}i}dD]}t|j|||<!i}||d<||d<| |||fS)z !Get data from tile service file TiledPatternsz;Unable to parse tile service file. No tag '%s' was found. TiledGroupNNamerz3Tiled group '%s' was not found in tile service file TilePatternr0rrztime=${rrrrrLatLonBoundingBox)r2r3r1r4)r_getAllTiledGroupr5rIr7r r _parseTilePatternr<_insTimeToTilePatternUrlrgettilepatternurldataabsrget)rhrr<r=r8tiled_patterns tile_groups req_groupgroupname group_t_patts best_patturlsrut_bboxwidthheightrtile_pattern_bboxrar[r@s rr_z#OnEarthRequestMgr._parseTileServices?3,,^<  KKPQ     E::f%DyyF8,,!      KKGH"#  "))-8 **=$G ~~##D) + //{0CTJCq'C A%C &*]]%H%H%M"VUF VAY23 #VAY23 #%NN+>? 1 =A"#4#8#8#;ACL4</6&>AC s8c#h HH $ $G)-)L)L ""4(+* &CVAY23e;E#JVAY23fkv has_time_var url_p_idxs url_p_values rrkz*OnEarthRequestMgr._insTimeToTilePatternUrls$**3/$! E {{3'1F{%%a( L !11#q9 !!*Q-#a#g,">AO r?d*{3{;Ka;O/PTW/Wo 1 .6Z]_9MMC#'L   ST+&'=! F  MMc99  Q  =k* + sD,D0/D0cd}i}dx|d<|d<t|d|dz |dz |z|d<t|d |d z |d z |z|d <tj||||j|j|y )rrrrrr4r3rrr1r2rrN)rrrrr@)rhr<rarr@rrs rrz%OnEarthRequestMgr._computeRequestData1s <== Y,y"9"'  ;v#6 6)C. H7 R# Y#(  ;v#6 6)C. H7 R# Y ** $ T^^T^^\ rc |j|jdkDry|jd|jz}|jd|jz}|jddzdt |j d|zd t |j d |z d t |j d |zd t |j d |z z|jd z}t|jd|j|jdz z|jd<t|jd|j|jdz z|jd<|j|jdk\r*|jd|_|xjd z c_n|xjd z c_||jfS)rrNrrrrzbbox=r2rr3r1r4rrr*rr+r) rrrrrrrrfr@rq)rhx_offsety_offsetrps rrCzOnEarthRequestMgr.GetNextTileBs :: 2 2>>#&3>>#&3 HHQK doof-89doof-89doof-89doof-89  hhqk  *- NN3 4:: 0J#J K*  o&*- NN3 4:: 0J#J K*  o& ::3 33DJ JJ!OJ JJ!OJ$--''rr) rrrrrBr_rirjrkrrCrrrrArA~s.T(26h #J3j ""(rrA)+rrO grass.scriptscriptr5rrosgeorrIr7numpyrarangermathrrurllib2rhttplibr ImportError urllib.error http.clientxml.etree.ElementTreer xml.parsers.expatr wms_baser r r wms_cap_parsersrrr-rrrr?r;rArrrrs$^^*!% ;065IKWK\vvr`N`FW(^W(tf(f(IEKK b *&)*;:;s.B B9CB69C  C  CC