o EbP@sTdZddlZddlZddlZddlZddlmZm Z m Z m Z m Z m Z mZddlmZmZddlmZgdZejdkZdZdZd Zd Zd Zd Zed edededededdgdddiZeeeeeeeeeeed ZdZdZ d Z!ddddddZ"ede de!diZ#Gd d!d!Z$Gd"d#d#Z%Gd$d%d%eZ&d-d'd(Z'Gd)d*d*Z(Gd+d,d,Z)dS).z1 Classes for read / write of matlab (TM) 4 files N) MatFileReader docfillermatdims read_dtypeconvert_dtypes arr_to_charsarr_dtype_number)squeeze_elementchars_to_strings)reduce)MatFile4ReaderMatFile4WriterSYS_LITTLE_ENDIAN VarHeader4 VarReader4 VarWriter4 arr_to_2d mclass_infomdtypes_templatemiDOUBLEmiINT16miINT32miSINGLEmiUINT16miUINT8 mxCHAR_CLASS mxFULL_CLASSmxSPARSE_CLASS np_to_mtypes order_codeslittlef8f4i4i2u2u1header))moptr()mrowsr()ncolsr()imagfr()namlenr(U1) r&Zc32Zc24Zc16r'Zc8r(r)r*r+S1<>z VAX D-floatz VAX G-floatZCray)rrr"r#r$Zdoublecharsparsec@seZdZdZdZddZdS)rFcCs"||_||_||_||_||_dSN)namedtypemclassdims is_complex)selfr9r:r;r<r=r?7/usr/lib/python3/dist-packages/scipy/io/matlab/_mio4.py__init__Ys  zVarHeader4.__init__N)__name__ __module__ __qualname__Z is_logicalZ is_globalrAr?r?r?r@rTs rc@sTeZdZdZddZddZdddZdd d Zd d Zd dZ ddZ ddZ dS)rz" Class to read matlab 4 variables cCs*||_|j|_|j|_|j|_|j|_dSr8) file_reader mat_streamdtypeschars_as_strings squeeze_me)r>rEr?r?r@rAis  zVarReader4.__init__c Cst|j|jd}|jt|dd}|ddks"|ddkr&tdt|dd\}}|d vr=t d t |t t|d \}}|dkrLtd t|d \}}|}|d|df}|ddk} |j|} t || ||| S)z% Read and return header for variable r,r1r-rz.Mat 4 mopt wrong format, byteswapping problem?)rrzBWe do not support byte ordering '%s'; returned data may be corruptdz,O in MOPT integer should be 0, wrong format? r.r/r0r) rrFrGreadintstrip ValueErrordivmodwarningswarnr UserWarningr) r>datar9MrestOPTr<r=r:r?r?r@ read_headerps4  zVarReader4.read_headerTcCst|j}|tkr ||}n"|tkr ||}|r|jrt|}n|tkr)||St d||r8|j r8t |S|S)NNo reader for class code %s) r;rread_full_arrayrread_char_arrayrHr rread_sparse_array TypeErrorrIr )r>hdrprocessr;arrr?r?r@array_from_headers      zVarReader4.array_from_headerc Csp|j}|j}|j}|D]}||9}q |jt|}t||kr'td|jt j |||dd}|r6| }|S)a Mat4 read using header `hdr` dtype and dims Parameters ---------- hdr : object object with attributes ``dtype``, ``dims``. dtype is assumed to be the correct endianness copy : bool, optional copies array before return if True (default True) (buffer is usually read only) Returns ------- arr : ndarray of dtype given by `hdr` ``dtype`` and shape given by `hdr` ``dims`` zNot enough bytes to read matrix '%s'; is this a badly-formed file? Consider listing matrices with `whosmat` and loading named matrices with `variable_names` kwarg to `loadmat`F)shaper:bufferorder) r:r<itemsizerFrOrPlenrRr9npndarraycopy) r>rcrodtr<Z num_bytesdrirer?r?r@read_sub_arrays$  zVarReader4.read_sub_arraycCs8|jr|j|dd}|j|dd}||dS||S)aM Full (rather than sparse) matrix getter Read matrix (array) can be real or complex Parameters ---------- hdr : ``VarHeader4`` instance Returns ------- arr : ndarray complex array if ``hdr.is_complex`` is True, otherwise a real numeric array F)roy?)r=rr)r>rcresZres_jr?r?r@r_s   zVarReader4.read_full_arraycCsB||tj}|d}tj|jtdt |d S)z latin-1 text matrix (char matrix) reader Parameters ---------- hdr : ``VarHeader4`` instance Returns ------- arr : ndarray with dtype 'U1', shape given by `hdr` ``dims`` latin-1r2rhr:ri) rrastypermZuint8tobytesdecodernr<r:Zarrayro)r>rcreSr?r?r@r`s zVarReader4.read_char_arraycCs||}|ddddf}t|dt|df}tj|dddfdd}tj|dddfdd}|d8}|d8}|jdd krRtj|ddd fd d}ntj|ddd fd d}|ddd f|_tj|||ff|S) a Read and return sparse matrix type Parameters ---------- hdr : ``VarHeader4`` instance Returns ------- arr : ``scipy.sparse.coo_matrix`` with dtype ``float`` and shape read from the sparse matrix data Notes ----- MATLAB 4 real sparse arrays are saved in a N+1 by 3 array format, where N is the number of non-zero values. Column 1 values [0:N] are the (1-based) row indices of the each non-zero value, column 2 [0:N] are the column indices, column 3 [0:N] are the (real) values. The last values [-1,0:2] of the rows, column indices are shape[0] and shape[1] respectively of the output matrix. The last value for the values column is a padding 0. mrows and ncols values from the header give the shape of the stored matrix, here [N+1, 3]. Complex data are saved as a 4 column matrix, where the fourth column contains the imaginary component; the last value is again 0. Complex sparse data do *not* have the header ``imagf`` field set to True; the fact that the data are complex is only detectable because there are 4 storage columns. N)rzr)rzrrZintcr:rr#r"floatcomplex) rrrPrmZascontiguousarrayrhimagscipyr7Z coo_matrix)r>rcrstmpr<IJVr?r?r@ras zVarReader4.read_sparse_arraycCs.|j}|tkrttt|j}ny|tkr&ttt|j}|jr%|dd}nc|tkr|j }|j}t |dkrB|ddkrB|ddksDdS|j |j |dddtjd||j |j d}|j |j |dddtjd||j |j d}t|t|f}ntd||jrtd d |D}|S) zwRead the shape of the array described by the header. The file position after this call is unspecified. Nrzr"rrr?rur^cSsg|]}|dkr|qS)rr?).0xr?r?r@ 0sz0VarReader4.shape_from_header..)r;rtuplemaprPr<rrHrr:rlrFseekrkrmrnrOrbrI)r>rcr;rhrpr<ZrowsZcolsr?r?r@shape_from_headers4 $   zVarReader4.shape_from_headerNT) rBrCrD__doc__rAr]rfrrr_r`rarr?r?r?r@rfs  $ *rcsXeZdZdZefddZddZddZdd Zdd d Z dddZ ddZ Z S)r z Reader for Mat4 files cs$tj|g|Ri|d|_dS)zR Initialize matlab 4 file reader %(matstream_arg)s %(load_args)s N)superrA_matrix_reader)r>rFargskwargs __class__r?r@rA6s zMatFile4Reader.__init__cCs^|jdt|jtd}|jd|dkrdS|dks#|dkr)tr'dp(dStr-dp.dS)Nrr(r4rKr5)rFrrrmr:r)r>r-r?r?r@guess_byte_order@s    zMatFile4Reader.guess_byte_ordercCstt|j|_t||_dS)za Run when beginning read of variables Sets up readers from parameters in `self` N)rrZ byte_orderrGrr)r>r?r?r@initialize_readLszMatFile4Reader.initialize_readcCsV|j}tdd|jd}|jj|}|jr |jtks |d9}|j |}||fS)ab Read and return header, next position Parameters ---------- None Returns ------- header : object object that can be passed to self.read_var_array, and that has attributes ``name`` and ``is_global`` next_position : int position in stream of next variable cSs||Sr8r?)ryr?r?r@dsz0MatFile4Reader.read_var_header..rr") rr]r r<r:rkr=r;rrFtell)r>rcnZremaining_bytes next_positionr?r?r@read_var_headerTs  zMatFile4Reader.read_var_headerTcCs|j||S)a Read array, given `header` Parameters ---------- header : header object object with fields defining variable header process : {True, False}, optional If True, apply recursive post-processing during loading of array. Returns ------- arr : array array with post-processing applied or not according to `process`. )rrf)r>r,rdr?r?r@read_var_arraykszMatFile4Reader.read_var_arrayNcCst|tr |g}n|durt|}|jd|i}|sf|\}}|jdur.dn|j d}|durC||vrC|j|q| |||<|j||durb| |t |dkrb |S|r!|S)a, get variables from stream as dictionary Parameters ---------- variable_names : None or str or sequence of str, optional variable name, or sequence of variable names to get from Mat file / file stream. If None, then get all variables in file. NrNonelatin1) isinstancestrlistrFrr end_of_streamrr9rxrremoverl)r>Zvariable_namesmdictrcrr9r?r?r@ get_variables}s,        zMatFile4Reader.get_variablescCs|jd|g}|sB|\}}|jdurdn|jd}|j|}t |j d}| |||f|j||r|S)z list variables from stream rNrrunknown) rFrrrrr9rxrrrgetr;append)r>varsrcrr9rhinfor?r?r@list_variabless    zMatFile4Reader.list_variablesrr8) rBrCrDrrrArrrrrr __classcell__r?r?rr@r 4s    r rowcCs(t||}t|dkrtd||S)a Make ``arr`` exactly two dimensional If `arr` has more than 2 dimensions, raise a ValueError Parameters ---------- arr : array oned_as : {'row', 'column'}, optional Whether to reshape 1-D vectors as row vectors or column vectors. See documentation for ``matdims`` for more detail Returns ------- arr2d : array 2-D version of the array r"z=Matlab 4 files cannot save arrays with more than 2 dimensions)rrlrRZreshape)reoned_asr<r?r?r@rs   rc@sTeZdZddZddZddZeedfdd Zd d Z d d Z ddZ ddZ dS)rcCs|j|_|j|_dSr8) file_streamr)r>Z file_writerr?r?r@rAs zVarWriter4.__init__cCs|j|jdddS)Nrg)rj)rwriterw)r>rer?r?r@ write_bytesszVarWriter4.write_bytescCs|j|dSr8)rr)r>sr?r?r@ write_stringszVarWriter4.write_stringrc Cstdtd}t }d}|d|d|d||d<|d|d<|d |d <||d <t|d |d <|||d } || ddS)a( Write header for given data options Parameters ---------- name : str name of variable shape : sequence Shape of array as it will be read in matlab P : int, optional code for mat4 data type, one of ``miDOUBLE, miSINGLE, miINT32, miINT16, miUINT16, miUINT8`` T : int, optional code for mat4 matrix class, one of ``mxFULL_CLASS, mxCHAR_CLASS, mxSPARSE_CLASS`` imagf : int, optional flag indicating complex r?r,rrLrMrNr-r.rr/r0r1rN)rmemptyrrrlrrencode) r>r9rhr[r\r0r,rXrZrWr?r?r@ write_headers"   zVarWriter4.write_headercCstj|r|||dSt|}|j}|js!|| d}|j }|tj ur-t d|tj ur6t d|tjtjfvrF|||dS|||dS)z Write matrix `arr`, with name `name` Parameters ---------- arr : array_like array to write name : str name in matlab workspace N=z!Cannot save object arrays in Mat4zCannot save void type arrays)rr7Zissparse write_sparsermZasarrayr:ZisnativervZ newbyteordertypeZobject_rbZvoidZunicode_Zstring_ write_char write_numeric)r>rer9rpZdttr?r?r@rs     zVarWriter4.writecCst||j}|jjdk}z t|jjdd}Wnty0|r'|d}n|d}t}Ynw|j ||j |t |d|rL| |j | |jdS| |dS)NcrZc128r&)r[r\r0)rrr:kindrrKeyErrorrvrrrhrrrealr~)r>rer9r0r[r?r?r@rs(      zVarWriter4.write_numericcCst|}t||j}|j}|j||ttd|jjdkr;t |}t j dt |||d}| d}t j |d|d}||dS)Nr[r\Ur?rurtr3)rrrrhrrrr:rrmZprodrnr itemrr)r>rer9r<Zn_charsZst_arrstr?r?r@r$s$   zVarWriter4.write_charcCs|}|jjdk}tj|jdd|fdd}|j|dddf<|j|dddf<|dddd fd7<|rO|jj |ddd f<|jj |dddf<n |j|ddd f<|j |ddd f<|j ||j t td ||dS) zY Sparse matrices are 2-D See docstring for VarReader4.read_sparse_array rrr#r&r{Nrzrr"r)Ztocoor:rrmZzerosZnnzrcolrWrr~rhrrrr)r>rer9Ar0Zijvr?r?r@r7s$ zVarWriter4.write_sparseN) rBrCrDrArrrrrrrrrr?r?r?r@rs! rc@s$eZdZdZdddZdddZdS)rz) Class for writing matlab 4 format files NcCs"||_|dur d}||_d|_dS)Nr)rr_matrix_writer)r>rrr?r?r@rARs  zMatFile4Writer.__init__cCs.t||_|D] \}}|j||q dS)a Write variables in `mdict` to stream Parameters ---------- mdict : mapping mapping with method ``items`` return name, contents pairs where ``name`` which will appeak in the matlab workspace in file load, and ``contents`` is something writeable to a matlab file, such as a NumPy array. write_header : {None, True, False} If True, then write the matlab file header before writing the variables. If None (the default) then write the file header if we are at position 0 in the stream. By setting False here, and setting the stream position to the end of the file, you can append variables to a matlab file N)rritemsr)r>rrr9varr?r?r@ put_variablesYs zMatFile4Writer.put_variablesr8)rBrCrDrrArr?r?r?r@rPs r)r)*rsysrTZnumpyrmZ scipy.sparserZ_miobaserrrrrrr Z _mio_utilsr r functoolsr __all__ byteorderrrrrrrrrrrrrr rrrr rrrr?r?r?r@st$   O y