OwlCyberSecurity - MANAGER
Edit File: layermapping.cpython-39.pyc
a ���e�p � @ s d Z ddlZddlmZ ddlmZ ddlmZ ddlm Z ddl m Z m Z m Z mZmZmZ ddlmZmZmZmZmZmZmZ dd lmZmZ dd l m Z m Z m Z m Z dd l!m"Z" G d d � d e#�Z$G dd� de$�Z%G dd� de$�Z&G dd� de$�Z'G dd� de$�Z(G dd� d�Z)dS )a The LayerMapping class provides a way to map the contents of OGR vector files (e.g. SHP files) to Geographic-enabled Django models. For more information, please consult the GeoDjango documentation: https://docs.djangoproject.com/en/dev/ref/contrib/gis/layermapping/ � N)�Decimal)�InvalidOperation)�Path)� GeometryField)�CoordTransform� DataSource� GDALException� OGRGeometry� OGRGeomType�SpatialReference)�OFTDate� OFTDateTime� OFTInteger� OFTInteger64�OFTReal� OFTString�OFTTime)�FieldDoesNotExist�ObjectDoesNotExist)� connections�models�router� transaction)� force_strc @ s e Zd ZdS )� LayerMapErrorN��__name__� __module__� __qualname__� r r �f/home/gouroczh/virtualenv/pat/3.9/lib/python3.9/site-packages/django/contrib/gis/utils/layermapping.pyr & s r c @ s e Zd ZdS )� InvalidStringNr r r r r r! * s r! c @ s e Zd ZdS )�InvalidDecimalNr r r r r r" . s r" c @ s e Zd ZdS )�InvalidIntegerNr r r r r r# 2 s r# c @ s e Zd ZdS )�MissingForeignKeyNr r r r r r$ 6 s r$ c , @ s� e Zd ZdZded�ded�ded�ed�jed �ed �jed �ed �jed �iZeje ej e ej e ej e eefeje eefeje efejeejeejeejeeje efejeejeej eej eej eej e eefej e eefej!e eefej"e eefej#e eefiZ$d0dd�Z%dd� Z&dd� Z'dd� Z(dd � Z)d d � Z*d d � Z+d!d"� Z,d#d$� Z-d%d&� Z.d'd(� Z/d)d*� Z0d+d,� Z1d-d-d-d-d-e2j3d-fd.d/�Z4dS )1� LayerMappingz1A class that maps OGR Layers to GeoDjango Models.� Z MultiPoint� ZMultiLineString� Z MultiPolygonZPoint25DZ MultiPoint25DZ LineString25DZMultiLineString25DZ Polygon25DZMultiPolygon25Dr N�utf-8�commit_on_successTc C s* t |ttf�r t||d�| _n|| _| j| | _| dur<| nt�|�| _t | j } | j | _ || _ || _ | �� | jjr�| �� | _nd}|r�| �|�| _| �� | _n|| _|r�ddlm} | |� || _nd| _| r�| �| � d}| | _nd| _|| _ |dk�rd| _ n |dk�rt j | _ n t d| ��dS ) a A LayerMapping object is initialized using the given Model (not an instance), a DataSource (or string path to an OGR-supported data file), and a mapping dictionary. See the module level docstring for more details and keyword argument usage. )�encodingNFr )�lookupZ autocommitr* z!Unrecognized transaction mode: %s)!� isinstance�strr r Zds�layerr Z db_for_write�usingr �ops�spatial_backend�mapping�model� check_layer�featuresZsupports_transform�geometry_field� geo_field� check_srs� source_srs�coord_transform� transform�codecsr, r+ � check_unique�unique�transaction_mode�transaction_decoratorr Zatomicr ) �selfr4 �datar3 r/ r: r+ r@ r< r? r0 � connectionr, r r r �__init__` sB zLayerMapping.__init__c C s6 |r.t |ttf�rt|� S t |t�r(|S t�ndS dS )z Check the `fid_range` keyword.N)r- �tuple�list�slice� TypeError)rB � fid_ranger r r �check_fid_range� s z LayerMapping.check_fid_rangec s d| _ i | _| jj� | jj}� fdd�}| j�� D �]�\}}z| jj�|�}W n t yl t d| ��Y n0 |j j }t |t��r0| j r�t d��|j}z"|dkr�t|d �}nt|�}W n ty� t d| ��Y n0 | jj} | j�|j��s | �| |��s t d ||dk�rd nd | f ��|| _ || _|} n�t |tj��r�t |t��r�|jj} |�� D ]L\} } || �}z| j�| � W n( t �y� t d | | j j f ��Y n0 �qZ| } ntd ��nV|j | j v�r�t d| ��||�}|| } t | | j |j ��s t d| | j |f ��|} | | j|< q2dS )z� Check the Layer metadata and ensure that it's compatible with the mapping information and model. Unlike previous revisions, there is no need to increment through each feature in the Layer. Fc s2 z� � | �}W n ty, td| ��Y n0 |S )Nz4Given mapping OGR field "%s" not found in OGR Layer.)�index� ValueErrorr )Z ogr_map_fld�idx�Z ogr_fieldsr r � check_ogr_fld� s � z/LayerMapping.check_layer.<locals>.check_ogr_fldz3Given mapping field "%s" not in given Model fields.zDLayerMapping does not support more than one GeometryField per model.r( Z25Dz'Invalid mapping for GeometryField "%s".zDInvalid mapping geometry; model has %s%s, layer geometry type is %s.z(dim=3)� z/ForeignKey mapping field "%s" not in %s fields.z.ForeignKey mapping must be of dictionary type.z0Django field type "%s" has no OGR mapping (yet).z:OGR field "%s" (of type %s) cannot be mapped to Django %s.N) � geom_field�fieldsr/ Z field_typesr3 �itemsr4 �_meta� get_fieldr r � __class__r r- r �dimr r � geom_type�name� startswith� make_multi� coord_dimr Z ForeignKey�dictZ remote_fieldrI � FIELD_TYPES� issubclass)rB Zogr_field_typesrP � field_name�ogr_name� model_fieldZfld_namer] �gtypeZltypeZ fields_val� rel_modelZrel_name� ogr_fieldrN r rO r r5 � s� � � � � ��� �� � ��zLayerMapping.check_layerc C s^ t |t�r|}n8t || j�� �r(|j}n t |ttf�r@t|�}n| jj}|sVtd��n|S dS )z>Check the compatibility of the given spatial reference object.z#No source reference system defined.N) r- r r2 �spatial_ref_sys�srs�intr. r/ r )rB r: �srr r r r9 4 s zLayerMapping.check_srsc C sN t |ttf�r(|D ]}|| jvrt�qn"t |t�rB|| jvrJt�ntd��dS )zDCheck the `unique` keyword parameter -- may be a sequence or string.zBUnique keyword argument must be set with a tuple, list, or string.N)r- rG rF r3 rM r. rI )rB r? �attrr r r r> F s �zLayerMapping.check_uniquec C s� i }| j �� D ]�\}}| j| }t|t�rZz| �|j|�}W q� tyV td��Y q�0 n.t|t j j �rx| � |||�}n| � || |�}|||< q|S )z{ Given an OGR Feature, return a dictionary of keyword arguments for constructing the mapped model. z)Could not retrieve geometry from feature.)r3 rT rS r- r � verify_geom�geomr r r �baseZ ModelBase� verify_fk�verify_ogr_field)rB �feat�kwargsra rb rc �valr r r �feature_kwargsW s zLayerMapping.feature_kwargsc s4 t | jt�r | j� | j iS � fdd�| jD �S dS )z� Given the feature keyword arguments (from `feature_kwargs`), construct and return the uniqueness keyword arguments -- a subset of the feature kwargs. c s i | ]}|� | �qS r r )�.0Zfld�rr r r � <dictcomp>� � z.LayerMapping.unique_kwargs.<locals>.<dictcomp>N)r- r? r. )rB rr r rv r � unique_kwargsx s zLayerMapping.unique_kwargsc C s� t |t�r|t |tjtjf�r|| jr<|jdur<t|j| j�}n|j}|jrx|durxt |�|jkrxt d|j |jt |�f ���nt |t ��r<t |tj ��r<ztt|j��}W n ty� td|j ��Y n0 |�� }|d }|d }|j|j }|dk �r t |d|� �} n t |�| } | |k�r6td|j|j|f ��|}nXt |t tf��r�t |tj��r�zt|j�}W n" t�y� td|j ��Y n0 n|j}|S ) z� Verify if the OGR Field contents are acceptable to the model field. If they are, return the verified value, otherwise raise an exception. Nz@%s model field maximum string length is %s, given %s characters.z$Could not construct decimal from: %sr& r' r zeA DecimalField with max_digits %d, decimal_places %d must round to an absolute value less than 10^%d.z$Could not construct integer from: %s)r- r r � CharField� TextFieldr+ �valuer � max_length�lenr! rZ r � DecimalFieldr r. �DecimalInvalidOperationr" �as_tupleZ max_digitsZdecimal_places� IntegerFieldri rM r# ) rB rf rc rs �dZdtup�digitsZd_idxZmax_precZn_precr r r rp � sf ��� ���� � ���� z LayerMapping.verify_ogr_fieldc C sx i }|� � D ]$\}}| �|| |j�|��||< q z |j�| j�jf i |��W S tyr td|j |f ��Y n0 dS )z� Given an OGR Feature, the related model and its dictionary mapping, retrieve the related model for the ForeignKey mapping. z7No ForeignKey %s model found with keyword arguments: %sN) rT rp rU rV �objectsr0 �getr r$ r )rB rq re Z rel_mappingZ fk_kwargsra rb r r r ro � s � ��zLayerMapping.verify_fkc C s` | j |j kr| j |_ | �|j|�rD| j|jj }t|�}|�|� n|}| jrZ|�| j� |jS )z� Verify the geometry -- construct and return a GeometryCollection if necessary (for example if the model field is MultiPolygonField while the mapped shapefile only contains Polygons). ) r] r\ rY � MULTI_TYPES�numr �addr< �wkt)rB rm rc Z multi_type�gr r r rl � s zLayerMapping.verify_geomc C sh | j �� }z*|j�| j�j| jjd�j}t| j |�W S t yb } zt d�|�W Y d}~n d}~0 0 dS )z,Return the coordinate transformation object.)�sridz?Could not translate between the data source and model geometry.N) r2 rg r� r0 r� r8 r� rh r r: � Exceptionr )rB Z SpatialRefSysZ target_srs�excr r r r; s ����z LayerMapping.coord_transformc C s | j j}|�| j�S )zHReturn the GeometryField instance associated with the geographic column.)r4 rU rV rR )rB �optsr r r r7 s zLayerMapping.geometry_fieldc C s |j | jv o |jjd|j kS )z� Given the OGRGeomType for a geometry and its associated GeometryField, determine whether the geometry should be turned into a GeometryCollection. zMulti%s)r� r� rW r �django)rB rY rc r r r r\ s �zLayerMapping.make_multiFc s. �� |�}� r*� du s t� t�s&d�n� �|ddf� ������fdd� } �jdur^��| �} �jj} |�r$t|t��r$|| k �r$|r�td��d\} } } t|| |�}t|�}t |�D ]l\}}|d |kr�t | d�}n t | |�}z| || | �\} } |} W q� t �y �� d d |f � � Y q�0 q�n| � dS ) a� Save the contents from the OGR DataSource Layer into the database according to the mapping dictionary given at initialization. Keyword Parameters: verbose: If set, information will be printed subsequent to each model save executed on the database. fid_range: May be set with a slice or tuple of (begin, end) feature ID's to map from the data source. In other words, this keyword enables the user to selectively import a subset range of features in the geographic data source. step: If set with an integer, transactions will occur at every step interval. For example, if step=1000, a commit would occur after the 1,000th feature, the 2,000th feature etc. progress: When this keyword is set, status information will be printed giving the number of features processed and successfully saved. By default, progress information will pe printed every 1000 features processed, however, this default may be overridden by setting this keyword with an integer for the desired interval. stream: Status information will be written to this file handle. Defaults to using `sys.stdout`, but any object with a `write` method is supported. silent: By default, non-fatal error notifications are printed to stdout, but this keyword may be set to disable these notifications. strict: Execution of the model mapping will cease upon the first error encountered. The default behavior is to attempt to continue. Ti� r c s" | r�j | }n�j }|D �]�}|d7 }z��|�}W nF ty| } z.�rN� n�sf��d|j|f � W Y d }~�n�d }~0 0 d}�j�r<z���|�}�jj� �j �j f i |��} d}t | �j �} | d u r�t |�j �} n(| j} t |�j �} | D ]} | �| � q�t| �j | j� W n$ t�y8 �jf i |��} Y n0 n�jf i |��} z<| j�j d� |d7 }��r���d|�rzdnd| f � W nl t�y� } zR��rȈ�sĈ�d |j � ��d | � � n��s��d ||f � W Y d }~n d }~0 0 � r|� d kr��d ||f � q||fS )Nr& z#Ignoring Feature ID %s because: %s FT)r0 z%s: %s ZUpdatedZSavedzOFailed to save the feature (id: %s) into the model with the keyword arguments: z%s z"Failed to save %s: %s Continuing r z$Processed %d features, saved %d ... )r/ rt r �writeZfidr? ry r4 r� r0 r� �getattrrR r Zogrr� �setattrr� r �saver� )Z feat_range�num_feat� num_savedZ layer_iterrq rr �msgZ is_updateZu_kwargs�mZ geom_valuerm �newr� ��progressZprogress_intervalrB �silent�stream�strict�verboser r �_save_ sr � ��� � �z LayerMapping.save.<locals>._saveNzOThe `step` keyword may not be used in conjunction with the `fid_range` keyword.)r r r r& z %s Failed to save slice: %s z(=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-) rK r- ri rA r/ r� r �ranger~ � enumeraterH r� r� )rB r� rJ �stepr� r� r� r� Z default_ranger� Znfeat�begr� r� �indicesZn_i�i�endZ step_slicer r� r r� $ s< 2 T � � zLayerMapping.save)r Nr) r* TNN)5r r r �__doc__r r� r� r Z AutoFieldr Z BigAutoFieldr ZSmallAutoFieldZ BooleanFieldr r r� Z FloatFieldZ DateFieldr Z DateTimeFieldr Z EmailFieldZ TimeFieldr r rz Z SlugFieldr{ ZURLFieldZ UUIDFieldZBigIntegerFieldZSmallIntegerFieldZPositiveBigIntegerFieldZPositiveIntegerFieldZPositiveSmallIntegerFieldr_ rE rK r5 r9 r> rt ry rp ro rl r; r7 r\ �sys�stdoutr� r r r r r% : st � � � S u! H �r% )*r� r� �decimalr r r� �pathlibr Z django.contrib.gis.db.modelsr Zdjango.contrib.gis.gdalr r r r r r Z django.contrib.gis.gdal.fieldr r r r r r r Zdjango.core.exceptionsr r Z django.dbr r r r Zdjango.utils.encodingr r� r r! r" r# r$ r% r r r r �<module> s $