Your IP : 18.191.44.145
U
e5d�k � @ s| d Z ddlZddlZddlZddlZddlZddlZddlmZ ej
dkrXddl m Z
ndZ
ddlZddlmZmZmZmZ dddhZeed �r�e�ej� e�ej� d
ZeZeed �p�ejjZ d7dd�Z dd� Z z
ej Z W n e k
� r� e Z Y nX G dd� d�Z!G dd� d�Z"z
ej#Z#W n( e k
�rH G dd� de$e%�Z#Y nX G dd� dej&d�Z'ej'�(e'� G d d � d e'�Z)ej)�(e)� dd l*m+Z+ e)�(e+� G d d � d e'�Z,ej,�(e,� G d!d"� d"e,�Z-G d#d$� d$e,�Z.G d%d&� d&e-�Z/G d'd(� d(e-�Z0G d)d*� d*e,�Z1G d+d,� d,e0e/�Z2G d-d.� d.e)�Z+G d/d0� d0e'�Z3ej3�(e3� G d1d2� d2ej4�Z5G d3d4� d4e3�Z6G d5d6� d6e6�Z7dS )8z)
Python implementation of the io module.
� N)�
allocate_lock> �win32�cygwin)�setmode)�__all__�SEEK_SET�SEEK_CUR�SEEK_END� � � SEEK_HOLEi Zgettotalrefcount�r���Tc C s� t | t�st�| �} t | tttf�s0td| ��t |t�sFtd| ��t |t�s\td| ��|dk rzt |t�sztd| ��|dk r�t |t�s�td| ��t|�}|td� s�t|�t|�kr�t d| ��d|k} d |k}
d
|k} d |k} d |k}
d
|k}d|k}d|k�rD| �s"| �s"| �s"|
�r*t d��ddl
}|� dt d� d}
|�rX|�rXt d��| |
| | dk�rvt d��| �s�|
�s�| �s�| �s�t d��|�r�|dk �r�t d��|�r�|dk �r�t d��|�r�|dk �r�t d��|�r|dk�rddl
}|� d t
d� t| | �rd�pd |
�r"d �p$d | �r2d
�p4d | �rBd �pDd |
�rRd �pTd ||d �}|}�z$d }|dk�s�|dk �r�|�� �r�d }d}|dk �r�t}zt�|�� �j}W n ttfk
�r� Y nX |dk�r�|}|dk �r�t d!��|dk�r|�r|W S t d"��|
�r t||�}n<| �s2| �s2| �r>t||�}n |
�rPt||�}n t d#| ��|}|�rl|W S t|||||�}|}||_|W S |�� � Y nX dS )$a� Open file and return a stream. Raise OSError upon failure.
file is either a text or byte string giving the name (and the path
if the file isn't in the current working directory) of the file to
be opened or an integer file descriptor of the file to be
wrapped. (If a file descriptor is given, it is closed when the
returned I/O object is closed, unless closefd is set to False.)
mode is an optional string that specifies the mode in which the file is
opened. It defaults to 'r' which means open for reading in text mode. Other
common values are 'w' for writing (truncating the file if it already
exists), 'x' for exclusive creation of a new file, and 'a' for appending
(which on some Unix systems, means that all writes append to the end of the
file regardless of the current seek position). In text mode, if encoding is
not specified the encoding used is platform dependent. (For reading and
writing raw bytes use binary mode and leave encoding unspecified.) The
available modes are:
========= ===============================================================
Character Meaning
--------- ---------------------------------------------------------------
'r' open for reading (default)
'w' open for writing, truncating the file first
'x' create a new file and open it for writing
'a' open for writing, appending to the end of the file if it exists
'b' binary mode
't' text mode (default)
'+' open a disk file for updating (reading and writing)
'U' universal newline mode (deprecated)
========= ===============================================================
The default mode is 'rt' (open for reading text). For binary random
access, the mode 'w+b' opens and truncates the file to 0 bytes, while
'r+b' opens the file without truncation. The 'x' mode implies 'w' and
raises an `FileExistsError` if the file already exists.
Python distinguishes between files opened in binary and text modes,
even when the underlying operating system doesn't. Files opened in
binary mode (appending 'b' to the mode argument) return contents as
bytes objects without any decoding. In text mode (the default, or when
't' is appended to the mode argument), the contents of the file are
returned as strings, the bytes having been first decoded using a
platform-dependent encoding or using the specified encoding if given.
'U' mode is deprecated and will raise an exception in future versions
of Python. It has no effect in Python 3. Use newline to control
universal newlines mode.
buffering is an optional integer used to set the buffering policy.
Pass 0 to switch buffering off (only allowed in binary mode), 1 to select
line buffering (only usable in text mode), and an integer > 1 to indicate
the size of a fixed-size chunk buffer. When no buffering argument is
given, the default buffering policy works as follows:
* Binary files are buffered in fixed-size chunks; the size of the buffer
is chosen using a heuristic trying to determine the underlying device's
"block size" and falling back on `io.DEFAULT_BUFFER_SIZE`.
On many systems, the buffer will typically be 4096 or 8192 bytes long.
* "Interactive" text files (files for which isatty() returns True)
use line buffering. Other text files use the policy described above
for binary files.
encoding is the str name of the encoding used to decode or encode the
file. This should only be used in text mode. The default encoding is
platform dependent, but any encoding supported by Python can be
passed. See the codecs module for the list of supported encodings.
errors is an optional string that specifies how encoding errors are to
be handled---this argument should not be used in binary mode. Pass
'strict' to raise a ValueError exception if there is an encoding error
(the default of None has the same effect), or pass 'ignore' to ignore
errors. (Note that ignoring encoding errors can lead to data loss.)
See the documentation for codecs.register for a list of the permitted
encoding error strings.
newline is a string controlling how universal newlines works (it only
applies to text mode). It can be None, '', '\n', '\r', and '\r\n'. It works
as follows:
* On input, if newline is None, universal newlines mode is
enabled. Lines in the input can end in '\n', '\r', or '\r\n', and
these are translated into '\n' before being returned to the
caller. If it is '', universal newline mode is enabled, but line
endings are returned to the caller untranslated. If it has any of
the other legal values, input lines are only terminated by the given
string, and the line ending is returned to the caller untranslated.
* On output, if newline is None, any '\n' characters written are
translated to the system default line separator, os.linesep. If
newline is '', no translation takes place. If newline is any of the
other legal values, any '\n' characters written are translated to
the given string.
closedfd is a bool. If closefd is False, the underlying file descriptor will
be kept open when the file is closed. This does not work when a file name is
given and must be True in that case.
The newly created file is non-inheritable.
A custom opener can be used by passing a callable as *opener*. The
underlying file descriptor for the file object is then obtained by calling
*opener* with (*file*, *flags*). *opener* must return an open file
descriptor (passing os.open as *opener* results in functionality similar to
passing None).
open() returns a file object whose type depends on the mode, and
through which the standard file operations such as reading and writing
are performed. When open() is used to open a file in a text mode ('w',
'r', 'wt', 'rt', etc.), it returns a TextIOWrapper. When used to open
a file in a binary mode, the returned class varies: in read binary
mode, it returns a BufferedReader; in write binary and append binary
modes, it returns a BufferedWriter, and in read/write mode, it returns
a BufferedRandom.
It is also possible to use a string or bytearray as a file for both
reading and writing. For strings StringIO can be used like a file
opened in a text mode, and for bytes a BytesIO can be used like a file
opened in a binary mode.
zinvalid file: %rzinvalid mode: %rzinvalid buffering: %rN�invalid encoding: %r�invalid errors: %rzaxrwb+tU�xr
�w�a�+�t�b�Uz4mode U cannot be combined with 'x', 'w', 'a', or '+'r z'U' mode is deprecatedr Tz'can't have text and binary mode at oncer
z)can't have read/write/append mode at oncez/must have exactly one of read/write/append modez-binary mode doesn't take an encoding argumentz+binary mode doesn't take an errors argumentz+binary mode doesn't take a newline argumentzaline buffering (buffering=1) isn't supported in binary mode, the default buffer size will be used� )�openerFr zinvalid buffering sizez can't have unbuffered text I/Ozunknown mode: %r) �
isinstance�int�os�fspath�str�bytes� TypeError�set�len�
ValueError�warnings�warn�DeprecationWarning�RuntimeWarning�FileIO�isatty�DEFAULT_BUFFER_SIZE�fstat�fileno�
st_blksize�OSError�AttributeError�BufferedRandom�BufferedWriter�BufferedReader�
TextIOWrapper�mode�close)�filer4 � buffering�encoding�errors�newline�closefdr ZmodesZcreatingZreadingZwritingZ appendingZupdating�textZbinaryr$ �raw�result�line_bufferingZbs�buffer� rA � /usr/lib64/python3.8/_pyio.py�open) s� {
� ����� �
rC c C s ddl }|�dtd� t| d�S )az Opens the provided file with mode ``'rb'``. This function
should be used when the intent is to treat the contents as
executable code.
``path`` should be an absolute path.
When supported by the runtime, this function can be hooked
in order to allow embedders more control over code files.
This functionality is not supported on the current runtime.
r Nz(_pyio.open_code() may not be using hooksr �rb)r$ r% r' rC )�pathr$ rA rA rB �_open_code_with_warning s �rF c @ s e Zd ZdZddd�ZdS )�
DocDescriptorz%Helper for builtins.open.__doc__
Nc C s
dt j S )Nz\open(file, mode='r', buffering=-1, encoding=None, errors=None, newline=None, closefd=True)
)rC �__doc__)�self�obj�typrA rA rB �__get__ s ��zDocDescriptor.__get__)N)�__name__�
__module__� __qualname__rH rL rA rA rA rB rG s rG c @ s e Zd ZdZe� Zdd� ZdS )� OpenWrapperz�Wrapper for builtins.open
Trick so that open won't become a bound method when stored
as a class variable (as dbm.dumb does).
See initstdio() in Python/pylifecycle.c.
c O s
t ||�S �N)rC )�cls�args�kwargsrA rA rB �__new__, s zOpenWrapper.__new__N)rM rN rO rH rG rU rA rA rA rB rP " s rP c @ s e Zd ZdS )�UnsupportedOperationN)rM rN rO rA rA rA rB rV 5 s rV c @ s� e Zd ZdZdd� Zd6dd�Zdd� Zd7d
d �Zd d
� ZdZ dd� Z
dd� Z dd� Z d8dd�Z
dd� Zd9dd�Zdd � Zd:d d �Zed d � �Zd;d!d"�Zd#d$� Zd%d&� Zd'd(� Zd)d*� Zd<d,d-�Zd.d/� Zd0d1� Zd=d2d3�Z d4d5� Z d S )>�IOBasea The abstract base class for all I/O classes, acting on streams of
bytes. There is no public constructor.
This class provides dummy implementations for many methods that
derived classes can override selectively; the default implementations
represent a file that cannot be read, written or seeked.
Even though IOBase does not declare read or write because
their signatures will vary, implementations and clients should
consider those methods part of the interface. Also, implementations
may raise UnsupportedOperation when operations they do not support are
called.
The basic type used for binary data read from or written to a file is
bytes. Other bytes-like objects are accepted as method arguments too.
Text I/O classes work with str data.
Note that calling any method (even inquiries) on a closed stream is
undefined. Implementations may raise OSError in this case.
IOBase (and its subclasses) support the iterator protocol, meaning
that an IOBase object can be iterated over yielding the lines in a
stream.
IOBase also supports the :keyword:`with` statement. In this example,
fp is closed after the suite of the with statement is complete:
with open('spam.txt', 'r') as fp:
fp.write('Spam and eggs!')
c C s t d| jj|f ��dS )z@Internal: raise an OSError exception for unsupported operations.z%s.%s() not supportedN)rV � __class__rM )rI �namerA rA rB � _unsupported\ s
�zIOBase._unsupportedr c C s | � d� dS )a$ Change stream position.
Change the stream position to byte offset pos. Argument pos is
interpreted relative to the position indicated by whence. Values
for whence are ints:
* 0 -- start of stream (the default); offset should be zero or positive
* 1 -- current stream position; offset may be negative
* 2 -- end of stream; offset is usually negative
Some operating systems / file systems could provide additional values.
Return an int indicating the new absolute position.
�seekN�rZ �rI �pos�whencerA rA rB r[ c s z IOBase.seekc C s | � dd�S )z5Return an int indicating the current stream position.r r
)r[ �rI rA rA rB �tells s z IOBase.tellNc C s | � d� dS )z�Truncate file to size bytes.
Size defaults to the current IO position as reported by tell(). Return
the new size.
�truncateNr\ �rI r^ rA rA rB rb w s zIOBase.truncatec C s | � � dS )zuFlush write buffers, if applicable.
This is not implemented for read-only and non-blocking streams.
N�� _checkClosedr` rA rA rB �flush� s z IOBase.flushFc C s | j s z | �� W 5 d| _ X dS )ziFlush and close the IO object.
This method has no effect if the file is already closed.
TN)�_IOBase__closedrf r` rA rA rB r5 � s z IOBase.closec C sV z
| j }W n tk
r Y dS X |r*dS tr8| �� nz | �� W n Y nX dS )zDestructor. Calls close().N)�closedr/ �_IOBASE_EMITS_UNRAISABLEr5 )rI rh rA rA rB �__del__� s
zIOBase.__del__c C s dS )z�Return a bool indicating whether object supports random access.
If False, seek(), tell() and truncate() will raise OSError.
This method may need to do a test seek().
FrA r` rA rA rB �seekable� s zIOBase.seekablec C s | � � s t|dkrdn|��dS )zEInternal: raise UnsupportedOperation if file is not seekable
Nz File or stream is not seekable.)rk rV �rI �msgrA rA rB �_checkSeekable� s ��zIOBase._checkSeekablec C s dS )zvReturn a bool indicating whether object was opened for reading.
If False, read() will raise OSError.
FrA r` rA rA rB �readable� s zIOBase.readablec C s | � � s t|dkrdn|��dS )zEInternal: raise UnsupportedOperation if file is not readable
Nz File or stream is not readable.)ro rV rl rA rA rB �_checkReadable� s ��zIOBase._checkReadablec C s dS )z�Return a bool indicating whether object was opened for writing.
If False, write() and truncate() will raise OSError.
FrA r` rA rA rB �writable� s zIOBase.writablec C s | � � s t|dkrdn|��dS )zEInternal: raise UnsupportedOperation if file is not writable
Nz File or stream is not writable.)rq rV rl rA rA rB �_checkWritable� s ��zIOBase._checkWritablec C s | j S )z�closed: bool. True iff the file has been closed.
For backwards compatibility, this is a property, not a predicate.
)rg r` rA rA rB rh � s z
IOBase.closedc C s | j rt|dkrdn|��dS )z7Internal: raise a ValueError if file is closed
N� I/O operation on closed file.�rh r# rl rA rA rB re � s ��zIOBase._checkClosedc C s | � � | S )zCContext management protocol. Returns self (an instance of IOBase).rd r` rA rA rB � __enter__� s zIOBase.__enter__c G s | � � dS )z+Context management protocol. Calls close()N)r5 )rI rS rA rA rB �__exit__� s zIOBase.__exit__c C s | � d� dS )z�Returns underlying file descriptor (an int) if one exists.
An OSError is raised if the IO object does not use a file descriptor.
r, Nr\ r` rA rA rB r, � s z
IOBase.filenoc C s | � � dS )z{Return a bool indicating whether this is an 'interactive' stream.
Return False if it can't be determined.
Frd r` rA rA rB r) s z
IOBase.isattyr c s� t � d�r� �fdd�}ndd� }�dkr0d�n4z
�j}W n" tk
r\ t��d���Y nX |� �t� }�dk s~t|��k r�� �|� �}|s�q�||7 }|�d �rjq�qjt|�S )
aN Read and return a line of bytes from the stream.
If size is specified, at most size bytes will be read.
Size should be an int.
The line terminator is always b'\n' for binary files; for text
files, the newlines argument to open can be used to select the line
terminator(s) recognized.
�peekc s> � � d�} | sdS | �d�d p&t| �}�dkr:t|��}|S )Nr
�
r )rw �findr" �min)Z readahead�n�rI �sizerA rB �
nreadahead s
z#IOBase.readline.<locals>.nreadaheadc S s dS �Nr
rA rA rA rA rB r~ s Nr � is not an integerr rx ) �hasattr� __index__r/ r � bytearrayr" �read�endswithr )rI r} r~ �
size_index�resr rA r| rB �readline s&
zIOBase.readlinec C s | � � | S rQ rd r` rA rA rB �__iter__5 s zIOBase.__iter__c C s | � � }|st�|S rQ )r� �
StopIteration�rI �linerA rA rB �__next__9 s zIOBase.__next__c C sP |dks|dkrt | �S d}g }| D ]&}|�|� |t|�7 }||kr$ qLq$|S )z�Return a list of lines from the stream.
hint can be specified to control the number of lines read: no more
lines will be read if the total size (in bytes/characters) of all
lines so far exceeds hint.
Nr )�list�appendr" )rI Zhintr{ �linesr� rA rA rB � readlines? s
zIOBase.readlinesc C s | � � |D ]}| �|� q dS )z�Write a list of lines to the stream.
Line separators are not added, so it is usual for each of the lines
provided to have a line separator at the end.
N)re �write)rI r� r� rA rA rB �
writelinesQ s zIOBase.writelines)r )N)N)N)N)N)r )N) rM rN rO rH rZ r[ ra rb rf rg r5 rj rk rn ro rp rq rr �propertyrh re ru rv r, r) r� r� r� r� r� rA rA rA rB rW 9 s6 !
*
rW )� metaclassc @ s2 e Zd ZdZd dd�Zdd� Zdd� Zd d
� Zd S )
� RawIOBasez Base class for raw binary I/O.r c C sP |dkr d}|dk r | � � S t|�� �}| �|�}|dkr>dS ||d�= t|�S )z�Read and return up to size bytes, where size is an int.
Returns an empty bytes object on EOF, or None if the object is
set not to block and has no data to read.
Nr r )�readallr� r� �readintor )rI r} r r{ rA rA rB r� l s
zRawIOBase.readc C s4 t � }| �t�}|sq ||7 }q|r,t|�S |S dS )z+Read until EOF, using multiple read() call.N)r� r� r* r )rI r� �datarA rA rB r� } s
zRawIOBase.readallc C s | � d� dS )z�Read bytes into a pre-allocated bytes-like object b.
Returns an int representing the number of bytes read (0 for EOF), or
None if the object is set not to block and has no data to read.
r� Nr\ �rI r rA rA rB r� � s zRawIOBase.readintoc C s | � d� dS )z�Write the given buffer to the IO stream.
Returns the number of bytes written, which may be less than the
length of b in bytes.
r� Nr\ r� rA rA rB r� � s zRawIOBase.writeN)r )rM rN rO rH r� r� r� r� rA rA rA rB r� ^ s
r� )r( c @ sL e Zd ZdZddd�Zddd�Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dS )�BufferedIOBasea Base class for buffered IO objects.
The main difference with RawIOBase is that the read() method
supports omitting the size argument, and does not have a default
implementation that defers to readinto().
In addition, read(), readinto() and write() may raise
BlockingIOError if the underlying raw stream is in non-blocking
mode and not ready; unlike their raw counterparts, they will never
return None.
A typical implementation should not inherit from a RawIOBase
implementation, but wrap one.
r c C s | � d� dS )a� Read and return up to size bytes, where size is an int.
If the argument is omitted, None, or negative, reads and
returns all data until EOF.
If the argument is positive, and the underlying raw stream is
not 'interactive', multiple raw reads may be issued to satisfy
the byte count (unless EOF is reached first). But for
interactive raw streams (XXX and for pipes?), at most one raw
read will be issued, and a short result does not imply that
EOF is imminent.
Returns an empty bytes array on EOF.
Raises BlockingIOError if the underlying raw stream has no
data at the moment.
r� Nr\ r| rA rA rB r� � s zBufferedIOBase.readc C s | � d� dS )zaRead up to size bytes with at most one read() system call,
where size is an int.
�read1Nr\ r| rA rA rB r� � s zBufferedIOBase.read1c C s | j |dd�S )af Read bytes into a pre-allocated bytes-like object b.
Like read(), this may issue multiple reads to the underlying raw
stream, unless the latter is 'interactive'.
Returns an int representing the number of bytes read (0 for EOF).
Raises BlockingIOError if the underlying raw stream has no
data at the moment.
F�r� �� _readintor� rA rA rB r� � s zBufferedIOBase.readintoc C s | j |dd�S )z�Read bytes into buffer *b*, using at most one system call
Returns an int representing the number of bytes read (0 for EOF).
Raises BlockingIOError if the underlying raw stream has no
data at the moment.
Tr� r� r� rA rA rB � readinto1� s zBufferedIOBase.readinto1c C sV t |t�st|�}|�d�}|r0| �t|��}n| �t|��}t|�}||d |�< |S )N�B)r �
memoryview�castr� r" r� )rI r r� r� r{ rA rA rB r� � s
zBufferedIOBase._readintoc C s | � d� dS )a Write the given bytes buffer to the IO stream.
Return the number of bytes written, which is always the length of b
in bytes.
Raises BlockingIOError if the buffer is full and the
underlying raw stream cannot accept more data at the moment.
r� Nr\ r� rA rA rB r� � s zBufferedIOBase.writec C s | � d� dS )z�
Separate the underlying raw stream from the buffer and return it.
After the raw stream has been detached, the buffer is in an unusable
state.
�detachNr\ r` rA rA rB r� � s zBufferedIOBase.detachN)r )r ) rM rN rO rH r� r� r� r� r� r� r� rA rA rA rB r� � s
r� c @ s� e Zd ZdZdd� Zd$dd�Zdd� Zd%d
d �Zd d
� Zdd� Z dd� Z
dd� Z e dd� �Z
e dd� �Ze dd� �Ze dd� �Zd d � Zd d � Zd d!� Zd"d#� Zd S )&�_BufferedIOMixinz�A mixin implementation of BufferedIOBase with an underlying raw stream.
This passes most requests on to the underlying raw stream. It
does *not* provide implementations of read(), readinto() or
write().
c C s
|| _ d S rQ ��_raw�rI r= rA rA rB �__init__ s z_BufferedIOMixin.__init__r c C s" | j �||�}|dk r td��|S )Nr z#seek() returned an invalid position)r= r[ r. )rI r^ r_ Z new_positionrA rA rB r[ s z_BufferedIOMixin.seekc C s | j �� }|dk rtd��|S )Nr z#tell() returned an invalid position)r= ra r. rc rA rA rB ra s
z_BufferedIOMixin.tellNc C s$ | � � |d kr| �� }| j�|�S rQ )rf ra r= rb rc rA rA rB rb $ s z_BufferedIOMixin.truncatec C s | j rtd��| j�� d S )N�flush on closed file)rh r# r= rf r` rA rA rB rf 2 s z_BufferedIOMixin.flushc C s. | j d k r*| js*z | �� W 5 | j �� X d S rQ )r= rh r5 rf r` rA rA rB r5 7 s z_BufferedIOMixin.closec C s* | j d krtd��| �� | j}d | _|S )Nzraw stream already detached)r= r# rf r� r� rA rA rB r� ? s
z_BufferedIOMixin.detachc C s
| j �� S rQ )r= rk r` rA rA rB rk I s z_BufferedIOMixin.seekablec C s | j S rQ r� r` rA rA rB r= L s z_BufferedIOMixin.rawc C s | j jS rQ )r= rh r` rA rA rB rh P s z_BufferedIOMixin.closedc C s | j jS rQ )r= rY r` rA rA rB rY T s z_BufferedIOMixin.namec C s | j jS rQ )r= r4 r` rA rA rB r4 X s z_BufferedIOMixin.modec C s t d| jj�d���d S �Nzcannot pickle z object�r rX rM r` rA rA rB � __getstate__\ s z _BufferedIOMixin.__getstate__c C sN | j j}| j j}z
| j}W n tk
r: d�||� Y S X d�|||�S d S )Nz<{}.{}>z<{}.{} name={!r}>)rX rN rO rY r/ �format)rI �modnameZclsnamerY rA rA rB �__repr___ s
z_BufferedIOMixin.__repr__c C s
| j �� S rQ )r= r, r` rA rA rB r, k s z_BufferedIOMixin.filenoc C s
| j �� S rQ )r= r) r` rA rA rB r) n s z_BufferedIOMixin.isatty)r )N)rM rN rO rH r� r[ ra rb rf r5 r� rk r� r= rh rY r4 r� r� r, r) rA rA rA rB r�
s*
r� c s� e Zd ZdZdZd!dd�Zdd� Zdd� Zd d
� Z� fd d �Z d"dd�Z
d#dd�Z dd� Z d$dd�Z
dd� Zd%dd�Zdd � Zd d � Zd d � Z� ZS )&�BytesIOz<Buffered I/O implementation using an in-memory bytes buffer.Nc C s& t � }|d k r||7 }|| _d| _d S �Nr )r� �_buffer�_pos)rI Z
initial_bytes�bufrA rA rB r� z s
zBytesIO.__init__c C s | j rtd��| j�� S )Nz__getstate__ on closed file)rh r# �__dict__�copyr` rA rA rB r� � s zBytesIO.__getstate__c C s | j rtd��t| j�S )z8Return the bytes value (contents) of the buffer
zgetvalue on closed file)rh r# r r� r` rA rA rB �getvalue� s zBytesIO.getvaluec C s | j rtd��t| j�S )z;Return a readable and writable view of the buffer.
zgetbuffer on closed file)rh r# r� r� r` rA rA rB � getbuffer� s zBytesIO.getbufferc s" | j d k r| j �� t� �� d S rQ )r� �clear�superr5 r` �rX rA rB r5 � s
z
BytesIO.closer c C s� | j rtd��|d kr d}n4z
|j}W n" tk
rH t|�d���Y nX |� }|dk rbt| j�}t| j�| jkrvdS tt| j�| j| �}| j| j|� }|| _t |�S )N�read from closed filer r� r � )
rh r# r� r/ r r" r� r� rz r )rI r} r� Znewposr rA rA rB r� � s"
z BytesIO.readc C s
| � |�S )z"This is the same as read.
)r� r| rA rA rB r� � s z
BytesIO.read1c C s� | j rtd��t|t�r td��t|�� }|j}W 5 Q R X |dkrFdS | j}|t| j �krzd|t| j � }| j |7 _ || j ||| �< | j|7 _|S )N�write to closed file� can't write str to binary streamr � )
rh r# r r r r� �nbytesr� r" r� )rI r Zviewr{ r^ ZpaddingrA rA rB r� � s
z
BytesIO.writer c C s� | j rtd��z
|j}W n" tk
r: t|�d���Y nX |� }|dkrh|dk r`td|f ��|| _nD|dkr�td| j| �| _n(|dkr�tdt| j�| �| _ntd��| jS )Nzseek on closed filer� r �negative seek position %rr
r zunsupported whence value) rh r# r� r/ r r� �maxr" r� )rI r^ r_ � pos_indexrA rA rB r[ � s"
z BytesIO.seekc C s | j rtd��| jS )N�tell on closed file)rh r# r� r` rA rA rB ra � s z BytesIO.tellc C sx | j rtd��|d kr | j}nJz
|j}W n" tk
rJ t|�d���Y nX |� }|dk rhtd|f ��| j|d �= |S )Nztruncate on closed filer� r z negative truncate position %r)rh r# r� r� r/ r r� )rI r^ r� rA rA rB rb � s
zBytesIO.truncatec C s | j rtd��dS �Nrs Trt r` rA rA rB ro � s zBytesIO.readablec C s | j rtd��dS r� rt r` rA rA rB rq � s zBytesIO.writablec C s | j rtd��dS r� rt r` rA rA rB rk � s zBytesIO.seekable)N)r )r )r )N)rM rN rO rH r� r� r� r� r� r5 r� r� r� r[ ra rb ro rq rk �
__classcell__rA rA r� rB r� r s
r� c @ sx e Zd ZdZefdd�Zdd� Zdd� Zdd d
�Zd d d �Z d dd�Z
d dd�Z d dd�Z dd� Z
dd� Zd dd�ZdS )!r2 a BufferedReader(raw[, buffer_size])
A buffer for a readable, sequential BaseRawIO object.
The constructor creates a BufferedReader for the given readable raw
stream and buffer_size. If buffer_size is omitted, DEFAULT_BUFFER_SIZE
is used.
c C sF |� � std��t�| |� |dkr,td��|| _| �� t� | _dS )zMCreate a new buffered reader using the given readable raw IO object.
z "raw" argument must be readable.r �invalid buffer sizeN) ro r. r� r� r# � buffer_size�_reset_read_buf�Lock�
_read_lock�rI r= r� rA rA rB r� s zBufferedReader.__init__c C s
| j �� S rQ )r= ro r` rA rA rB ro s zBufferedReader.readablec C s d| _ d| _d S )Nr� r )� _read_buf� _read_posr` rA rA rB r� s z BufferedReader._reset_read_bufNc
C s@ |dk r|dk rt d��| j� | �|�W 5 Q R � S Q R X dS )z�Read size bytes.
Returns exactly size bytes of data unless the underlying raw IO
stream reaches EOF or if the call would block in non-blocking
mode. If size is negative, read until EOF or until read() would
block.
Nr z invalid number of bytes to read)r# r� �_read_unlockedr| rA rA rB r� s zBufferedReader.readc C s� d}d}| j }| j}|d ks$|dkr�| �� t| jd�rj| j�� }|d krZ||d � pXd S ||d � | S ||d � g}d}| j�� }||kr�|}q�|t|�7 }|�|� q|d� |�p�|S t|�| } || kr�| j|7 _|||| � S ||d � g}t
| j |�}
| |k �rH| j�|
�}||k�r.|}�qH| t|�7 } |�|� �qt || �}d� |�} | |d � | _ d| _| �r�| d |� S |S )Nr� )r� Nr r� r )
r� r� r� r� r= r� r� r" r� �joinr� r� rz ) rI r{ Z
nodata_valZ empty_valuesr� r^ �chunkZchunksZ current_size�availZwanted�outrA rA rB r� - sL
z BufferedReader._read_unlockedr c
C s( | j � | �|�W 5 Q R � S Q R X dS )z�Returns buffered bytes without advancing the position.
The argument indicates a desired minimal number of bytes; we
do at most one raw read to satisfy it. We never return more
than self.buffer_size.
N)r� �_peek_unlockedr| rA rA rB rw a s zBufferedReader.peekc C sr t || j�}t| j�| j }||k s,|dkrb| j| }| j�|�}|rb| j| jd � | | _d| _| j| jd � S r� )rz r� r" r� r� r= r� )rI r{ ZwantZhaveZto_readZcurrentrA rA rB r� k s
z BufferedReader._peek_unlockedr c
C s^ |dk r| j }|dkrdS | j�4 | �d� | �t|t| j�| j ��W 5 Q R � S Q R X dS )z<Reads up to size bytes, with at most one read() system call.r r� r
N)r� r� r� r� rz r" r� r� r| rA rA rB r� v s
�zBufferedReader.read1c C s
t |t�st|�}|jdkr dS |�d�}d}| j�� |t|�k r�tt| j�| j t|��}|r�| j| j| j| � |||| �< | j|7 _||7 }|t|�kr�q�t|�| | j kr�| j
� ||d� �}|s�q�||7 }n|r�|s�| � d�s�q�|r6|r6q�q6W 5 Q R X |S )z2Read data into *buf* with at most one system call.r r� Nr
)
r r� r� r� r� r" rz r� r� r� r= r� r� )rI r� r� �writtenr� r{ rA rA rB r� � s6
�
zBufferedReader._readintoc C s t �| �t| j� | j S rQ )r� ra r" r� r� r` rA rA rB ra � s zBufferedReader.tellc
C sd |t krtd��| j�D |dkr4|t| j�| j 8 }t�| ||�}| �� |W 5 Q R � S Q R X d S )N�invalid whence valuer
) �valid_seek_flagsr# r� r" r� r� r� r[ r� r] rA rA rB r[ � s zBufferedReader.seek)N)N)r )r )r )r )rM rN rO rH r* r� ro r� r� r� rw r� r� r� ra r[ rA rA rA rB r2 s
4
.r2 c @ s` e Zd ZdZefdd�Zdd� Zdd� Zdd d
�Zd d � Z d
d� Z
dd� Z ddd�Z dd� Z
dS )r1 z�A buffer for a writeable sequential RawIO object.
The constructor creates a BufferedWriter for the given writeable raw
stream. If the buffer_size is not given, it defaults to
DEFAULT_BUFFER_SIZE.
c C sF |� � std��t�| |� |dkr,td��|| _t� | _t� | _ d S )Nz "raw" argument must be writable.r r� )
rq r. r� r� r# r� r� �
_write_bufr� � _write_lockr� rA rA rB r� � s zBufferedWriter.__init__c C s
| j �� S rQ )r= rq r` rA rA rB rq � s zBufferedWriter.writablec C s t |t�rtd��| j�� | jr(td��t| j�| jkr@| � � t| j�}| j�
|� t| j�| }t| j�| jkr�z | � � W nl t k
r� } zNt| j�| jkr�t| j�| j }||8 }| jd | j� | _t |j |j
|��W 5 d }~X Y nX |W 5 Q R � S Q R X d S )Nr� r� )r r r r� rh r# r" r� r� �_flush_unlocked�extend�BlockingIOError�errno�strerror)rI r Zbeforer� �eZoveragerA rA rB r� � s(
"zBufferedWriter.writeNc
C sD | j �4 | �� |d kr"| j�� }| j�|�W 5 Q R � S Q R X d S rQ )r� r� r= ra rb rc rA rA rB rb � s
zBufferedWriter.truncatec C s | j � | �� W 5 Q R X d S rQ )r� r� r` rA rA rB rf � s zBufferedWriter.flushc C s� | j rtd��| jr�z| j�| j�}W n tk
rB td��Y nX |d krZttjdd��|t | j�ksp|dk rxt
d��| jd |�= qd S )Nr� zHself.raw should implement RawIOBase: it should not raise BlockingIOErrorz)write could not complete without blockingr z*write() returned incorrect number of bytes) rh r# r� r= r� r� � RuntimeErrorr� ZEAGAINr" r. �rI r{ rA rA rB r� s �z BufferedWriter._flush_unlockedc C s t �| �t| j� S rQ )r� ra r" r� r` rA rA rB ra s zBufferedWriter.tellr c
C sD |t krtd��| j�$ | �� t�| ||�W 5 Q R � S Q R X d S )Nr� )r� r# r� r� r� r[ r] rA rA rB r[ s
zBufferedWriter.seekc C s` | j �$ | jd ks| jr&W 5 Q R � d S W 5 Q R X z | �� W 5 | j � | j�� W 5 Q R X X d S rQ )r� r= rh r5 rf r` rA rA rB r5 s zBufferedWriter.close)N)r )rM rN rO rH r* r� rq r� rb rf r� ra r[ r5 rA rA rA rB r1 � s
r1 c @ s� e Zd ZdZefdd�Zd dd�Zdd� Zd d
� Zd d d
�Z d!dd�Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd� Zed d � �Zd S )"�BufferedRWPaira� A buffered reader and writer object together.
A buffered reader object and buffered writer object put together to
form a sequential IO object that can read and write. This is typically
used with a socket or two-way pipe.
reader and writer are RawIOBase objects that are readable and
writeable respectively. If the buffer_size is omitted it defaults to
DEFAULT_BUFFER_SIZE.
c C s< |� � std��|�� s td��t||�| _t||�| _dS )zEConstructor.
The arguments are two RawIO instances.
z#"reader" argument must be readable.z#"writer" argument must be writable.N)ro r. rq r2 �readerr1 �writer)rI r� r� r� rA rA rB r� < s zBufferedRWPair.__init__r c C s |d kr d}| j �|�S �Nr )r� r� r| rA rA rB r� J s zBufferedRWPair.readc C s | j �|�S rQ )r� r� r� rA rA rB r� O s zBufferedRWPair.readintoc C s | j �|�S rQ )r� r� r� rA rA rB r� R s zBufferedRWPair.writer c C s | j �|�S rQ )r� rw r| rA rA rB rw U s zBufferedRWPair.peekc C s | j �|�S rQ )r� r� r| rA rA rB r� X s zBufferedRWPair.read1c C s | j �|�S rQ )r� r� r� rA rA rB r� [ s zBufferedRWPair.readinto1c C s
| j �� S rQ )r� ro r` rA rA rB ro ^ s zBufferedRWPair.readablec C s
| j �� S rQ )r� rq r` rA rA rB rq a s zBufferedRWPair.writablec C s
| j �� S rQ )r� rf r` rA rA rB rf d s zBufferedRWPair.flushc C s z| j�� W 5 | j �� X d S rQ )r� r5 r� r` rA rA rB r5 g s zBufferedRWPair.closec C s | j �� p| j�� S rQ )r� r) r� r` rA rA rB r) m s zBufferedRWPair.isattyc C s | j jS rQ )r� rh r` rA rA rB rh p s zBufferedRWPair.closedN)r )r )r )rM rN rO rH r* r� r� r� r� rw r� r� ro rq rf r5 r) r� rh rA rA rA rB r� , s
r� c @ sn e Zd ZdZefdd�Zddd�Zdd� Zdd
d �Zdd d
�Z dd� Z
d dd�Z d dd�Z dd� Z
dd� Zd S ) r0 z�A buffered interface to random access streams.
The constructor creates a reader and writer for a seekable stream,
raw, given in the first argument. If the buffer_size is omitted it
defaults to DEFAULT_BUFFER_SIZE.
c C s( |� � t�| ||� t�| ||� d S rQ )rn r2 r� r1 r� rA rA rB r� ~ s zBufferedRandom.__init__r c C s� |t krtd��| �� | jrJ| j� | j�| jt| j� d� W 5 Q R X | j�||�}| j� | � � W 5 Q R X |dk r�t
d��|S )Nr� r
r z seek() returned invalid position) r� r# rf r� r� r= r[ r� r" r� r. r] rA rA rB r[ � s $zBufferedRandom.seekc C s | j rt�| �S t�| �S d S rQ )r� r1 ra r2 r` rA rA rB ra � s
zBufferedRandom.tellNc C s |d kr| � � }t�| |�S rQ )ra r1 rb rc rA rA rB rb � s zBufferedRandom.truncatec C s |d kr d}| � � t�| |�S r� )rf r2 r� r| rA rA rB r� � s zBufferedRandom.readc C s | � � t�| |�S rQ )rf r2 r� r� rA rA rB r� � s zBufferedRandom.readintoc C s | � � t�| |�S rQ )rf r2 rw r| rA rA rB rw � s zBufferedRandom.peekr c C s | � � t�| |�S rQ )rf r2 r� r| rA rA rB r� � s zBufferedRandom.read1c C s | � � t�| |�S rQ )rf r2 r� r� rA rA rB r� � s zBufferedRandom.readinto1c C sF | j r:| j�( | j�| jt| j � d� | �� W 5 Q R X t�| |�S r ) r� r� r= r[ r� r" r� r1 r� r� rA rA rB r� � s
zBufferedRandom.write)r )N)N)r )r )rM rN rO rH r* r� r[ ra rb r� r� rw r� r� r� rA rA rA rB r0 u s
r0 c s� e Zd ZdZdZdZdZdZdZdZ d0dd�Z
dd � Z d
d � Z d d
� Z
dd� Zd1dd�Zd2dd�Zdd� Zdd� Zdd� Zefdd�Zd d � Zd3d d �Z� fd d!�Zd"d#� Zd$d%� Zd&d'� Zd(d)� Z d*d+� Z e d,d-� �Z e d.d/� �Z � Z!S )4r( r FNTr
c
C sB | j dkr*z| jr t�| j � W 5 d| _ X t|t�r<td��t|t�r\|}|dk r`td��nd}t|t �sxtd|f ��t
|�t
d�ks�td|f ��t dd� |D ��d ks�|� d
�d kr�td ��d |kr�d
| _
d
| _tjtjB }nTd|kr�d
| _d}n@d|k�rd
| _tjtjB }n"d|k�r8d
| _d
| _tjtjB }d
|k�rNd
| _d
| _| j�rj| j�rj|tjO }n | j�r~|tjO }n
|tjO }|ttdd�O }ttdd��p�ttdd�}||O }d}�zT|dk �r:|�s�td��|dk�r�t�||d�}n0|||�}t|t��std��|dk �r$td��|}|�s:t�|d� || _t� |�} z(t � | j ��rpt t!j"t�#t!j"�|��W n t$k
�r� Y nX t| dd�| _%| j%d k�r�t&| _%t'�r�t'|tj(� || _)| j�rzt�*|dt+� W n4 tk
�r }
z|
j!t!j,k�r � W 5 d}
~
X Y nX W n" |dk �r0t�|� � Y nX || _ dS )ad Open a file. The mode can be 'r' (default), 'w', 'x' or 'a' for reading,
writing, exclusive creation or appending. The file will be created if it
doesn't exist when opened for writing or appending; it will be truncated
when opened for writing. A FileExistsError will be raised if it already
exists when opened for creating. Opening a file for creating implies
writing so this mode behaves in a similar way to 'w'. Add a '+' to the mode
to allow simultaneous reading and writing. A custom opener can be used by
passing a callable as *opener*. The underlying file descriptor for the file
object is then obtained by calling opener with (*name*, *flags*).
*opener* must return an open file descriptor (passing os.open as *opener*
results in functionality similar to passing None).
r r z$integer argument expected, got floatznegative file descriptorzinvalid mode: %szxrwab+c s s | ]}|d kV qdS )ZrwaxNrA )�.0�crA rA rB � <genexpr>� s z"FileIO.__init__.<locals>.<genexpr>r
r zKMust have exactly one of create/read/write/append mode and at most one plusr Tr
r r �O_BINARYZ O_NOINHERIT� O_CLOEXECNz'Cannot use closefd=False with file namei� z expected integer from openerzNegative file descriptorFr- )-�_fd�_closefdr r5 r �floatr r r# r r! �sum�count�_created� _writable�O_EXCL�O_CREAT� _readable�O_TRUNC�
_appending�O_APPEND�O_RDWR�O_RDONLY�O_WRONLY�getattrrC r. �set_inheritabler+ �stat�S_ISDIR�st_mode�IsADirectoryErrorr� ZEISDIRr� r/ �_blksizer* �_setmoder� rY �lseekr ZESPIPE) rI r6 r4 r; r �fd�flagsZnoinherit_flagZowned_fdZfdfstatr� rA rA rB r� � s�
$
�
�
zFileIO.__init__c C sB | j dkr>| jr>| js>dd l}|jd| f td| d� | �� d S )Nr zunclosed file %rr )�
stacklevel�source)r� r� rh r$ r% �ResourceWarningr5 )rI r$ rA rA rB rj A s �zFileIO.__del__c C s t d| jj�d���d S r� r� r` rA rA rB r� H s zFileIO.__getstate__c C sp d| j j| j jf }| jr"d| S z
| j}W n* tk
rV d|| j| j| jf Y S X d||| j| jf S d S )Nz%s.%sz
<%s [closed]>z <%s fd=%d mode=%r closefd=%r>z <%s name=%r mode=%r closefd=%r>) rX rN rO rh rY r/ r� r4 r� )rI �
class_namerY rA rA rB r� K s �
�
�zFileIO.__repr__c C s | j std��d S )NzFile not open for reading)r� rV r` rA rA rB rp Y s zFileIO._checkReadablec C s | j std��d S )NzFile not open for writing)r� rV rl rA rA rB rr ] s zFileIO._checkWritablec C sT | � � | �� |dks |dk r(| �� S zt�| j|�W S tk
rN Y dS X dS )z�Read at most size bytes, returned as bytes.
Only makes one system call, so less data may be returned than requested
In non-blocking mode, returns None if no data is available.
Return an empty bytes object at EOF.
Nr )re rp r� r r� r� r� r| rA rA rB r� a s z FileIO.readc C s� | � � | �� t}z6t�| jdt�}t�| j�j}||krH|| d }W n t k
r^ Y nX t
� }t |�|kr�t |�}|t |t�7 }|t |� }zt�
| j|�}W n tk
r� |r�Y q�Y dS X |s�q�||7 }qft|�S )z�Read all data from the file, returned as bytes.
In non-blocking mode, returns as much as is immediately available,
or None if no data is available. Return an empty bytes object at EOF.
r r
N)re rp r* r r r� r r+ �st_sizer. r� r" r� r� r� r )rI �bufsizer^ �endr> r{ r� rA rA rB r� q s2
zFileIO.readallc C s4 t |��d�}| �t|��}t|�}||d|�< |S )z Same as RawIOBase.readinto().r� N)r� r� r� r" )rI r �mr� r{ rA rA rB r� � s
zFileIO.readintoc C s< | � � | �� zt�| j|�W S tk
r6 Y dS X dS )a Write bytes b to file, return number written.
Only makes one system call, so not all of the data may be written.
The number of bytes actually written is returned. In non-blocking mode,
returns None if the write would block.
N)re rr r r� r� r� r� rA rA rB r� � s z FileIO.writec C s* t |t�rtd��| �� t�| j||�S )a� Move to new file position.
Argument offset is a byte count. Optional argument whence defaults to
SEEK_SET or 0 (offset from start of file, offset should be >= 0); other values
are SEEK_CUR or 1 (move relative to current position, positive or negative),
and SEEK_END or 2 (move relative to end of file, usually negative, although
many platforms allow seeking beyond the end of a file).
Note that not all file objects are seekable.
zan integer is required)r r� r re r r r� r] rA rA rB r[ � s
z FileIO.seekc C s | � � t�| jdt�S )zYtell() -> int. Current file position.
Can raise OSError for non seekable files.r )re r r r� r r` rA rA rB ra � s z FileIO.tellc C s2 | � � | �� |dkr | �� }t�| j|� |S )z�Truncate the file to at most size bytes.
Size defaults to the current file position, as returned by tell().
The current file position is changed to the value of size.
N)re rr ra r � ftruncater� r| rA rA rB rb � s zFileIO.truncatec s. | j s*z| jrt�| j� W 5 t� �� X dS )z�Close the file.
A closed file cannot be used for further I/O operations. close() may be
called more than once without error.
N)rh r� r5 r� r r� r` r� rA rB r5 � s
z FileIO.closec C sF | � � | jdkr@z | �� W n tk
r8 d| _Y nX d| _| jS )z$True if file supports random-access.NFT)re � _seekablera r. r` rA rA rB rk � s
zFileIO.seekablec C s | � � | jS )z'True if file was opened in a read mode.)re r� r` rA rA rB ro � s zFileIO.readablec C s | � � | jS )z(True if file was opened in a write mode.)re r� r` rA rA rB rq � s zFileIO.writablec C s | � � | jS )z3Return the underlying file descriptor (an integer).)re r� r` rA rA rB r, � s z
FileIO.filenoc C s | � � t�| j�S )z.True if the file is connected to a TTY device.)re r r) r� r` rA rA rB r) � s z
FileIO.isattyc C s | j S )z6True if the file descriptor will be closed by close().)r� r` rA rA rB r; � s zFileIO.closefdc C sJ | j r| jrdS dS n0| jr,| jr&dS dS n| jrB| jr<dS dS ndS dS ) zString giving the file modezxb+Zxbzab+Zabzrb+rD �wbN)r� r� r� r� r` rA rA rB r4 s z FileIO.mode)r
TN)N)N)N)"rM rN rO r� r� r� r� r� r r� r� rj r� r� rp rr r� r� r� r� r r[ ra rb r5 rk ro rq r, r) r� r; r4 r� rA rA r� rB r( � s<
y
#
r( c @ s` e Zd ZdZddd�Zdd� Zddd �Zd
d � Zd d
� Ze dd� �Z
e dd� �Z e dd� �Z dS )�
TextIOBasez�Base class for text I/O.
This class provides a character and line based interface to stream
I/O. There is no public constructor.
r c C s | � d� dS )z�Read at most size characters from stream, where size is an int.
Read from underlying buffer until we have size characters or we hit EOF.
If size is negative or omitted, read until EOF.
Returns a string.
r� Nr\ r| rA rA rB r� s zTextIOBase.readc C s | � d� dS )z.Write string s to stream and returning an int.r� Nr\ )rI �srA rA rB r� ( s zTextIOBase.writeNc C s | � d� dS )z*Truncate size to pos, where pos is an int.rb Nr\ rc rA rA rB rb , s zTextIOBase.truncatec C s | � d� dS )z_Read until newline or EOF.
Returns an empty string if EOF is hit immediately.
r� Nr\ r` rA rA rB r� 0 s zTextIOBase.readlinec C s | � d� dS )z�
Separate the underlying buffer from the TextIOBase and return it.
After the underlying buffer has been detached, the TextIO is in an
unusable state.
r� Nr\ r` rA rA rB r� 7 s zTextIOBase.detachc C s dS )zSubclasses should override.NrA r` rA rA rB r8 @ s zTextIOBase.encodingc C s dS )z�Line endings translated so far.
Only line endings translated during reading are considered.
Subclasses should override.
NrA r` rA rA rB �newlinesE s zTextIOBase.newlinesc C s dS )zMError setting of the decoder or encoder.
Subclasses should override.NrA r` rA rA rB r9 O s zTextIOBase.errors)r )N)
rM rN rO rH r� r� rb r� r� r� r8 r r9 rA rA rA rB r s
r c @ sT e Zd ZdZddd�Zddd�Zdd � Zd
d � Zd d
� ZdZ dZ
dZ e dd� �Z
dS )�IncrementalNewlineDecodera+ Codec used when reading a file in universal newlines mode. It wraps
another incremental decoder, translating \r\n and \r into \n. It also
records the types of newlines encountered. When used with
translate=False, it ensures that the newline sequence is returned in
one piece.
�strictc C s, t jj| |d� || _|| _d| _d| _d S )N)r9 r F)�codecs�IncrementalDecoderr� � translate�decoder�seennl� pendingcr)rI r r r9 rA rA rB r� ` s
z"IncrementalNewlineDecoder.__init__Fc C s� | j d kr|}n| j j||d�}| jr<|s.|r<d| }d| _|�d�r\|s\|d d� }d| _|�d�}|�d�| }|�d�| }| j|o�| j|o�| jB |o�| jB O _| j r�|r�|�
dd�}|r�|�
dd�}|S )N��final�
Fr T�
�
) r �decoder r� r� r �_LF�_CR�_CRLFr �replace)rI �inputr �outputZcrlfZcrZlfrA rA rB r# g s*
� z IncrementalNewlineDecoder.decodec C s@ | j d krd}d}n| j �� \}}|dK }| jr8|dO }||fS )Nr� r r
)r �getstater )rI r� �flagrA rA rB r* � s
z"IncrementalNewlineDecoder.getstatec C s8 |\}}t |d@ �| _| jd k r4| j�||d? f� d S r )�boolr r �setstate)rI �stater� r+ rA rA rB r- � s
z"IncrementalNewlineDecoder.setstatec C s$ d| _ d| _| jd k r | j�� d S )Nr F)r r r �resetr` rA rA rB r/ � s
z IncrementalNewlineDecoder.resetr
r � c C s
d| j S )N)Nr" r )r r" r! )r" r! )r r! )r r" r! )r r` rA rA rB r � s �z"IncrementalNewlineDecoder.newlinesN)r )F)rM rN rO rH r� r# r* r- r/ r$ r% r& r� r rA rA rA rB r Y s
r c @ sv e Zd ZdZdZdZdOdd�Zdd� ZdPd d
�Zd d � Z e
d
d� �Z e
dd� �Z e
dd� �Z
e
dd� �Ze
dd� �Zddeddd�dd�Zdd� Zd d � Zd d � Zd d!� Zd"d#� Ze
d$d%� �Ze
d&d'� �Zd(d)� Zd*d+� Zd,d-� Zd.d/� Z d0d1� Z d2d3� Z dQd4d5�Z d6d7� Z d8d9� Z!dRd;d<�Z"d=d>� Z#d?d@� Z$dSdAdB�Z%dCdD� Z&dTdEdF�Z'dUdGdH�Z(dIdJ� Z)dVdKdL�Z*e
dMdN� �Z+dS )Wr3 a Character and line based layer over a BufferedIOBase object, buffer.
encoding gives the name of the encoding that the stream will be
decoded or encoded with. It defaults to locale.getpreferredencoding(False).
errors determines the strictness of encoding and decoding (see the
codecs.register) and defaults to "strict".
newline can be None, '', '\n', '\r', or '\r\n'. It controls the
handling of line endings. If it is None, universal newlines is
enabled. With this enabled, on input, the lines endings '\n', '\r',
or '\r\n' are translated to '\n' before being returned to the
caller. Conversely, on output, '\n' is translated to the system
default line separator, os.linesep. If newline is any other of its
legal values, that newline becomes the newline when the file is read
and it is returned untranslated. On output, '\n' is converted to the
newline.
If line_buffering is True, a call to flush is implied when a call to
write contains a newline character.
i NFc C s | � |� |d krvzt�|�� �}W n ttfk
r< Y nX |d krvz dd l}W n tk
rj d}Y n X |�d�}t |t
�s�t d| ��t �
|�js�d}t|| ��|d kr�d}nt |t
�s�t d| ��|| _d| _d| _d | _| j�� | _| _t| jd �| _| �|||||� d S )
Nr �asciiFr zG%r is not a text encoding; use codecs.open() to handle arbitrary codecsr r r r� )�_check_newliner �device_encodingr, r/ rV �locale� ImportErrorZgetpreferredencodingr r r# r �lookup�_is_text_encoding� LookupErrorr� �_decoded_chars�_decoded_chars_used� _snapshotr@ rk r �_tellingr� �
_has_read1�
_configure) rI r@ r8 r9 r: r? �
write_throughr4 rm rA rA rB r� � s>
�zTextIOWrapper.__init__c C s> |d k r$t |t�s$tdt|�f ��|dkr:td|f ��d S )Nzillegal newline type: %r)Nr r" r r! zillegal newline value: %r)r r r �typer# )rI r: rA rA rB r2 � s z TextIOWrapper._check_newlinec C s� || _ || _d | _d | _d| _| | _|d k| _|| _|dk| _|pHt j
| _ || _ || _
| jr�| �� r�| j�� }|dkr�z| �� �d� W n tk
r� Y nX d S )N� r r )� _encoding�_errors�_encoder�_decoder� _b2cratio�_readuniversal�_readtranslate�_readnl�_writetranslater �linesep�_writenl�_line_buffering�_write_throughr rq r@ ra � _get_encoderr- r8 )rI r8 r9 r: r? r? �positionrA rA rB r> � s&
zTextIOWrapper._configurec C s� d� | jj| jj�}z
| j}W n tk
r2 Y nX |d� |�7 }z
| j}W n tk
r` Y nX |d� |�7 }|d� | j� S )Nz<{}.{}z name={0!r}z mode={0!r}z encoding={0!r}>)r� rX rN rO rY r/ r4 r8 )rI r> rY r4 rA rA rB r� ! s
�
zTextIOWrapper.__repr__c C s | j S rQ )rB r` rA rA rB r8 2 s zTextIOWrapper.encodingc C s | j S rQ )rC r` rA rA rB r9 6 s zTextIOWrapper.errorsc C s | j S rQ )rM r` rA rA rB r? : s z TextIOWrapper.line_bufferingc C s | j S rQ )rN r` rA rA rB r? > s zTextIOWrapper.write_throughc C s | j S rQ )r� r` rA rA rB r@ B s zTextIOWrapper.buffer)r8 r9 r: r? r? c C s� | j dk r*|dk s"|dk s"|tk r*td��|dkrH|dkrB| j}q^d}nt|t�s^td| ��|dkrn| j}nt|t�s�td| ��|tkr�| j}| � |� |dkr�| j
}|dkr�| j }| � � | �
|||||� dS )z`Reconfigure the text stream with new parameters.
This also flushes the stream.
NzPIt is not possible to set the encoding or newline of stream after the first readr r r )rE �EllipsisrV rC r r r rB rI r2 r? r? rf r> )rI r8 r9 r: r? r? rA rA rB � reconfigureF s@
����
�zTextIOWrapper.reconfigurec C s | j rtd��| jS )Nrs )rh r# r r` rA rA rB rk o s zTextIOWrapper.seekablec C s
| j �� S rQ )r@ ro r` rA rA rB ro t s zTextIOWrapper.readablec C s
| j �� S rQ )r@ rq r` rA rA rB rq w s zTextIOWrapper.writablec C s | j �� | j| _d S rQ )r@ rf r r< r` rA rA rB rf z s
zTextIOWrapper.flushc C s. | j d k r*| js*z | �� W 5 | j �� X d S rQ )r@ rh r5 rf r` rA rA rB r5 ~ s zTextIOWrapper.closec C s | j jS rQ )r@ rh r` rA rA rB rh � s zTextIOWrapper.closedc C s | j jS rQ )r@ rY r` rA rA rB rY � s zTextIOWrapper.namec C s
| j �� S rQ )r@ r, r` rA rA rB r, � s zTextIOWrapper.filenoc C s
| j �� S rQ )r@ r) r` rA rA rB r) � s zTextIOWrapper.isattyc C s� | j rtd��t|t�s(td|jj ��t|�}| js<| j oBd|k}|rf| jrf| j
dkrf|� d| j
�}| j pr| �
� }|�|�}| j�|� | j r�|s�d|kr�| �� | �d� d| _| jr�| j�� |S )z Write data, where s is a strr� z can't write %s to text streamr" r r N)rh r# r r r rX rM r" rJ rM rL r' rD rO �encoder@ r� rf �_set_decoded_charsr; rE r/ )rI r ZlengthZhaslf�encoderr rA rA rB r� � s(
�
zTextIOWrapper.writec C s t �| j�}|| j�| _| jS rQ )r �getincrementalencoderrB rC rD )rI Z make_encoderrA rA rB rO � s zTextIOWrapper._get_encoderc C s2 t �| j�}|| j�}| jr(t|| j�}|| _|S rQ )r �getincrementaldecoderrB rC rG r rH rE )rI Z make_decoderr rA rA rB � _get_decoder� s
zTextIOWrapper._get_decoderc C s || _ d| _dS )z Set the _decoded_chars buffer.r N)r9 r: )rI �charsrA rA rB rT � s z TextIOWrapper._set_decoded_charsc C sF | j }|dkr | j|d� }n| j||| � }| j t|�7 _ |S )z'Advance into the _decoded_chars buffer.N)r: r9 r" )rI r{ �offsetrY rA rA rB �_get_decoded_chars� s z TextIOWrapper._get_decoded_charsc C s$ | j |k rtd��| j |8 _ dS )z!Rewind the _decoded_chars buffer.z"rewind decoded_chars out of boundsN)r: �AssertionErrorr� rA rA rB �_rewind_decoded_chars� s
z#TextIOWrapper._rewind_decoded_charsc C s� | j dkrtd��| jr&| j �� \}}| jr<| j�| j�}n| j�| j�}| }| j � ||�}| �
|� |r�t |�t | j � | _
nd| _
| jr�||| f| _| S )zQ
Read and decode the next chunk of data from the BufferedReader.
Nz
no decoderrA )rE r# r< r* r= r@ r� � _CHUNK_SIZEr� r# rT r" r9 rF r; )rI �
dec_buffer� dec_flags� input_chunk�eofZ
decoded_charsrA rA rB � _read_chunk� s
zTextIOWrapper._read_chunkr c C s( ||d> B |d> B |d> B t |�d> B S )N�@ � � � )r, )rI rP r` �
bytes_to_feed�need_eof�
chars_to_skiprA rA rB � _pack_cookie� s
�
�zTextIOWrapper._pack_cookiec C sF t |d�\}}t |d�\}}t |d�\}}t |d�\}}|||||fS )Nl )�divmod)rI Zbigint�restrP r` rh ri rj rA rA rB �_unpack_cookie s
z TextIOWrapper._unpack_cookiec C s@ | j std��| js td��| �� | j�� }| j}|d ksF| jd krX| j rTt
d��|S | j\}}|t |�8 }| j }|dkr�| �
||�S |�� }�z�t| j| �}d}|dk�r"|�d|f� t |�|d |� ��} | |k�r|�� \}
} |
s�| }|| 8 }�q4|t |
�8 }d}q�||8 }|d }q�d}|�d|f� || } |}
|dk�rZ| �
| |
�W ��S d}d}d}t|t |��D ]x}|d7 }|t |�|||d � ��7 }|�� \}}|�s�||k�r�| |7 } ||8 }|dd }
}}||k�rt �q�qt|t |jddd ��7 }d}||k �rtd
��| �
| |
|||�W �S |�|� X d S ) N�!underlying stream is not seekablez(telling position disabled by next() callzpending decoded textr r
r� r Tr z'can't reconstruct logical file position)r rV r< r. rf r@ ra rE r; r9 r\ r" r: rk r* r- r rF r# �range)rI rP r r` Z
next_inputrj Z saved_stateZ
skip_bytesZ skip_backr{ r �d� start_posZ start_flagsZ bytes_fedri Z
chars_decoded�ir_ rA rA rB ra
s�
�zTextIOWrapper.tellc C s$ | � � |d kr| �� }| j�|�S rQ )rf ra r@ rb rc rA rA rB rb m s zTextIOWrapper.truncatec C s* | j d krtd��| �� | j}d | _|S )Nzbuffer is already detached)r@ r# rf r� )rI r@ rA rA rB r� s s
zTextIOWrapper.detachc s� � fdd�}� j rtd��� js(td��|tkrN|dkr@td��d}� �� }nZ|tkr�|dkrftd��� �� � j� d|�}� �
d� d � _ � j r�� j �
� ||� |S |dkr�td |f ��|dk r�td
|f ��� �� � �|�\}}}}} � j� |� � �
d� d � _ |dk�r*� j �r*� j �
� n@� j �s>|�s>| �rj� j �pL� �� � _ � j �d |f� |d f� _ | �r�� j�|�}
� �
� j �|
|�� ||
f� _ t� j�| k �r�td ��| � _||� |S )
Nc sH z� j p� �� }W n tk
r& Y n X | dkr<|�d� n|�� dS )z9Reset the encoder (merely useful for proper BOM handling)r N)rD rO r8 r- r/ )rP rU r` rA rB �_reset_encoder| s z*TextIOWrapper.seek.<locals>._reset_encoderr� ro r z#can't do nonzero cur-relative seeksz#can't do nonzero end-relative seeksr zunsupported whence (%r)r� r� z#can't restore logical file position)rh r# r rV r ra r rf r@ r[ rT r; rE r/ rn rX r- r� r# r" r9 r. r: ) rI Zcookier_ rt rP rr r` rh ri rj ra rA r` rB r[ { s`
�
�
zTextIOWrapper.seekc C s� | � � |d krd}n4z
|j}W n" tk
rB t|�d���Y nX |� }| jpV| �� }|dk r�| �� |j| j� � dd� }| �
d� d | _ |S d}| �|�}t |�|k r�|s�| �
� }|| �|t |� �7 }q�|S d S )Nr r� r Tr r F)rp r� r/ r rE rX r[ r# r@ r� rT r; r" rc )rI r} r� r r> rb rA rA rB r� � s,
�
zTextIOWrapper.readc C s( d| _ | �� }|s$d | _| j| _ t�|S )NF)r< r� r; r r� r� rA rA rB r� � s zTextIOWrapper.__next__c C s
| j rtd��|d kr d}n4z
|j}W n" tk
rH t|�d���Y nX |� }| �� }d}| jsj| �� d }}| jr�|� d|�}|dkr�|d }�q�nt
|�}n�| j �rF|� d|�}|� d|�}|dkr�|dkr�t
|�}n |d }�q�nX|dk�r|d }�q�n@||k �r |d }�q�n(||d k�r8|d }�q�n |d }�q�n(|� | j �}|dk�rn|t
| j � }�q�|dk�r�t
|�|k�r�|}�q�| �
� �r�| j�r��q��q�| j�r�|| �� 7 }qr| �d � d | _|S qr|dk�r�||k�r�|}| �t
|�| � |d |� S )
Nr� r r� r r" r
r r r )rh r# r� r/ r r[ rE rX rH ry r" rG rI rc r9 rT r; r] ) rI r} r� r� �startr^ �endposZnlposZcrposrA rA rB r� � st
zTextIOWrapper.readlinec C s | j r| j jS d S rQ )rE r r` rA rA rB r H
s zTextIOWrapper.newlines)NNNFF)NNNFF)N)r r r r )N)r )N)N),rM rN rO rH r^ r� r� r2 r> r� r� r8 r9 r? r? r@ rQ rR rk ro rq rf r5 rh rY r, r) r� rO rX rT r[ r] rc rk rn ra rb r� r[ r� r� r� r rA rA rA rB r3 � s| �
( �
$
� )
* �
c
K
]r3 c sR e Zd ZdZd� fdd� Zdd� Zdd � Zed
d � �Zed d
� �Z dd� Z
� Z S )�StringIOz�Text I/O implementation using an in-memory buffer.
The initial_value argument sets the value of object. The newline
argument is like the one of TextIOWrapper's constructor.
r r" c sf t t| �jt� dd|d� |d kr(d| _|d k rbt|t�sNtd�t |�j
���| � |� | � d� d S )Nzutf-8�
surrogatepass)r8 r9 r: Fz*initial_value must be str or None, not {0}r )
r� rw r� r� rJ r r r r� r@ rM r� r[ )rI Z
initial_valuer: r� rA rB r� T
s �
�
zStringIO.__init__c C sP | � � | jp| �� }|�� }|�� z|j| j�� dd�W �S |�|� X d S )NTr ) rf rE rX r* r/ r- r# r@ r� )rI r Z old_staterA rA rB r� d
s zStringIO.getvaluec C s
t �| �S rQ )�objectr� r` rA rA rB r� n
s zStringIO.__repr__c C s d S rQ rA r` rA rA rB r9 s
s zStringIO.errorsc C s d S rQ rA r` rA rA rB r8 w
s zStringIO.encodingc C s | � d� d S )Nr� r\ r` rA rA rB r� {
s zStringIO.detach)r r" ) rM rN rO rH r� r� r� r� r9 r8 r� r� rA rA r� rB rw M
s
rw )r
r NNNTN)8rH r �abcr r� r� �sys�_threadr r� �platformZmsvcrtr r �ior r r r r� r� �addr � SEEK_DATAr* r� r �dev_moderi rC rF � open_coder/ rG rP rV r. r# �ABCMetarW �registerr� �_ior( r� r� r� r2 r1 r� r0 r r r r3 rw rA rA rA rB �<module> s�
�
[
$ =
g h CiIJ Y@ U $