mirrors/cpython
1
0
Fork 0
mirror of https://github.com/python/cpython.git synced 2025-09-27 02:39:58 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 13

merge heads

Browse source
This commit is contained in:
Benjamin Peterson 2011-10-24 08:51:46 -04:00
commit 22dabb6ffa
3 changed files with 195 additions and 116 deletions
Download patch file Download diff file Expand all files Collapse all files

30
Doc/library/socketserver.rst
View file

@ -225,6 +225,7 @@ The server classes support the following class variables:
desired. If :meth:`handle_request` receives no incoming requests within the desired. If :meth:`handle_request` receives no incoming requests within the
timeout period, the :meth:`handle_timeout` method is called. timeout period, the :meth:`handle_timeout` method is called.
There are various server methods that can be overridden by subclasses of base There are various server methods that can be overridden by subclasses of base
server classes like :class:`TCPServer`; these methods aren't useful to external server classes like :class:`TCPServer`; these methods aren't useful to external
users of the server object. users of the server object.
@ -355,7 +356,7 @@ This is the server side::
def handle(self): def handle(self):
# self.request is the TCP socket connected to the client # self.request is the TCP socket connected to the client
self.data = self.request.recv(1024).strip() self.data = self.request.recv(1024).strip()
print "%s wrote:" % self.client_address[0] print "{} wrote:".format(self.client_address[0])
print self.data print self.data
# just send back the same data, but upper-cased # just send back the same data, but upper-cased
self.request.send(self.data.upper()) self.request.send(self.data.upper())
@ -379,7 +380,7 @@ objects that simplify communication by providing the standard file interface)::
# self.rfile is a file-like object created by the handler; # self.rfile is a file-like object created by the handler;
# we can now use e.g. readline() instead of raw recv() calls # we can now use e.g. readline() instead of raw recv() calls
self.data = self.rfile.readline().strip() self.data = self.rfile.readline().strip()
print "%s wrote:" % self.client_address[0] print "{} wrote:".format(self.client_address[0])
print self.data print self.data
# Likewise, self.wfile is a file-like object used to write back # Likewise, self.wfile is a file-like object used to write back
# to the client # to the client
@ -402,16 +403,18 @@ This is the client side::
# Create a socket (SOCK_STREAM means a TCP socket) # Create a socket (SOCK_STREAM means a TCP socket)
sock = socket.socket(socket.AF_INET, socket.SOCK_STREAM) sock = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
try:
# Connect to server and send data # Connect to server and send data
sock.connect((HOST, PORT)) sock.connect((HOST, PORT))
sock.send(data + "\n") sock.send(data + "\n")
# Receive data from the server and shut down # Receive data from the server and shut down
received = sock.recv(1024) received = sock.recv(1024)
finally:
sock.close() sock.close()
print "Sent: %s" % data print "Sent: {}".format(data)
print "Received: %s" % received print "Received: {}".format(received)
The output of the example should look something like this: The output of the example should look something like this:
@ -452,7 +455,7 @@ This is the server side::
def handle(self): def handle(self):
data = self.request[0].strip() data = self.request[0].strip()
socket = self.request[1] socket = self.request[1]
print "%s wrote:" % self.client_address[0] print "{} wrote:".format(self.client_address[0])
print data print data
socket.sendto(data.upper(), self.client_address) socket.sendto(data.upper(), self.client_address)
@ -477,8 +480,8 @@ This is the client side::
sock.sendto(data + "\n", (HOST, PORT)) sock.sendto(data + "\n", (HOST, PORT))
received = sock.recv(1024) received = sock.recv(1024)
print "Sent: %s" % data print "Sent: {}".format(data)
print "Received: %s" % received print "Received: {}".format(received)
The output of the example should look exactly like for the TCP server example. The output of the example should look exactly like for the TCP server example.
@ -499,8 +502,8 @@ An example for the :class:`ThreadingMixIn` class::
def handle(self): def handle(self):
data = self.request.recv(1024) data = self.request.recv(1024)
cur_thread = threading.currentThread() cur_thread = threading.current_thread()
response = "%s: %s" % (cur_thread.getName(), data) response = "{}: {}".format(cur_thread.name, data)
self.request.send(response) self.request.send(response)
class ThreadedTCPServer(SocketServer.ThreadingMixIn, SocketServer.TCPServer): class ThreadedTCPServer(SocketServer.ThreadingMixIn, SocketServer.TCPServer):
@ -509,9 +512,11 @@ An example for the :class:`ThreadingMixIn` class::
def client(ip, port, message): def client(ip, port, message):
sock = socket.socket(socket.AF_INET, socket.SOCK_STREAM) sock = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
sock.connect((ip, port)) sock.connect((ip, port))
try:
sock.send(message) sock.send(message)
response = sock.recv(1024) response = sock.recv(1024)
print "Received: %s" % response print "Received: {}".format(response)
finally:
sock.close() sock.close()
if __name__ == "__main__": if __name__ == "__main__":
@ -525,9 +530,9 @@ An example for the :class:`ThreadingMixIn` class::
# more thread for each request # more thread for each request
server_thread = threading.Thread(target=server.serve_forever) server_thread = threading.Thread(target=server.serve_forever)
# Exit the server thread when the main thread terminates # Exit the server thread when the main thread terminates
server_thread.setDaemon(True) server_thread.daemon = True
server_thread.start() server_thread.start()
print "Server loop running in thread:", server_thread.getName() print "Server loop running in thread:", server_thread.name
client(ip, port, "Hello World 1") client(ip, port, "Hello World 1")
client(ip, port, "Hello World 2") client(ip, port, "Hello World 2")
@ -535,6 +540,7 @@ An example for the :class:`ThreadingMixIn` class::
server.shutdown() server.shutdown()
The output of the example should look something like this:: The output of the example should look something like this::
$ python ThreadedTCPServer.py $ python ThreadedTCPServer.py

255
Doc/library/subprocess.rst
View file

@ -31,7 +31,142 @@ modules and functions can be found in the following sections.
Using the subprocess Module Using the subprocess Module
--------------------------- ---------------------------
This module defines one class called :class:`Popen`: The recommended interface to this module is to use the following convenience
functions for all use cases they can handle. For more advanced use cases, the
underlying :class:`Popen` interface can be used directly.
.. function:: call(args, *, stdin=None, stdout=None, stderr=None)
Run the command described by *args*. Wait for command to complete, then
return the :attr:`returncode` attribute.
The arguments shown above are merely the most common ones, described below
in :ref:`frequently-used-arguments`. The full function signature is the
same as that of the :class:`Popen` constructor - the convenience functions
pass all supplied arguments directly through to that interface.
Examples::
>>> subprocess.call(["ls", "-l"])
0
>>> subprocess.call(["python", "-c", "import sys; sys.exit(1)"])
1
.. warning::
Like :meth:`Popen.wait`, this will deadlock when using
``stdout=PIPE`` and/or ``stderr=PIPE`` and the child process
generates enough output to a pipe such that it blocks waiting
for the OS pipe buffer to accept more data.
.. function:: check_call(*callargs, **kwargs)
Run command with arguments. Wait for command to complete. If the return
code was zero then return, otherwise raise :exc:`CalledProcessError`. The
:exc:`CalledProcessError` object will have the return code in the
:attr:`returncode` attribute.
The arguments are the same as for :func:`call`. Examples::
>>> subprocess.check_call(["ls", "-l"])
0
>>> subprocess.check_call(["python", "-c", "import sys; sys.exit(1)"])
Traceback (most recent call last):
...
subprocess.CalledProcessError: Command '['python', '-c', 'import sys; sys.exit(1)']' returned non-zero exit status 1
.. versionadded:: 2.5
.. warning::
See the warning for :func:`call`.
.. function:: check_output(*callargs, **kwargs)
Run command with arguments and return its output as a byte string.
If the return code was non-zero it raises a :exc:`CalledProcessError`. The
:exc:`CalledProcessError` object will have the return code in the
:attr:`returncode` attribute and any output in the :attr:`output`
attribute.
Examples::
>>> subprocess.check_output(["ls", "-l", "/dev/null"])
'crw-rw-rw- 1 root root 1, 3 Oct 18 2007 /dev/null\n'
>>> subprocess.check_output(["python", "-c", "import sys; sys.exit(1)"])
Traceback (most recent call last):
...
subprocess.CalledProcessError: Command '['python', '-c', 'import sys; sys.exit(1)']' returned non-zero exit status 1
The arguments are the same as for :func:`call`, except that *stdout* is
not allowed as it is used internally. To also capture standard error in
the result, use ``stderr=subprocess.STDOUT``::
>>> subprocess.check_output(
... ["/bin/sh", "-c", "ls non_existent_file; exit 0"],
... stderr=subprocess.STDOUT)
'ls: non_existent_file: No such file or directory\n'
.. versionadded:: 2.7
.. data:: PIPE
Special value that can be used as the *stdin*, *stdout* or *stderr* argument
to :class:`Popen` and indicates that a pipe to the standard stream should be
opened.
.. data:: STDOUT
Special value that can be used as the *stderr* argument to :class:`Popen` and
indicates that standard error should go into the same handle as standard
output.
.. _frequently-used-arguments:
Frequently Used Arguments
^^^^^^^^^^^^^^^^^^^^^^^^^
To support a wide variety of use cases, the :class:`Popen` constructor (and
the convenience functions) accept a large number of optional arguments. For
most typical use cases, many of these arguments can be safely left at their
default values. The arguments that are most commonly needed are:
*args* should be a string, or a sequence of program arguments. Providing
a sequence of arguments is generally preferred, as it allows the module to
take care of any required escaping and quoting of arguments (e.g. to permit
spaces in file names)
*stdin*, *stdout* and *stderr* specify the executed program's standard input,
standard output and standard error file handles, respectively. Valid values
are :data:`PIPE`, an existing file descriptor (a positive integer), an
existing file object, and ``None``. :data:`PIPE` indicates that a new pipe
to the child should be created. With the default settings of ``None``, no
redirection will occur; the child's file handles will be inherited from the
parent. Additionally, *stderr* can be :data:`STDOUT`, which indicates that
the stderr data from the child process should be captured into the same file
handle as for stdout.
These options, along with all of the other options, are described in more
detail in the :class:`Popen` constructor documentation.
Popen Constuctor
^^^^^^^^^^^^^^^^
The underlying process creation and management in this module is handled by
the :class:`Popen` class. It offers a lot of flexibility so that developers
are able to handle the less common cases not covered by the convenience
functions.
.. class:: Popen(args, bufsize=0, executable=None, stdin=None, stdout=None, stderr=None, preexec_fn=None, close_fds=False, shell=False, cwd=None, env=None, universal_newlines=False, startupinfo=None, creationflags=0) .. class:: Popen(args, bufsize=0, executable=None, stdin=None, stdout=None, stderr=None, preexec_fn=None, close_fds=False, shell=False, cwd=None, env=None, universal_newlines=False, startupinfo=None, creationflags=0)
@ -126,14 +261,15 @@ This module defines one class called :class:`Popen`:
You don't need ``shell=True`` to run a batch file, nor to run a console-based You don't need ``shell=True`` to run a batch file, nor to run a console-based
executable. executable.
*stdin*, *stdout* and *stderr* specify the executed programs' standard input, *stdin*, *stdout* and *stderr* specify the executed program's standard input,
standard output and standard error file handles, respectively. Valid values standard output and standard error file handles, respectively. Valid values
are :data:`PIPE`, an existing file descriptor (a positive integer), an are :data:`PIPE`, an existing file descriptor (a positive integer), an
existing file object, and ``None``. :data:`PIPE` indicates that a new pipe existing file object, and ``None``. :data:`PIPE` indicates that a new pipe
to the child should be created. With ``None``, no redirection will occur; to the child should be created. With the default settings of ``None``, no
the child's file handles will be inherited from the parent. Additionally, redirection will occur; the child's file handles will be inherited from the
*stderr* can be :data:`STDOUT`, which indicates that the stderr data from the parent. Additionally, *stderr* can be :data:`STDOUT`, which indicates that
applications should be captured into the same file handle as for stdout. the stderr data from the child process should be captured into the same file
handle as for stdout.
If *preexec_fn* is set to a callable object, this object will be called in the If *preexec_fn* is set to a callable object, this object will be called in the
child process just before the child is executed. (Unix only) child process just before the child is executed. (Unix only)
@ -184,87 +320,6 @@ This module defines one class called :class:`Popen`:
:data:`CREATE_NEW_PROCESS_GROUP`. (Windows only) :data:`CREATE_NEW_PROCESS_GROUP`. (Windows only)
.. data:: PIPE
Special value that can be used as the *stdin*, *stdout* or *stderr* argument
to :class:`Popen` and indicates that a pipe to the standard stream should be
opened.
.. data:: STDOUT
Special value that can be used as the *stderr* argument to :class:`Popen` and
indicates that standard error should go into the same handle as standard
output.
Convenience Functions
^^^^^^^^^^^^^^^^^^^^^
This module also defines the following shortcut functions:
.. function:: call(*popenargs, **kwargs)
Run command with arguments. Wait for command to complete, then return the
:attr:`returncode` attribute.
The arguments are the same as for the :class:`Popen` constructor. Example::
>>> retcode = subprocess.call(["ls", "-l"])
.. warning::
Like :meth:`Popen.wait`, this will deadlock when using
``stdout=PIPE`` and/or ``stderr=PIPE`` and the child process
generates enough output to a pipe such that it blocks waiting
for the OS pipe buffer to accept more data.
.. function:: check_call(*popenargs, **kwargs)
Run command with arguments. Wait for command to complete. If the exit code was
zero then return, otherwise raise :exc:`CalledProcessError`. The
:exc:`CalledProcessError` object will have the return code in the
:attr:`returncode` attribute.
The arguments are the same as for the :class:`Popen` constructor. Example::
>>> subprocess.check_call(["ls", "-l"])
0
.. versionadded:: 2.5
.. warning::
See the warning for :func:`call`.
.. function:: check_output(*popenargs, **kwargs)
Run command with arguments and return its output as a byte string.
If the exit code was non-zero it raises a :exc:`CalledProcessError`. The
:exc:`CalledProcessError` object will have the return code in the
:attr:`returncode`
attribute and output in the :attr:`output` attribute.
The arguments are the same as for the :class:`Popen` constructor. Example::
>>> subprocess.check_output(["ls", "-l", "/dev/null"])
'crw-rw-rw- 1 root root 1, 3 Oct 18 2007 /dev/null\n'
The stdout argument is not allowed as it is used internally.
To capture standard error in the result, use ``stderr=subprocess.STDOUT``::
>>> subprocess.check_output(
... ["/bin/sh", "-c", "ls non_existent_file; exit 0"],
... stderr=subprocess.STDOUT)
'ls: non_existent_file: No such file or directory\n'
.. versionadded:: 2.7
Exceptions Exceptions
^^^^^^^^^^ ^^^^^^^^^^
@ -523,12 +578,15 @@ The :mod:`subprocess` module exposes the following constants.
Replacing Older Functions with the subprocess Module Replacing Older Functions with the subprocess Module
---------------------------------------------------- ----------------------------------------------------
In this section, "a ==> b" means that b can be used as a replacement for a. In this section, "a becomes b" means that b can be used as a replacement for a.
.. note:: .. note::
All functions in this section fail (more or less) silently if the executed All functions in this section fail (more or less) silently if the executed
program cannot be found; this module raises an :exc:`OSError` exception. program cannot be found; this module raises an :exc:`OSError` exception. In
addition, the replacements using :func:`check_output` will fail with a
:exc:`CalledProcessError` if the requested operation produces a non-zero
return code.
In the following examples, we assume that the subprocess module is imported with In the following examples, we assume that the subprocess module is imported with
"from subprocess import \*". "from subprocess import \*".
@ -540,8 +598,8 @@ Replacing /bin/sh shell backquote
:: ::
output=`mycmd myarg` output=`mycmd myarg`
==> # becomes
output = Popen(["mycmd", "myarg"], stdout=PIPE).communicate()[0] output = check_output(["mycmd", "myarg"])
Replacing shell pipeline Replacing shell pipeline
@ -550,7 +608,7 @@ Replacing shell pipeline
:: ::
output=`dmesg | grep hda` output=`dmesg | grep hda`
==> # becomes
p1 = Popen(["dmesg"], stdout=PIPE) p1 = Popen(["dmesg"], stdout=PIPE)
p2 = Popen(["grep", "hda"], stdin=p1.stdout, stdout=PIPE) p2 = Popen(["grep", "hda"], stdin=p1.stdout, stdout=PIPE)
p1.stdout.close() # Allow p1 to receive a SIGPIPE if p2 exits. p1.stdout.close() # Allow p1 to receive a SIGPIPE if p2 exits.
@ -559,15 +617,22 @@ Replacing shell pipeline
The p1.stdout.close() call after starting the p2 is important in order for p1 The p1.stdout.close() call after starting the p2 is important in order for p1
to receive a SIGPIPE if p2 exits before p1. to receive a SIGPIPE if p2 exits before p1.
Alternatively, for trusted input, the shell's pipeline may still be used
directly:
output=`dmesg | grep hda`
# becomes
output=check_output("dmesg | grep hda", shell=True)
Replacing :func:`os.system` Replacing :func:`os.system`
^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^
:: ::
sts = os.system("mycmd" + " myarg") sts = os.system("mycmd" + " myarg")
==> # becomes
p = Popen("mycmd" + " myarg", shell=True) sts = call("mycmd" + " myarg", shell=True)
sts = os.waitpid(p.pid, 0)[1]
Notes: Notes:

8
Misc/NEWS
View file

@ -342,6 +342,14 @@ Tests
- Issue #12057: Add tests for ISO 2022 codecs (iso2022_jp, iso2022_jp_2, - Issue #12057: Add tests for ISO 2022 codecs (iso2022_jp, iso2022_jp_2,
iso2022_kr). iso2022_kr).
Documentation
-------------
- Issue #13237: Reorganise subprocess documentation to emphasise convenience
functions and the most commonly needed arguments to Popen.
- Issue #13141: Demonstrate recommended style for SocketServer examples.
What's New in Python 2.7.2? What's New in Python 2.7.2?
=========================== ===========================