Skip to content

Latest commit

 

History

History
1919 lines (1599 loc) · 104 KB

CHANGES.rst

File metadata and controls

1919 lines (1599 loc) · 104 KB
Raw

Changelog

.. currentmodule:: gevent

1.2.2 (unreleased)

  • Testing on Python 3.5 now uses Python 3.5.3 due to SSL changes. See :issue:`943`.

  • Linux CI has been updated from Ubuntu 12.04 to Ubuntu 14.04 since the former has reached EOL.

  • Linux CI now tests on PyPy2 5.7.1, updated from PyPy2 5.6.0.

  • Linux CI now tests on PyPy3 3.5-5.7.1-beta, updated from PyPy3 3.3-5.5-alpha.

  • Python 2 sockets are compatible with the SOCK_CLOEXEC flag found on Linux. They no longer pass the socket type or protocol to getaddrinfo when connect is called. Reported in :issue:`944` by Bernie Hackett.

  • Replace optparse module with argparse. See :issue:`947`.

  • Update to version 1.3.1 of tblib to fix :issue:`954`, reported by ml31415.

  • Fix the name of the type parameter to :func:`gevent.socket.getaddrinfo` to be correct on Python 3. This would cause callers using keyword arguments to raise a :exc:`TypeError`. Reported in :issue:`960` by js6626069. Likewise, correct the argument names for fromfd and socketpair on Python 2, although they cannot be called wit keyword arguments under CPython.

    Note

    The gethost* functions take different argument names under CPython and PyPy. gevent follows the CPython convention, although these functions cannot be called with keyword arguments on CPython.

1.2.1 (2017-01-12)

  • CI services now test on 3.6.0.
  • Windows: Provide socket.socketpair for all Python 3 versions. This was added to Python 3.5, but tests were only added in 3.6. (For versions older than 3.4 this is a gevent extension.) Previously this was not supported on any Python 3 version.
  • Windows: List subprocess.STARTUPINFO in subprocess.__all__ for 3.6 compatibility.
  • The _DummyThread objects created by calling :func:`threading.current_thread` from inside a raw :class:`greenlet.greenlet` in a system with monkey-patched threading now clean up after themselves when the greenlet dies (:class:`gevent.Greenlet`-based _DummyThreads have always cleaned up). This requires the use of a :class:`weakref.ref` (and may not be timely on PyPy). Reported in :issue:`918` by frozenoctobeer.
  • Build OS X wheels with -D_DARWIN_FEATURE_CLOCK_GETTIME=0 for compatibility with OS X releases before 10.12 Sierra. Reported by Ned Batchelder in :issue:`916`.

1.2.0 (2016-12-23)

  • The c-ares DNS resolver ignores bad flags to getnameinfo, like the system resolver does. Discovered when cleaning up the DNS resolver tests to produce more reliable results. See :issue:`774`.

1.2a2 (Dec 9, 2016)

  • Update libev to version 4.23.
  • Allow the MAKE environment variable to specify the make command on non-Windows systems for ease of development on BSD systems where make is BSD make and gmake is GNU make (gevent requires GNU make). See :issue:`888`.
  • Let :class:`gevent.server.StreamServer` accept an SSLContext on Python versions that support it. Added in :pr:`904` by Arcadiy Ivanov.

1.2a1 (Oct 27, 2016)

Incompatible Changes

  • Support for Python 2.6 has been removed. See :pr:`766`.
  • Remove module gevent.coros which was replaced by gevent.lock and has been deprecated since 1.0b2.
  • The internal implementation modules gevent.corecext and gevent.corecffi have been moved. Please import from gevent.core instead; this has always been the only documented place to import from.

Libraries and Installation

  • Update libev to version 4.22 (was 4.20).
  • Update tblib to 1.3.0.
  • Update Cython to 0.25 (was 0.23.5).
  • Update c-ares to version 1.12.0 (was 1.10.0) (release notes).
  • For the benefit of downstream package maintainers, gevent is now tested with c-ares and libev linked dynamically and not embedded (i.e., using the system libraries). However, only the versions shipped with gevent are tested and known to work.
  • The repository directory layout has been changed to make it easier to include third-party dependencies. Likewise, the setup.py script has been split to make it easier to build third-party dependencies.
  • PyPy/CFFI: The corecffi native extension is now only built at installation time. Previously, if it wasn't available, a build was attempted at every import. This could lead to scattered "gevent" directories and undependable results.
  • setuptools is now required at build time on all platforms. Previously it was only required for Windows and PyPy.
  • POSIX: Don't hardcode /bin/sh into the configuration command line, instead relying on sh being on the PATH, as recommended by the standard. Fixed in :pr:`809` by Fredrix Fornwall.

Security

  • :mod:`gevent.pywsgi` now checks that the values passed to start_response do not contain a carriage return or newline in order to prevent HTTP response splitting (header injection), raising a :exc:`ValueError` if they do. See :issue:`775`.
  • Incoming headers containing an underscore are no longer placed in the WSGI environ. See :issue:`819`.
  • Errors logged by :class:`~gevent.pywsgi.WSGIHandler` no longer print the entire WSGI environment by default. This avoids possible information disclosure vulnerabilities. Applications can also opt-in to a higher security level for the WSGI environment if they choose and their frameworks support it. Originally reported in :pr:`779` by sean-peters-au and changed in :pr:`781`.

Platforms

  • As mentioned above, Python 2.6 is no longer supported.
  • Python 3.6 is now tested on POSIX platforms. This includes a few notable changes:
    • SSLContext.wrap_socket accepts the session parameter, though this parameter isn't useful prior to 3.6.
    • SSLSocket.recv(0) or read(0) returns an empty byte string. This is a fix for Python bug #23804 which has also been merged into Python 2.7 and Python 3.5.
  • PyPy3 5.5.0 alpha (supporting Python 3.3.5) is now tested and passes the test suite. Thanks to btegs for :issue:`866`, and Fabio Utzig for :pr:`826`. Note that PyPy3 is not optimized for performance either by the PyPy developers or under gevent, so it may be significantly slower than PyPy2.

Stdlib Compatibility

  • The modules :mod:`gevent.os`, :mod:`gevent.signal` and :mod:`gevent.select` export all the attributes from their corresponding standard library counterpart.
  • Python 2: reload(site) no longer fails with a TypeError if gevent has been imported. Reported in :issue:`805` by Jake Hilton.
  • Python 2: sendall on a non-blocking socket could spuriously fail with a timeout.

select/poll

  • If :func:`gevent.select.select` is given a negative timeout argument, raise an exception like the standard library does.
  • If :func:`gevent.select.select` is given closed or invalid file descriptors in any of its lists, raise the appropriate EBADF exception like the standard library does. Previously, libev would tend to return the descriptor as ready. In the worst case, this adds an extra system call, but may also reduce latency if descriptors are ready at the time of entry.
  • :class:`selectors.SelectSelector` is properly monkey-patched regardless of the order of imports. Reported in :issue:`835` by Przemysław Węgrzyn.
  • :meth:`gevent.select.poll.unregister` raises an exception if fd is not registered, like the standard library.
  • :meth:`gevent.select.poll.poll` returns an event with POLLNVAL for registered fds that are invalid. Previously it would tend to report both read and write events.

File objects

  • FileObjectPosix exposes the read1 method when in read mode, and generally only exposes methods appropriate to the mode it is in.
  • FileObjectPosix supports a bufsize of 0 in binary write modes. Reported in :issue:`840` by Mike Lang.
  • Python 3: :meth:`gevent.socket.connect_ex` was letting BlockingIOError (and possibly others) get raised instead of returning the errno due to the refactoring of the exception hierarchy in Python 3.3. Now the errno is returned. Reported in :issue:`841` by Dana Powers.

Other Changes

  • :class:`~.Group` and :class:`~.Pool` now return whether :meth:`~.Group.join` returned with an empty group. Suggested by Filippo Sironi in :pr:`503`.
  • Unhandled exception reports that kill a greenlet now include a timestamp. See :issue:`137`.
  • :class:`~.PriorityQueue` now ensures that an initial items list is a valid heap. Fixed in :pr:`793` by X.C.Dong.
  • :class:`gevent.hub.signal` (aka :func:`gevent.signal`) now verifies that its handler argument is callable, raising a :exc:`TypeError` if it isn't. Reported in :issue:`818` by Peter Renström.
  • If sys.stderr has been monkey-patched (not recommended), exceptions that the hub reports aren't lost and can still be caught. Reported in :issue:`825` by Jelle Smet.
  • The :func:`gevent.os.waitpid` function is cooperative in more circumstances. Reported in :issue:`878` by Heungsub Lee.
  • The various FileObject implementations are more consistent with each other. Note: Writing to the io property of a FileObject should be considered deprecated.
  • Timeout exceptions (and other asynchronous exceptions) could cause the BackdoorServer to fail to properly manage the stdout/stderr/stdin values. Reported with a patch in :pr:`874` by stefanmh.
  • The BackDoorServer now tracks spawned greenlets (connections) and kills them in its stop method.

Servers

  • Default to AF_INET6 when binding to all addresses (e.g., ""). This supports both IPv4 and IPv6 connections (except on Windows). Original change in :pr:`495` by Felix Kaiser.
  • pywsgi/performance: Chunks of data the application returns are no longer copied before being sent to the socket when the transfer-encoding is chunked, potentially reducing overhead for large responses.

Threads

SSL

subprocess module

  • Setting SIGCHLD to SIG_IGN or SIG_DFL after :mod:`gevent.subprocess` had been used previously could not be reversed, causing Popen.wait and other calls to hang. Now, if SIGCHLD has been ignored, the next time :mod:`gevent.subprocess` is used this will be detected and corrected automatically. (This potentially leads to issues with :func:`os.popen` on Python 2, but the signal can always be reset again. Mixing the low-level process handling calls, low-level signal management and high-level use of :mod:`gevent.subprocess` is tricky.) Reported in :issue:`857` by Chris Utz.
  • Popen.kill and send_signal no longer attempt to send signals to processes that are known to be exited.

Several backwards compatible updates to the subprocess module have been backported from Python 3 to Python 2, making :mod:`gevent.subprocess` smaller, easier to maintain and in some cases safer.

  • Popen objects can be used as context managers even on Python 2. The high-level API functions (call, etc) use this for added safety.
  • The :mod:`gevent.subprocess` module now provides the :func:`gevent.subprocess.run` function in a cooperative way even when the system is not monkey patched, on all supported versions of Python. (It was added officially in Python 3.5.)
  • Popen objects save their args attribute even on Python 2.
  • :exc:`gevent.subprocess.TimeoutExpired` is defined even on Python 2, where it is a subclass of the :exc:`gevent.timeout.Timeout` exception; all instances where a Timeout exception would previously be thrown under Python 2 will now throw a TimeoutExpired exception.
  • :func:`gevent.subprocess.call` (and check_call) accepts the timeout keyword argument on Python 2. This is standard on Python 3, but a gevent extension on Python 2.
  • :func:`gevent.subprocess.check_output` accepts the timeout and input arguments on Python 2. This is standard on Python 3, but a gevent extension on Python 2.

1.1.2 (Jul 21, 2016)

  • Python 2: sendall on a non-blocking socket could spuriously fail with a timeout.
  • If sys.stderr has been monkey-patched (not recommended), exceptions that the hub reports aren't lost and can still be caught. Reported in :issue:`825` by Jelle Smet.
  • :class:`selectors.SelectSelector` is properly monkey-patched regardless of the order of imports. Reported in :issue:`835` by Przemysław Węgrzyn.
  • Python 2: reload(site) no longer fails with a TypeError if gevent has been imported. Reported in :issue:`805` by Jake Hilton.

1.1.1 (Apr 4, 2016)

1.1.0 (Mar 5, 2016)

  • Python 3: A monkey-patched :class:`threading.RLock` now properly blocks (or deadlocks) in acquire if the default value for timeout of -1 is used (which differs from gevent's default of None). The acquire method also raises the same :exc:`ValueError` exceptions that the standard library does for invalid parameters. Reported in :issue:`750` by Joy Zheng.
  • Fix a race condition in :class:`~gevent.event.Event` that made it return False when the event was set and cleared by the same greenlet before allowing a switch to already waiting greenlets. (Found by the 3.4 and 3.5 standard library test suites; the same as Python bug 13502. Note that the Python 2 standard library still has this race condition.)
  • :class:`~gevent.event.Event` and :class:`~.AsyncResult` now wake waiting greenlets in the same (unspecified) order. Previously, AsyncResult tended to use a FIFO order, but this was never guaranteed. Both classes also use less per-instance memory.
  • Using a :class:`~logging.Logger` as a :mod:`pywsgi` error or request log stream no longer produces extra newlines. Reported in :issue:`756` by ael-code.
  • Windows: Installing from an sdist (.tar.gz) on PyPI no longer requires having Cython installed first. (Note that the binary installation formats (wheels, exes, msis) are preferred on Windows.) Reported in :issue:`757` by Ned Batchelder.
  • Issue a warning when :func:`~gevent.monkey.patch_all` is called with os set to False (not the default) but signal is still True (the default). This combination of parameters will cause signal handlers for SIGCHLD to not get called. In the future this might raise an error. Reported by Josh Zuech.
  • Issue a warning when :func:`~gevent.monkey.patch_all` is called more than once with different arguments. That causes the cumulative set of all True arguments to be patched, which may cause unexpected results.
  • Fix returning the original values of certain threading attributes from :func:`gevent.monkey.get_original`.

1.1rc5 (Feb 24, 2016)

  • SSL: Attempting to send empty data using the :meth:`~socket.socket.sendall` method of a gevent SSL socket that has a timeout now returns immediately (like the standard library does), instead of incorrectly raising :exc:`ssl.SSLEOFError`. (Note that sending empty data with the :meth:`~socket.socket.send` method does raise SSLEOFError in both gevent and the standard library.) Reported in :issue:`719` by Mustafa Atik and Tymur Maryokhin, with a reproducible test case provided by Timo Savola.

1.1rc4 (Feb 16, 2016)

  • Python 2: Using the blocking API at import time when multiple greenlets are also importing should not lead to LoopExit. Reported in :issue:`728` by Garrett Heel.
  • Python 2: Don't raise :exc:`OverflowError` when using the readline method of the WSGI input stream without a size hint or with a large size hint when the client is uploading a large amount of data. (This only impacted CPython 2; PyPy and Python 3 already handled this.) Reported in :issue:`289` by ggjjlldd, with contributions by Nathan Hoad.
  • :class:`~gevent.baseserver.BaseServer` and its subclasses like :class:`~gevent.pywsgi.WSGIServer` avoid allocating a new closure for each request, reducing overhead.
  • Python 2: Under 2.7.9 and above (or when the PEP 466 SSL interfaces are available), perform the same hostname validation that the standard library does; previously this was skipped. Also, reading, writing, or handshaking a closed :class:`~ssl.SSLSocket` now raises the same :exc:`ValueError` the standard library does, instead of an :exc:`AttributeError`. Found by updating gevent's copy of the standard library test cases. Initially reported in :issue:`735` by Dmitrij D. Czarkoff.
  • Python 3: Fix :meth:`~ssl.SSLSocket.unwrap` and SNI callbacks. Also raise the correct exceptions for unconnected SSL sockets and properly validate SSL hostnames. Found via updated standard library tests.
  • Python 3: Add missing support for :meth:`socket.socket.sendfile`. Found via updated standard library tests.
  • Python 3.4+: Add missing support for :meth:`socket.socket.get_inheritable` and :meth:`~socket.socket.set_inheritable`. Found via updated standard library tests.

1.1rc3 (Jan 04, 2016)

  • Python 2: Support the new PEP 466 :mod:`ssl` interfaces on any Python 2 version that supplies them, not just on the versions it officially shipped with. Some Linux distributions, including RedHat/CentOS and Amazon have backported the changes to older versions. Reported in :issue:`702`.
  • PyPy: An interaction between Cython compiled code and the garbage collector caused PyPy to crash when a previously-allocated Semaphore was used in a __del__ method, something done in the popular libraries requests and urllib3. Due to this and other Cython related issues, the Semaphore class is no longer compiled by Cython on PyPy. This means that it is now traceable and not exactly as atomic as the Cython version, though the overall semantics should remain the same. Reported in :issue:`704` by Shaun Crampton.
  • PyPy: Optimize the CFFI backend to use less memory (two pointers per watcher).
  • Python 3: The WSGI PATH_INFO entry is decoded from URL escapes using latin-1, not UTF-8. This improves compliance with PEP 3333 and compatibility with some frameworks like Django. Fixed in :pr:`712` by Ruben De Visscher.

1.1rc2 (Dec 11, 2015)

  • Exceptions raised by gevent's SSL sockets are more consistent with the standard library (e.g., gevent's Python 3 SSL sockets raise :exc:`socket.timeout` instead of :exc:`ssl.SSLError`, a change introduced in Python 3.2).
  • Python 2: gevent's socket's sendall method could completely ignore timeouts in some cases. The timeout now refers to the total time taken by sendall.
  • gevent's SSL socket's sendall method should no longer raise SSL3_WRITE_PENDING in rare cases when sending large buffers. Reported in :issue:`317`.
  • :func:`gevent.signal.signal` now allows resetting (SIG_DFL) and ignoring (SIG_IGN) the SIGCHLD signal at the process level (although this may allow race conditions with libev child watchers). Reported in :issue:`696` by Adam Ning.
  • :func:`gevent.spawn_raw` now accepts keyword arguments, as previously (incorrectly) documented. Reported in :issue:`680` by Ron Rothman.
  • PyPy: PyPy 2.6.1 or later is now required (4.0.1 or later is recommended).
  • The CFFI backend is now built and usable on CPython implementations (except on Windows) if cffi is installed before gevent is installed. To use the CFFI backend, set the environment variable GEVENT_CORE_CFFI_ONLY before starting Python. This can aid debugging in some cases and helps ensure parity across all combinations of supported platforms.
  • The CFFI backend now calls the callback of a watcher whose args attribute is set to None, just like the Cython backend does. It also only allows args to be a tuple or None, again matching the Cython backend.
  • PyPy/CFFI: Fix a potential crash when using stat watchers.
  • PyPy/CFFI: Encode unicode paths for stat watchers using :meth:`sys.getfilesystemencoding` like the Cython backend.
  • The internal implementation modules gevent._fileobject2, gevent._fileobject3, and gevent._util were removed. These haven't been used or tested since 1.1b1.

1.1rc1 (Nov 14, 2015)

  • Windows/Python 3: Finish porting the :mod:`gevent.subprocess` module, fixing a large number of failing tests. Examples of failures are in :issue:`668` and :issue:`669` reported by srossross.

  • Python 3: The SSLSocket class should return an empty bytes object on an EOF instead of a str. Fixed in :pr:`674` by Dahoon Kim.

  • Python 2: Workaround a buffering bug in the stdlib io module that caused FileObjectPosix to be slower than necessary in some cases. Reported in :issue:`675` by WGH-.

  • PyPy: Fix a crash. Reported in :issue:`676` by Jay Oster.

    Caution!

    There are some remaining, relatively rare, PyPy crashes, but their ultimate cause is unknown (gevent, CFFI, greenlet, the PyPy GC?). PyPy users can contribute to :issue:`677` to help track them down.

  • PyPy: Exceptions raised while handling an error raised by a loop callback function behave like the CPython implementation: the exception is printed, and the rest of the callbacks continue processing.

  • If a Hub object with active watchers was destroyed and then another one created for the same thread, which itself was then destroyed with destroy_loop=True, the process could crash. Documented in :issue:`237` and fix based on :pr:`238`, both by Jan-Philip Gehrcke.

  • Python 3: Initializing gevent's hub for the first time simultaneously in multiple native background threads could fail with AttributeError and ImportError. Reported in :issue:`687` by Gregory Petukhov.

1.1b6 (Oct 17, 2015)

1.1b5 (Sep 18, 2015)

  • :mod:`gevent.subprocess` works under Python 3.5. In general, Python 3.5 has preliminary support. Reported in :issue:`653` by Squeaky.
  • :func:`Popen.communicate <gevent.subprocess.Popen.communicate>` honors a timeout argument even if there is no way to communicate with the child process (none of stdin, stdout and stderr were set to PIPE). Noticed as part of the Python 3.5 test suite for the new function subprocess.run but impacts all versions (timeout is an official argument under Python 3 and a gevent extension with slightly different semantics under Python 2).
  • Fix a possible ValueError from :meth:`Queue.peek <gevent.queue.Queue.peek>`. Reported in :issue:`647` by Kevin Chen.
  • Restore backwards compatibility for using gevent.signal as a callable, which, depending on the order of imports, could be broken after the addition of the gevent.signal module. Reported in :issue:`648` by Sylvain Zimmer.
  • gevent blocking operations performed at the top-level of a module after the system was monkey-patched under Python 2 could result in raising a :exc:`~gevent.hub.LoopExit` instead of completing the expected blocking operation. Note that performing gevent blocking operations in the top-level of a module is typically not recommended, but this situation can arise when monkey-patching existing scripts. Reported in :issue:`651` and :issue:`652` by Mike Kaplinskiy.
  • SIGCHLD and waitpid now work for the pids returned by the (monkey-patched) os.forkpty and pty.fork functions in the same way they do for the os.fork function. Reported in :issue:`650` by Erich Heine.
  • :class:`~gevent.pywsgi.WSGIServer` and :class:`~gevent.pywsgi.WSGIHandler` do a better job detecting and reporting potential encoding errors for headers and the status line during :meth:`~gevent.pywsgi.WSGIHandler.start_response` as recommended by the WSGI specification. In addition, under Python 2, unnecessary encodings and decodings (often a trip through the ASCII encoding) are avoided for conforming applications. This is an enhancement of an already documented and partially enforced constraint: beginning in 1.1a1, under Python 2, u'abc' would typically previously have been allowed, but u'\u1f4a3' would not; now, neither will be allowed, more closely matching the specification, improving debugability and performance and allowing for better error handling both by the application and by gevent (previously, certain encoding errors could result in gevent writing invalid/malformed HTTP responses). Reported by Greg Higgins and Carlos Sanchez.
  • Code coverage by tests is now reported on coveralls.io.

1.1b4 (Sep 4, 2015)

  • Detect and raise an error for several important types of programming errors even if Python interpreter optimizations are enabled with -O or PYTHONOPTIMIZE. Previously these would go undetected if optimizations were enabled, potentially leading to erratic, difficult to debug behaviour.
  • Fix an AttributeError from gevent.queue.Queue when peek was called on an empty Queue. Reported in :issue:`643` by michaelvol.
  • Make SIGCHLD handlers specified to :func:`gevent.signal.signal` work with the child watchers that are used by default. Also make :func:`gevent.os.waitpid` work with a first argument of -1. (Also applies to the corresponding monkey-patched stdlib functions.) Noted by users of gunicorn.
  • Under Python 2, any timeout set on a socket would be ignored when using the results of socket.makefile. Reported in :issue:`644` by Karan Lyons.

1.1b3 (Aug 16, 2015)

  • Fix an AttributeError from gevent.monkey.patch_builtins on Python 2 when the future library is also installed. Reported by Carlos Sanchez.
  • PyPy: Fix a DistutilsModuleError or ImportError if the CFFI module backing gevent.core needs to be compiled when the hub is initialized (due to a missing or invalid __pycache__ directory). Now, the module will be automtically compiled when gevent is imported (this may produce compiler output on stdout). Reported in :issue:`619` by Thinh Nguyen and :issue:`631` by Andy Freeland, with contributions by Jay Oster and Matt Dupre.
  • PyPy: Improve the performance of gevent.socket.socket:sendall with large inputs. bench_sendall.py now performs about as well on PyPy as it does on CPython, an improvement of 10x (from ~60MB/s to ~630MB/s). See this pypy bug for details.
  • Fix a possible TypeError when calling gevent.socket.wait. Reported in #635 by lanstin.
  • gevent.socket.socket:sendto properly respects the socket's blocking status (meaning it can raise EWOULDBLOCK now in cases it wouldn't have before). Reported in :pr:`634` by Mike Kaplinskiy.
  • Common lookup errors using the :mod:`threaded resolver <gevent.resolver_thread>` are no longer always printed to stderr since they are usually out of the programmer's control and caught explicitly. (Programming errors like TypeError are still printed.) Reported in :issue:`617` by Jay Oster and Carlos Sanchez.
  • PyPy: Fix a TypeError from gevent.idle(). Reported in :issue:`639` by chilun2008.
  • The :func:`~gevent.pool.Pool.imap_unordered` methods of a pool-like object support a maxsize parameter to limit the number of results buffered waiting for the consumer. Reported in :issue:`638` by Sylvain Zimmer.
  • The class :class:`gevent.queue.Queue` now consistently orders multiple blocked waiting put and get callers in the order they arrived. Previously, due to an implementation quirk this was often roughly the case under CPython, but not under PyPy. Now they both behave the same.
  • The class :class:`gevent.queue.Queue` now supports the :func:`len` function.

1.1b2 (Aug 5, 2015)

1.1b1 (Jul 17, 2015)

  • setup.py can be run from a directory containing spaces. Reported in :issue:`319` by Ivan Smirnov.
  • setup.py can build with newer versions of clang on OS X. They enforce the distinction between CFLAGS and CPPFLAGS.
  • gevent.lock.Semaphore is atomic on PyPy, just like it is on CPython. This comes at a small performance cost on PyPy.
  • Fixed regression that failed to set the successful value to False when killing a greenlet before it ran with a non-default exception. Fixed in :pr:`608` by Heungsub Lee.
  • libev's child watchers caused :func:`os.waitpid` to become unreliable due to the use of signals on POSIX platforms. This was especially noticeable when using :mod:`gevent.subprocess` in combination with multiprocessing. Now, the monkey-patched os module provides a :func:`~gevent.os.waitpid` function that seeks to ameliorate this. Reported in :issue:`600` by champax and :issue:`452` by Łukasz Kawczyński.
  • On platforms that implement :class:`select.poll`, provide a gevent-friendly :class:`gevent.select.poll` and corresponding monkey-patch. Implemented in :pr:`604` by Eddi Linder.
  • Allow passing of events to the io callback under PyPy. Reported in :issue:`531` by M. Nunberg and implemented in :pr:`604`.
  • :func:`gevent.thread.allocate_lock` (and so a monkey-patched standard library :func:`~thread.allocate_lock`) more closely matches the behaviour of the builtin: an unlocked lock cannot be released, and attempting to do so throws the correct exception (thread.error on Python 2, RuntimeError on Python 3). Previously, over-releasing a lock was silently ignored. Reported in :issue:`308` by Jędrzej Nowak.
  • :class:`gevent.fileobject.FileObjectThread` uses the threadpool to close the underling file-like object. Reported in :issue:`201` by vitaly-krugl.
  • Malicious or malformed HTTP chunked transfer encoding data sent to the :class:`pywsgi handler <gevent.pywsgi.WSGIHandler>` is handled more robustly, resulting in "HTTP 400 bad request" responses instead of a 500 error or, in the worst case, a server-side hang. Reported in :issue:`229` by Björn Lindqvist.
  • Importing the standard library threading module before using gevent.monkey.patch_all() no longer causes Python 3.4 to fail to get the repr of the main thread, and other CPython platforms to return an unjoinable DummyThread. (Note that this is not recommended.) Reported in :issue:`153`.
  • Under Python 2, use the io package to implement :class:`~gevent.fileobject.FileObjectPosix`. This unifies the code with the Python 3 implementation, and fixes problems with using seek(). See :issue:`151`.
  • Under Python 2, importing a module that uses gevent blocking functions at its top level from multiple greenlets no longer produces import errors (Python 3 handles this case natively). Reported in :issue:`108` by shaun and initial fix based on code by Sylvain Zimmer.
  • :func:`gevent.spawn`, :func:`spawn_raw` and :func:`spawn_later`, as well as the :class:`~gevent.Greenlet` constructor, immediately produce useful TypeErrors if asked to run something that cannot be run. Previously, the spawned greenlet would die with an uncaught TypeError the first time it was switched to. Reported in :issue:`119` by stephan.
  • Recursive use of :meth:`ThreadPool.apply <gevent.threadpool.ThreadPool.apply>` no longer raises a LoopExit error (using ThreadPool.spawn and then get on the result still could; you must be careful to use the correct hub). Reported in :issue:`131` by 8mayday.
  • When the :mod:`threading` module is :func:`monkey-patched <gevent.monkey.patch_thread>`, the module-level lock in the :mod:`logging` module is made greenlet-aware, as are the instance locks of any configured handlers. This makes it safer to import modules that use the standard pattern of creating a module-level :class:`~logging.Logger` instance before monkey-patching. Configuring logging with a basic configuration and then monkey-patching is also safer (but not configurations that involve such things as the SocketHandler).
  • Fix monkey-patching of :class:`threading.RLock` under Python 3.
  • Under Python 3, monkey-patching at the top-level of a module that was imported by another module could result in a :exc:`RuntimeError` from :mod:`importlib`. Reported in :issue:`615` by Daniel Mizyrycki. (The same thing could happen under Python 2 if a threading.RLock was held around the monkey-patching call; this is less likely but not impossible with import hooks.)
  • Fix configuring c-ares for a 32-bit Python when running on a 64-bit platform. Reported in :issue:`381` and fixed in :pr:`616` by Chris Lane. Additional fix in :pr:`626` by Kevin Chen.
  • (Experimental) Let the :class:`pywsgi.WSGIServer` accept a :class:`logging.Logger` instance for its log and (new) error_log parameters. Take care that the system is fully monkey-patched very early in the process's lifetime if attempting this, and note that non-file handlers have not been tested. Fixes :issue:`106`.

1.1a2 (Jul 8, 2015)

1.1a1 (Jun 29, 2015)

  • Add support for Python 3.3 and 3.4. Many people have contributed to this effort, including but not limited to Fantix King, hashstat, Elizabeth Myers, jander, Luke Woydziak, and others. See :issue:`38`.

  • Add support for PyPy. See :issue:`248`. Note that for best results, you'll need a very recent PyPy build including CFFI 1.2.0.

  • Drop support for Python 2.5. Python 2.5 users can continue to use gevent 1.0.x.

  • Fix :func:`gevent.joinall` to not ignore count when raise_error is False. See :pr:`512` by Ivan Diao.

  • Fix :class:`gevent.subprocess.Popen` to not ignore the bufsize argument. Note that this changes the (platform dependent) default, typically from buffered to unbuffered. See :pr:`542` by Romuald Brunet.

  • Upgraded c-ares to 1.10.0. See :pr:`579` by Omer Katz.

    Caution!

    The c-ares configure script is now more strict about the contents of environment variables such as CFLAGS and LDFLAGS and they may have to be modified (for example, CFLAGS is no longer allowed to include -I directives, which must instead be placed in CPPFLAGS).

  • Add a count argument to :func:`gevent.iwait`. See :pr:`482` by wiggin15.

  • Add a timeout argument to :meth:`gevent.queue.JoinableQueue.join` which now returns whether all items were waited for or not.

  • gevent.queue.JoinableQueue treats items passed to __init__ as unfinished tasks, the same as if they were put. Initial :pr:`554` by DuLLSoN.

  • gevent.pywsgi no longer prints debugging information for the normal conditions of a premature client disconnect. See :issue:`136`, fixed in :pr:`377` by Paul Collier.

  • (Experimental.) Waiting on or getting results from greenlets that raised exceptions now usually raises the original traceback. This should assist things like Sentry to track the original problem. See :issue:`450` and :issue:`528` by Rodolfo and Eddi Linder and :issue:`240` by Erik Allik.

  • Upgrade to libev 4.20. See :pr:`590` by Peter Renström.

  • Fix gevent.baseserver.BaseServer to be printable when its handle function is an instancemethod of itself. See :pr:`501` by Joe Jevnik.

  • Make the acquire method of gevent.lock.DummySemaphore always return True, supporting its use-case as an "infinite" or unbounded semaphore providing no exclusion, and allowing the idiom if sem.acquire(): .... See :pr:`544` by Mouad Benchchaoui.

  • Patch subprocess by default in gevent.monkey.patch_all. See :issue:`446`.

  • gevent.pool.Group.imap and imap_unordered now accept multiple iterables like itertools.imap. :issue:`565` reported by Thomas Steinacher.

  • Compatibility note: gevent.baseserver.BaseServer and its subclass gevent.server.StreamServer now deterministically close the client socket when the request handler returns. Previously, the socket was left at the mercies of the garbage collector; under CPython 2.x this meant when the last reference went away, which was usually, but not necessarily, when the request handler returned, but under PyPy it was some arbitrary point in the future and under CPython 3.x a ResourceWarning could be generated. This was undocumented behaviour, and the client socket could be kept open after the request handler returned either accidentally or intentionally.

  • Compatibility note: pywsgi now ensures that headers can be encoded in latin-1 (ISO-8859-1). This improves adherence to the HTTP standard (and is necessary under Python 3). Under certain conditions, previous versions could have allowed non-ISO-8859-1 headers to be sent, but their interpretation by a conforming recipient is unknown; now, a UnicodeError will be raised. See :issue:`614`.

Release 1.0.2

  • Fix LifoQueue.peek() to return correct element. :pr:`456`. Patch by Christine Spang.
  • Upgrade to libev 4.19
  • Remove SSL3 entirely as default TLS protocol
  • Import socket on Windows (closes :issue:`459`)
  • Fix C90 syntax error (:pr:`449`)
  • Add compatibility with Python 2.7.9's SSL changes. :issue:`477`.

Release 1.0.1

  • Fix :issue:`423`: Pool's imap/imap_unordered could hang forever. Based on patch and test by Jianfei Wang.

Release 1.0 (Nov 26, 2013)

  • pywsgi: Pass copy of error list instead of direct reference. Thanks to Jonathan Kamens, Matt Iversen.
  • Ignore the autogenerated doc/gevent.*.rst files. Patch by Matthias Urlichs.
  • Fix cythonpp.py on Windows. Patch by Jeryn Mathew.
  • Remove gevent.run (use gevent.wait).

Release 1.0rc3 (Sep 14, 2013)

  • Fix :issue:`251`: crash in gevent.core when accessing destroyed loop.
  • Fix :issue:`235`: Replace self._threadpool.close() with self._threadpool.kill() in hub.py. Patch by Jan-Philip Gehrcke.
  • Remove unused timeout from select.py (:issue:`254`). Patch by Saúl Ibarra Corretgé.
  • Rename Greenlet.link()'s argument to 'callback' (closes :issue:`244`).
  • Fix parallel build (:issue:`193`). Patch by Yichao Yu.
  • Fix :issue:`263`: potential UnboundLocalError: 'length' in gevent.pywsgi.
  • Simplify psycopg2_pool.py (:issue:`239`). Patch by Alex Gaynor.
  • pywsgi: allow Content-Length in GET requests (:issue:`264`). Patch by 陈小玉.
  • documentation fixes (:issue:`281`) [philipaconrad].
  • Fix old documentation about default blocking behavior of kill, killall (:issue:`306`). Patch by Daniel Farina.
  • Fix :issue:`6`: patch sys after thread. Patch by Anton Patrushev.
  • subprocess: fix check_output on Py2.6 and older (:issue:`265`). Thanks to Marc Sibson for test.
  • Fix :issue:`302`: "python -m gevent.monkey" now sets __file__ properly.
  • pywsgi: fix logging when bound on unix socket (:issue:`295`). Thanks to Chris Meyers, Eugene Pankov.
  • pywsgi: readout request data to prevent ECONNRESET
  • Fix :issue:`303`: 'requestline' AttributeError in pywsgi. Thanks to Neil Chintomby.
  • Fix :issue:`79`: Properly handle HTTP versions. Patch by Luca Wehrstedt.
  • Fix :issue:`216`: propagate errors raised by Pool.map/imap

Release 1.0rc2 (Dec 10, 2012)

  • Fixed :issue:`210`: callbacks were not run for non-default loop (bug introduced in 1.0rc1).
  • patch_all() no longer patches subprocess unless subprocess=True is passed.
  • Fixed AttributeError in hub.Waiter.
  • Fixed :issue:`181`: make hidden imports visible to freezing tools like py2exe. Patch by Ralf Schmitt.
  • Fixed :issue:`202`: periodically yield when running callbacks (sleep(0) cannot block the event loop now).
  • Fixed :issue:`204`: os.tp_read/tp_write did not propogate errors to the caller.
  • Fixed :issue:`217`: do not set SO_REUSEADDR on Windows.
  • Fixed bug in --module argument for gevent.monkey. Patch by Örjan Persson.
  • Remove warning from threadpool.py about mixing fork() and threads.
  • Cleaned up hub.py from code that was needed to support older greenlets. Patch by Saúl Ibarra Corretgé.
  • Allow for explicit default loop creation via get_hub(default=True). Patch by Jan-Philip Gehrcke.

Release 1.0rc1 (Oct 30, 2012)

  • Fixed hub.switch() not to touch stacktrace when switching. greenlet restores the exception information correctly since version 0.3.2. gevent now requires greenlet >= 0.3.2
  • Added gevent.wait() and gevent.iwait(). This is like gevent.joinall() but supports more objects, including Greenlet, Event, Semaphore, Popen. Without arguments it waits for the event loop to finish (previously gevent.run() did that). gevent.run will be removed before final release and gevent.joinall() might be deprecated.
  • Reimplemented loop.run_callback with a list and a single prepare watcher; this fixes the order of spawns and improves performance a little.
  • Fixes Semaphore/Lock not to init hub in __init__, so that it's possible to have module-global locks without initializing the hub. This fixes monkey.patch_all() not to init the hub.
  • New implementation of callbacks that executes them in the order they were added. core.loop.callback is removed.
  • Fixed 2.5 compatibility.
  • Fixed crash on Windows when request 'prev' and 'attr' attributes of 'stat' watcher. The attribute access still fails, but now with an exception.
  • Added known_failures.txt that lists all the tests that fail. It can be used by testrunner.py via expected option. It's used when running the test suite in travis.
  • Fixed socket, ssl and fileobject to not mask EBADF error - it is now propogated to the caller. Previously EBADF was converted to empty read/write. Thanks to Vitaly Kruglikov
  • Removed gevent.event.waitall()
  • Renamed FileObjectThreadPool -> FileObjectThread
  • Greenlet: Fixed :issue:`143`: greenlet links are now executed in the order they were added
  • Synchronize access to FileObjectThread with Semaphore
  • EINVAL is no longer handled in fileobject.

monkey:

  • Fixed :issue:`178`: disable monkey patch os.read/os.write
  • Fixed monkey.patch_thread() to patch threading._DummyThread to avoid leak in threading._active. Original patch by Wil Tan.
  • added Event=False argument to patch_all() and patch_thread
  • added patch_sys() which patches stdin, stdout, stderr with FileObjectThread wrappers. Experimental / buggy.
  • monkey patching everything no longer initializes the hub/event loop.

socket:

  • create_connection: do not lookup IPv6 address if IPv6 is unsupported. Patch by Ralf Schmitt.

pywsgi:

  • Fixed :issue:`86`: bytearray is now supported. Original patch by Aaron Westendorf.
  • Fixed :issue:`116`: Multiline HTTP headers are now handled properly. Patch by Ralf Schmitt.

subprocess:

  • Fixed Windows compatibility. The wait() method now also supports 'timeout' argument on Windows.
  • Popen: Added rawlink() method, which makes Popen objects supported by gevent.wait(). Updated examples/processes.py
  • Fixed :issue:`148`: read from errpipe_read in small chunks, to avoid trigger EINVAL issue on Mac OS X. Patch by Vitaly Kruglikov
  • Do os._exit() in "finally" section to avoid executing unrelated code. Patch by Vitaly Kruglikov.

resolver_ares:

  • improve getaddrinfo: For string ports (e.g. "http") resolver_ares/getaddrinfo previously only checked either getservbyname(port, "tcp") or getservbyname(port, "udp"), but never both. It now checks both of them.
  • gevent.ares.channel now accepts strings as arguments
  • upgraded c-ares to cares-1_9_1-12-g805c736
  • it is now possible to configure resolver_ares directly with environ, like GEVENTARES_SERVERS

os:

  • Renamed threadpool_read/write to tp_read/write.
  • Removed posix_read, posix_write.
  • Added nb_read, nb_write, make_nonblocking.

hub:

  • The system error is now raised immediatelly in main greenlet in all cases.
  • Dropped support for old greenlet versions (need >= 0.3.2 now)

core:

  • allow 'callback' property of watcher to be set to None. "del w.callback" no longer works.
  • added missing 'noinotify' flag

Misc:

  • gevent.thread: allocate_lock is now an alias for LockType/Semaphore. That way it does not fail when being used as class member.
  • Updated greentest.py to start timeouts with ref=False.
  • pool: remove unused get_values() function
  • setup.py now recognizes GEVENTSETUP_EV_VERIFY env var which sets EV_VERIFY macro when compiling
  • Added a few micro benchmarks
  • stdlib tests that we care about are now included in greentest/2.x directories, so we don't depend on them being installed system-wide
  • updated util/makedist.py
  • the testrunner was completely rewritten.

Release 1.0b4 (Sep 6, 2012)

  • Added gevent.os module with 'read' and 'write' functions. Patch by Geert Jansen.
  • Moved gevent.hub.fork to gevent.os module (it is still available as gevent.fork).
  • Fixed :issue:`148`: Made fileobject handle EINVAL, which is randomly raised by os.read/os.write on Mac OS X. Thanks to Mark Hingston.
  • Fixed :issue:`150`: gevent.fileobject.SocketAdapter.sendall() could needlessly wait for write event on the descriptor. Original patch by Mark Hingston.
  • Fixed AttributeError in baseserver. In case of error, start() would call kill() which was renamed to close(). Thanks to Vitaly Kruglikov.

Release 1.0b3 (Jul 27, 2012)

  • New gevent.subprocess module
  • New gevent.fileobject module
  • Fixed ThreadPool to discard references of the objects passed to it (function, arguments) asap. Previously they could be stored for unlimited time until the thread gets a new job.
  • Fixed :issue:`138`: gevent.pool.Pool().imap_unordered hangs with an empty iterator. Thanks to exproxus.
  • Fixed :issue:`127`: ssl.py could raise TypeError in certain cases. Thanks to Johan Mjones.
  • Fixed socket.makefile() to keep the timeout setting of the socket instance. Thanks to Colin Marc.
  • Added 'copy()' method to queues.
  • The 'nochild' event loop config option is removed. The install_sigchld offer more flexible way of enabling child watchers.
  • core: all watchers except for 'child' now accept new 'priority' keyword argument
  • gevent.Timeout accepts new arguments: 'ref' and 'priority'. The default priority for Timeout is -1.
  • Hub.wait() uses Waiter now instead of raw switching
  • Updated libev to the latest CVS version
  • Made pywsgi to raise an AssertionError if non-zero content-length is passed to start_response(204/304) or if non-empty body is attempted to be written for 304/204 response
  • Removed pywsgi feature to capitalize the passed headers.
  • Fixed util/cythonpp.py to work on python3.2 (:issue:`123`). Patch by Alexandre Kandalintsev.
  • Added 'closed' readonly property to socket.
  • Added 'ref' read/write property to socket.
  • setup.py now parses CARES_EMBED and LIBEV_EMBED parameters, in addition to EMBED.
  • gevent.reinit() and gevent.fork() only reinit hub if it was created and do not create it themselves
  • Fixed setup.py not to add libev and c-ares to include dirs in non-embed mode. Patch by Ralf Schmitt.
  • Renamed util/make_dist.py to util/makedist.py
  • testrunner.py now saves more information about the system; the stat printing functionality is moved to a separate util/stat.py script.

Release 1.0b2 (Apr 11, 2012)

Major and backward-incompatible changes:

  • Made the threadpool-based resolver the default. To enable the ares-based resolver, set GEVENT_RESOLVER=ares env var.
  • Added support for child watchers (not available on Windows). - Libev loop now reaps all children by default. - If NOCHILD flag is passed to the loop, child watchers and child reaping are disabled.
  • Renamed gevent.coros to gevent.lock. The gevent.coros is still available but deprecated.
  • Added 'stat' watchers to loop.
  • The setup.py now recognizes gevent_embed env var. When set to "no", bundled c-ares and libev are ignored.
  • Added optional 'ref' argument to sleep(). When ref=false, the watchers created by sleep() do not hold gevent.run() from exiting.
  • ThreadPool now calls Hub.handle_error for exceptions in worker threads.
  • ThreadPool got new method: apply_e.
  • Added new extension module gevent._util and moved gevent.core.set_exc_info function there.
  • Added new extension module gevent._semaphore. It contains Semaphore class which is imported by gevent.lock as gevent.lock.Semaphore. Providing Semaphore in extension module ensures that trace function set with settrace will not be called during __exit__. Thanks to Ralf Schmitt.
  • It is now possible to kill or pre-spawn threads in ThreadPool by setting its 'size' property.

core:

  • Make sure the default loop cannot be destroyed more than once, thus crashing the process.
  • Make Hub.destroy() method not to destroy the default loop, unless destroy_loop is True. Non-default loops are still destroyed by default.
  • loop: Removed properties from loop: fdchangecnt, timercnt, asynccnt.
  • loop: Added properties: sigfd, origflags, origflags_int
  • loop: The EVFLAG_NOENV is now always passed to libev. Thus LIBEV_FLAGS env variable is no longer checked. Use GEVENT_BACKEND.

Misc:

  • Check that the argument of link() is callable. Raise TypeError when it's not.
  • Fixed TypeError in baseserver when parsing an address.
  • Pool: made add() and discard() usable by external users. Thanks to Danil Eremeev.
  • When specifying a class to import, it is now possible to use format path/package.module.name
  • pywsgi: Made sure format_request() does not fail if 'status' attribute is not set yet
  • pywsgi: Added REMOTE_PORT variable to the environment.

Examples:

  • portforwarder.py now shows how to use gevent.run() to implement graceful shutdown of a server.
  • psycopg2_pool.py: Changed execute() to return rowcount.
  • psycopg2_pool.py: Added fetchall() and fetchiter() methods.

Developer utilities:

  • When building, CYTHON env variable can be used to specify Cython executable to use.
  • util/make_dist.py now recongizes --fast and --revert options. Previous --rsync option is removed.
  • Added util/winvbox.py which automates building/testing/making binaries on Windows VM.
  • Fixed typos in exception handling code in testrunner.py
  • Fixed patching unittest.runner on Python2.7. This caused the details of test cases run lost.
  • Made testrunner.py kill the whole process group after test is done.

Release 1.0b1 (Jan 10, 2012)

Backward-incompatible changes:

  • Removed "link to greenlet" feature of Greenlet.
  • If greenlet module older than 0.3.2 is used, then greenlet.GreenletExit.__bases__ is monkey patched to derive from BaseException and not Exception. That way gevent.GreenletExit is always derived from BaseException, regardless of installed greenlet version.
  • Some code supporting Python 2.4 has been removed.

Release highlights:

  • Added thread pool: gevent.threadpool.ThreadPool.
  • Added thread pool-based resolver. Enable with GEVENT_RESOLVER=thread.
  • Added UDP server: gevent.server.DatagramServer
  • A "configure" is now run on libev. This fixes a problem of 'kqueue' not being available on Mac OS X.
  • Gevent recognizes some environment variables now: - GEVENT_BACKEND allows passing argument to loop, e.g. "GEVENT_BACKEND=select" for force select backend - GEVENT_RESOLVER allows choosing resolver class. - GEVENT_THREADPOOL allows choosing thread pool class.
  • Added new examples: portforwarder, psycopg2_pool.py, threadpool.py, udp_server.py
  • Fixed non-embedding build. To build against system libev, remove or rename 'libev' directory. To build against system c-ares, remove or rename 'c-ares'. Thanks to Örjan Persson.

misc: - gevent.joinall() method now accepts optional 'count' keyword. - gevent.fork() only calls reinit() in the child process now. - gevent.run() now returns False when exiting because of timeout or event (previous None). - Hub got a new method: destroy(). - Hub got a new property: threadpool.

ares.pyx: - Fixed :issue:`104`: made ares_host_result pickable. Thanks to Shaun Cutts.

pywsgi: - Removed unused deprecated 'wfile' property from WSGIHandler - Fixed :issue:`92`: raise IOError on truncated POST requests. - Fixed :issue:`93`: do not sent multiple "100 continue" responses

core: - Fixed :issue:`97`: the timer watcher now calls ev_now_update() in start() and again() unless 'update' keyword is passed and set to False. - add set_syserr_cb() function; it's used by gevent internally. - gevent now installs syserr callback using libev's set_syserr_cb. This callback is called when libev encounters an error it cannot recover from. The default action is to print a message and abort. With the callback installed, a SystemError() is now raised in the main greenlet. - renamed 'backend_fd' property to 'fileno()' method. (not available if you build gevent against system libev) - added 'asynccnt' property (not available if you build gevent against system libev) - made loop.__repr__ output a bit more compact - the watchers check the arguments for validness now (previously invalid argument would crash libev). - The 'async' watcher now has send() method; - fixed time() function - libev has been upgraded to latest CVS version. - libev has been patched to use send()/recv() for evpipe on windows when libev_vfd.h is in effect

resolver_ares: - Slightly improved compatibility with stdlib's socket in some error cases.

socket: - Fixed close() method not to reference any globals - Fixed :issue:`115`: _dummy gets unexpected Timeout arg - Removed _fileobject used for python 2.4 compatibility in socket.py - Fixed :issue:`94`: fallback to buffer if memoryview fails in _get_memory on python 2.7

monkey: - Removed patch_httplib() - Fixed :issue:`112`: threading._sleep is not patched. Thanks to David LaBissoniere. - Added get_unpatched() function. However, it is slightly broken at the moment.

backdoor: - make 'locals()' not spew out __builtin__.__dict__ in backdoor - add optional banner argument to BackdoorServer

servers: - add server.DatagramServer; - StreamServer: 'ssl_enabled' is now a read-only property - servers no longer have 'kill' method; it has been renamed to 'close'. - listeners can now be configured as strings, e.g. ':80' or 80 - modify baseserver.BaseServer in such a way that makes it a good base class for both StreamServer and DatagramServer - BaseServer no longer accepts 'backlog' parameter. It is now done by StreamServer. - BaseServer implements start_accepting() and stop_accepting() methods - BaseServer now implements "temporarily stop accepting" strategy - BaseServer now has _do_read method which does everything except for actually calling accept()/recvfrom() - pre_start() method is renamed to init_socket() - renamed _stopped_event to _stop_event - 'started' is now a read-only property (which actually reports state of _stop_event) - post_stop() method is removed - close() now sets _stop_event(), thus setting 'started' to False, thus causing serve_forever() to exit - _tcp_listener() function is moved from baseserver.py to server.py - added 'fatal_errors' class attribute which is a tuple of all errnos that should kill the server

coros: - Semaphore: add _start_notify() method - Semaphore: avoid copying list of links; rawlink() no longer schedules notification

Release 1.0a3 (Sep 15, 2011)

Added 'ref' property to all watchers. Settings it to False make watcher call ev_unref/ev_ref appropriately so that this watcher does not prevent loop.run()/hub.join()/run() from exiting. Made resolver_ares.Resolver use 'ref' property for internal watcher.

In all servers, method "kill" was renamed to "close". The old name is available as deprecated alias.

Added a few properties to the loop: backend_fd, fdchangecnt, timercnt.

Upgraded c-ares to 1.7.5+patch.

Fixed getaddrinfo to return results in the order (::1, IPv4, IPv6).

Fixed getaddrinfo() to handle integer of string type. Thanks to kconor.

Fixed gethostbyname() to handle '' (empty string).

Fixed getaddrinfo() to convert UnicodeEncodeError into error('Int or String expected').

Fixed getaddrinfo() to uses the lowest 16 bits of passed port integer similar to built-in _socket.

Fixed getnameinfo() to call getaddrinfo() to process arguments similar to built-in _socket.

Fixed gethostbyaddr() to use getaddrinfo() to process arguments.

version_info is now a 5-tuple.

Added handle_system_error() method to Hub (used internally).

Fixed Hub's run() method to never exit. This prevent inappropriate switches into parent greenlet.

Fixed Hub.join() to return True if Hub was already dead.

Added 'event' argument to Hub.join().

Added run() function to gevent top level package.

Fixed Greenlet.start() to exit silently if greenlet was already started rather than raising :exc:`AssertionError`.

Fixed Greenlet.start() not to schedule another switch if greenlet is already dead.

Fixed gevent.signal() to spawn Greenlet instead of raw greenlet. Also it'll switch into the new greenlet immediately instead of scheduling additional callback.

Do monkey patch create_connection() as gevent's version works better with gevent.socket.socket than the standard create_connection.

pywsgi: make sure we don't try to read more requests if socket operation failed with EPIPE

pywsgi: if we failed to send the reply, change 'status' to socket error so that the logs mention the error.

Release 1.0a2 (Aug 2, 2011)

Fixed a bug in gevent.queue.Channel class. (Thanks to Alexey Borzenkov)

Release 1.0a1 (Aug 2, 2011)

Backward-incompatible changes:

Release highlights:

  • The :mod:`gevent.core` module now wraps libev's API and is not compatible with gevent 0.x.
  • Added a concept of pluggable event loops. By default gevent.core.loop is used, which is a wrapper around libev.
  • Added a concept of pluggable name resolvers. By default a resolver based on c-ares library is used.
  • Added support for multiple OS threads, each new thread will get its own Hub instance with its own event loop.
  • The release now includes and embeds the dependencies: libev and c-ares.
  • The standard :mod:`signal` works now as expected.
  • The unhandled errors are now handled uniformely by Hub.handle_error function.
  • Added :class:`Channel` class to :mod:`gevent.queue` module. It is equivalent to Queue(0) in gevent 0.x, which is deprecated now.
  • Added method :meth:`peek` to :class:`Queue` class.
  • Added :func:`idle` function which blocks until the event loop is idle.
  • Added a way to gracefully shutdown the application by waiting for all outstanding greenlets/servers/watchers: :meth:`Hub.join`.
  • Added new :mod:`gevent.ares` C extension which wraps c-ares and provides asynchronous DNS resolver.
  • Added new :mod:`gevent.resolver_ares` module provides synchronous API on top of :mod:`gevent.ares`.

The :mod:`gevent.socket` module:

  • DNS functions now use c-ares library rather than libevent-dns. This fixes a number of problems with name resolving:
    • Fix :issue:`2`: DNS resolver no longer breaks after fork(). You still need to call :func:`gevent.fork` (os.fork is monkey
      patched with it if monkey.patch_all() was called).
    • DNS resolver no longer ignores /etc/resolv.conf and /etc/hosts.
  • The following functions were added to socket module - gethostbyname_ex - getnameinfo - gethostbyaddr - getfqdn
  • Removed undocumented bind_and_listen and tcp_listener

The :class:`Hub` object:

  • Added :meth:`join` method which waits until the event loop exits or optional timeout expires.
  • Added :meth:`wait` method which waits until a watcher has got an event.
  • Added :meth:`handle_error` method which is called by all of gevent in case of unhandled exception.
  • Added :meth:`print_exception` method which is called by handle_error to print the exception traceback.

The :class:`Greenlet` objects:

  • Added __nonzero__ implementation that returns True after greenlet was started until it's dead. Previously greenlet was False after start() until it was first switched to.

The mod:gevent.pool module:

  • It is now possible to add raw greenlets to the pool.
  • The :meth:`map` and :meth:`imap` methods now start yielding the results as soon as possible.
  • The :meth:`imap_unordered` no longer swallows an exception raised while iterating its argument.

Miscellaneous:

  • gevent.sleep(<negative value>) no longer raises an exception, instead it does sleep(0).
  • Added method clear to internal Waiter class.
  • Removed wait method from internal Waiter class.
  • The :class:`WSGIServer` now sets max_accept to 1 if wsgi.multiprocessing is set to True.
  • Added :func:`monkey.patch_module` function that monkey patches module using __implements__ list provided by gevent module. All of gevent modules that replace stdlib module now have __implements__ attribute.

Release 0.13.8 (September 6, 2012)

  • Fixed :issue:`80`: gevent.httplib failed with RequestFailed errors because timeout was reset to 1s. Patch by Tomasz Prus.
  • core: fix compilation with the latest Cython: remove emit_ifdef/emit_else/emit_endif.
  • Fixed :issue:`132`: gevent.socket.gethostbyname(<unicode>) now does ascii encoding and uses gevent's resolver rather than calling built-in resolver. Patch by Alexey Borzenkov.

Release 0.13.7 (April 12, 2012)

  • Fixed :issue:`94`: fallback to buffer if memoryview fails in _get_memory on python 2.7.
  • Fixed :issue:`103`: Queue(None).full() returns False now (previously it returned True).
  • Fixed :issue:`112`: threading._sleep is not patched. Thanks to David LaBissoniere.
  • Fixed :issue:`115`: _dummy gets unexpected Timeout arg.

Release 0.13.6 (May 2, 2011)

  • Added __copy__ method to :class:`gevent.local.local` class that implements copy semantics compatible with built-in threading.local. Patch by Galfy Pundee.
  • Fixed :class:`StreamServer` class to catch EWOULDBLOCK rather than EAGAIN. This fixes lots of spurious tracebacks on Windows where these two constants are not the same. Patch by Alexey Borzenkov.
  • Fixed :issue:`65`: :func:`fork` now calls event_reinit only in the child process; otherwise the process could hang when using libevent2. Patch by Alexander Boudkar.

Release 0.13.5 (Apr 21, 2011)

  • Fixed build problem on Python 2.5

Release 0.13.4 (Apr 11, 2011)

Release 0.13.3 (Feb 7, 2011)

Release 0.13.2 (Jan 28, 2011)

Release 0.13.1 (Sep 23, 2010)

Release highlights:

:mod:`gevent.socket` module:

:mod:`gevent.ssl` module:

  • Imported a number of patches from stdlib by Antoine Pitrou:
    • Calling :meth:`makefile` method on an SSL object would prevent the underlying socket from being closed until all objects get truely destroyed (Python issue #5238).
    • SSL handshake would ignore the socket timeout and block indefinitely if the other end didn't respond (Python issue #5103).
    • When calling :meth:`getpeername` in SSLSocket.__init__, only silence exceptions caused by the "socket not connected" condition.
  • Added support for ciphers argument.
  • Updated SSLSocket.send and SSLSocket.recv methods to match the behavior of stdlib :mod:`ssl` better.
  • Fixed :class:`ssl.SSLObject` to delete events used by other greenlets when closing the instance (:issue:`34`).

Miscellaneous:

  • Made :class:`BaseServer` accept long values as pool argument in addition to int.
  • Made :attr:`http._requests` attribute public.
  • Updated webchat example to use file on disk rather than in-memory sqlite database to avoid :exc:`OperationalError`.
  • Fixed webproxy.py example to be runnable under external WSGI server.
  • Fixed bogus failure in test__exc_info.py.
  • Added new test to check PEP8 conformance: xtest_pep8.py.
  • Fixed :class:`BackdoorServer` close the connection on :exc:`SystemExit` and simplified the code.
  • Made :class:`Pool` raise :exc:`ValueError` when initialized with size=0.
  • Updated setup.py --libevent to configure and make libevent if it's not built already.
  • Updated setup.py to use setuptools if present and add dependency on greenlet.
  • Fixed doc/mysphinxext.py to work with Sphinx 1. Thanks by Örjan Persson.

Release 0.13.0 (Jul 14, 2010)

Release highlights:

Backward-incompatible changes:

:mod:`gevent.socket` module:

:mod:`gevent.coros` module:

:mod:`gevent.event` module:

:mod:`gevent.wsgi` module:

:mod:`gevent.pywsgi` module:

:mod:`gevent.core` module:

:mod:`gevent.http` and :mod:`gevent.wsgi` modules:

Miscellaneous:

Examples:

Thanks to Ralf Schmitt for :mod:`pywsgi`, a number of fixes for :mod:`wsgi`, help with :mod:`baseserver` and :mod:`server` modules, improving setup.py and various other patches and suggestions.

Thanks to Uriel Katz for :mod:`pywsgi` patches.

Release 0.12.2 (Mar 2, 2010)

  • Fixed http server to put the listening socket into a non-blocking mode. Contributed by Ralf Schmitt.

Release 0.12.1 (Feb 26, 2010)

  • Removed a symlink from the distribution (that causes pip to fail). Thanks to Brad Clements for reporting it.
  • setup.py: automatically create symlink from build/lib.../gevent/core.so to gevent/core.so.
  • :mod:`gevent.socket`: Improved compatibility with stdlib's socket:

Release 0.12.0 (Feb 5, 2010)

Release highlights:

:mod:`gevent.wsgi` module:

  • Made env["REMOTE_PORT"] into a string.
  • Fixed the server to close the iterator returned by the application.
  • Made wsgi.input object iterable.

:mod:`gevent.core` module:

  • Made DNS functions no longer accept/return IP addresses in dots-and-numbers format. They work with packed IPs now.
  • Made DNS functions no longer accept additional arguments to pass to the callback.
  • Fixed DNS functions to check the return value of the libevent functions and raise :exc:`IOError` if they failed.
  • Added :func:`core.dns_err_to_string`.
  • Made core.event.cancel not to raise if event_del reports an error. instead, the return code is passed to the caller.
  • Fixed minor issue in string representation of the events.

:mod:`gevent.socket` module:

Miscellaneous:

Release 0.11.2 (Dec 10, 2009)

Release 0.11.1 (Nov 15, 2009)

  • Fixed bug in :func:`select.select` function. Passing non-empty list of write descriptors used to cause this function to fail.
  • Changed setup.py to go ahead with the compilation even if the actual version of libevent cannot be determined (version 1.x.x is assumed in that case).

Contributed by Ludvig Ericson:

  • Fixed :mod:`wsgi`'s start_response to recognize exc_info argument.
  • Fixed setup.py to look for libevent.dylib rather than .so on Darwin platforms.

Release 0.11.0 (Oct 9, 2009)

Release 0.10.0 (Aug 26, 2009)

The following items were added to the gevent top level package:

The following items were marked as deprecated:

Internally, gevent.greenlet was split into a number of modules:

Thanks to Jason Toffaletti for reporting the installation issue and providing a test case for WSGI double content-length header bug.

Release 0.9.3 (Aug 3, 2009)

  • Fixed all known bugs in the :mod:`gevent.queue` module and made it 2.4-compatible. :class:`LifoQueue` and :class:`PriorityQueue` are implemented as well. :mod:`gevent.queue` will deprecate both coros.Queue and coros.Channel.
  • Fixed :class:`Timeout` to raise itself by default. TimeoutError is gone. Silent timeout is now created by passing False instead of None.
  • Fixed bug in :func:`gevent.select.select` where it could silent the wrong timeout.
  • :func:`spawn` and :func:`spawn_later` now avoid creating a closure and this decreases spawning time by 50%.
  • kill's and killall's wait argument was renamed to block. The polling is now implemented by greenlet.join and greenlet.joinall functions and it become more responsive, with gradual increase of sleep time.
  • Renamed proc.RunningProcSet to proc.ProcSet.
  • Added :func:`shutdown` function, which blocks until libevent has finished dispatching the events.
  • The return value of event_add and event_del in core.pyx are now checked properly and :exc:`IOError` is raised if they have failed.
  • Fixed backdoor.py, accidentally broken in the previous release.

Release 0.9.2 (Jul 20, 2009)

Release 0.9.1 (Jul 9, 2009)

  • Fixed compilation with libevent-1.3. Thanks to Litao Wei for reporting the problem.
  • Fixed :class:`Hub` to recover silently after event_dispatch() failures (I've seen this happen after fork even though event_reinit() is called as necessary). The end result is that :func:`fork` now works more reliably, as detected by test_socketserver.py - it used to fail occasionally, now it does not.
  • Reorganized the package, most of the stuff from gevent/__init__.py was moved to gevent/greenlet.py. gevent/__init__.py imports some of it back but not everything.
  • Renamed gevent.timeout to :class:`gevent.Timeout`. The old name is available as an alias.
  • Fixed a few bugs in :class:`queue.Queue`. Added test_queue.py from standard tests to check how good is :class:`queue.Queue` a replacement for a standard :mod:`Queue` (not good at all, timeouts in :meth:`queue.Queue.put` don't work yet)
  • :mod:`monkey` now patches ssl module when on 2.6 (very limited support).
  • Improved compatibility with Python 2.6 and Python 2.4.
  • Greenlet installed from PyPI (without py.magic prefix) is properly recognized now.
  • core.pyx was accidentally left out of the source package, it's included now.
  • :class:`GreenSocket <socket.socket>` now wraps a socket object from _socket module rather than from :mod:`socket`.

Release 0.9.0 (Jul 8, 2009)

Started as eventlet 0.8.11 fork, with the intention to support only libevent as a backend. Compared to eventlet, this version has a much simpler API and implementation and a few severe bugs fixed, namely

There's a test in my repo of eventlet that reproduces both of them: http://bitbucket.org/denis/eventlet/src/tip/greentest/test__socket.py

Besides having less bugs and less code to care about the goals of the fork are:

  • Piggy-back on libevent as much as possible (use its http and dns code).
  • Use the interfaces and conventions from the standard Python library where possible.