cpython/Lib/test
Joshua Herman 9e011e7c77
gh-82054: allow test runner to split test_asyncio to execute in parallel by sharding. (#103927)
This runs test_asyncio sub-tests in parallel using sharding from Cinder. This suite is typically the longest-pole in runs because it is a test package with a lot of further sub-tests otherwise run serially. By breaking out the sub-tests as independent modules we can run a lot more in parallel.

After porting we can see the direct impact on a multicore system.

Without this change:
  Running make test is 5 min 26 seconds
With this change:
  Running make test takes 3 min 39 seconds

That'll vary based on system and parallelism. On a `-j 4` run similar to what CI and buildbot systems often do, it reduced the overall test suite completion latency by 10%.

The drawbacks are that this implementation is hacky and due to the sorting of the tests it obscures when the asyncio tests occur and involves changing CPython test infrastructure but, the wall time saved it is worth it, especially in low-core count CI runs as it pulls a long tail. The win for productivity and reserved CI resource usage is significant.

Future tests that deserve to be refactored into split up suites to benefit from are test_concurrent_futures and the way the _test_multiprocessing suite gets run for all start methods. As exposed by passing the -o flag to python -m test to get a list of the 10 longest running tests.

---------

Co-authored-by: Carl Meyer <carl@oddbird.net>
Co-authored-by: Gregory P. Smith <greg@krypto.org> [Google, LLC]
2023-04-29 18:26:24 -07:00
..
audiodata gh-77171 Support WAVE_FORMAT_EXTENSIBLE in the wave module (GH-96777) 2022-09-14 14:34:40 +01:00
capath
cjkencodings
crashers
data
decimaltestdata
dtracedata
encoded_modules
imghdrdata
leakers
libregrtest gh-82054: allow test runner to split test_asyncio to execute in parallel by sharding. (#103927) 2023-04-29 18:26:24 -07:00
sndhdrdata
subprocessdata
support GH-103857: Deprecate utcnow and utcfromtimestamp (#103858) 2023-04-27 11:32:30 -06:00
test_asyncio gh-103793: Defer formatting task name (#103767) 2023-04-29 08:20:09 -07:00
test_capi GH-103805: Lib test f541 linting issue fix (#103812) 2023-04-24 23:24:49 +00:00
test_ctypes gh-84436: Implement Immortal Objects (gh-19474) 2023-04-22 13:39:37 -06:00
test_email gh-72346: Added isdst deprecation warning to email.utils.localtime (GH-91450) 2023-03-19 19:20:20 -05:00
test_import GH-103805: Lib test f541 linting issue fix (#103812) 2023-04-24 23:24:49 +00:00
test_importlib gh-98040: Remove just the imp module (#98573) 2023-04-28 16:17:58 -07:00
test_json gh-100931: Test all pickle protocols in test_slice (#100932) 2023-01-11 09:43:45 +00:00
test_lib2to3
test_peg_generator gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
test_sqlite3 GH-103857: Deprecate utcnow and utcfromtimestamp (#103858) 2023-04-27 11:32:30 -06:00
test_tkinter gh-103685: Fix tkinter.Menu.index() for Tk 8.7 (#103686) 2023-04-23 21:31:44 -04:00
test_tomllib
test_tools Remove non-existing tools from Sundry skiplist (#103991) 2023-04-29 12:11:15 -07:00
test_ttk gh-102778: Add sys.last_exc, deprecate sys.last_type, sys.last_value,sys.last_traceback (#102779) 2023-03-18 11:47:11 +00:00
test_unittest gh-62432: unittest runner: Exit code 5 if no tests were run (#102051) 2023-04-27 01:28:46 +00:00
test_warnings gh-39615: Add warnings.warn() skip_file_prefixes support (#100840) 2023-01-27 18:35:14 -08:00
test_zipfile gh-86094: Add support for Unicode Path Extra Field in ZipFile (gh-102566) 2023-04-05 20:54:48 +09:00
test_zoneinfo GH-102537: Handle check for PYTHONTZPATH failing in zoneinfo test (GH-102538) 2023-03-10 07:29:37 -08:00
tracedmodules
typinganndata GH-96073: Fix wild replacement in inspect.formatannotation (#96074) 2022-10-07 11:23:06 -07:00
xmltestdata
ziptestdata
__init__.py
__main__.py
_test_atexit.py
_test_eintr.py
_test_embed_set_config.py gh-98608: Change _Py_NewInterpreter() to _Py_NewInterpreterFromConfig() (gh-98609) 2022-10-26 11:16:30 -06:00
_test_embed_structseq.py gh-84436: Implement Immortal Objects (gh-19474) 2023-04-22 13:39:37 -06:00
_test_multiprocessing.py gh-84559: Remove the new multiprocessing warning, too disruptive. (#101551) 2023-02-03 15:20:46 -08:00
_test_venv_multiprocessing.py gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
_testcppext.cpp
_typed_dict_helper.py
allsans.pem
ann_module.py
ann_module2.py
ann_module3.py
ann_module4.py
ann_module5.py
ann_module6.py
ann_module7.py
ann_module8.py
audiotest.au
audiotests.py
audit-tests.py gh-86682: Adds sys._getframemodulename as an alternative to using _getframe (GH-99520) 2023-01-13 11:31:06 +00:00
autotest.py
bad_coding.py
bad_coding2.py
bad_getattr.py
bad_getattr2.py
bad_getattr3.py
badcert.pem
badkey.pem
badsyntax_3131.py
badsyntax_future3.py
badsyntax_future4.py
badsyntax_future5.py
badsyntax_future6.py
badsyntax_future7.py
badsyntax_future8.py
badsyntax_future9.py
badsyntax_future10.py
badsyntax_pep3120.py
bisect_cmd.py
cfgparser.1
cfgparser.2
cfgparser.3
clinic.test GH-100342: check for allocation failure in AC *args parsing (#100343) 2022-12-28 09:46:28 +05:30
cmath_testcases.txt Few coverage nitpicks for the cmath module (#102067) 2023-02-22 19:10:01 +00:00
coding20731.py
curses_tests.py
dataclass_module_1.py
dataclass_module_1_str.py
dataclass_module_2.py
dataclass_module_2_str.py
dataclass_textanno.py
datetimetester.py GH-103857: Deprecate utcnow and utcfromtimestamp (#103858) 2023-04-27 11:32:30 -06:00
dis_module.py
doctest_aliases.py
doctest_lineno.py gh-99433: Fix doctest failure on types.MethodWrapperType (#99434) 2022-12-30 17:25:01 +05:30
double_const.py
empty.vbs
exception_hierarchy.txt
ffdh3072.pem
final_a.py
final_b.py
floating_points.txt
fork_wait.py gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
formatfloat_testcases.txt
future_test1.py
future_test2.py
gdb_sample.py
good_getattr.py
idnsans.pem
ieee754.txt
imp_dummy.py
inspect_fodder.py gh-102799: use exception instance instead of sys.exc_info() (#102885) 2023-03-31 11:23:02 +01:00
inspect_fodder2.py gh-83035: handle decorator with nested parens in inspect.getsource (#99654) 2022-12-07 08:55:12 -08:00
inspect_stock_annotations.py
inspect_stringized_annotations.py
inspect_stringized_annotations_2.py
keycert.passwd.pem
keycert.pem
keycert2.pem
keycert3.pem
keycert4.pem
keycertecc.pem
levenshtein_examples.json gh-97008: Add a Python implementation of AttributeError and NameError suggestions (#97022) 2022-10-04 15:31:16 -07:00
list_tests.py
lock_tests.py
mailcap.txt
make_ssl_certs.py
mapping_tests.py
math_testcases.txt
memory_watchdog.py gh-95672: Update memory_watchdog to use test.support.get_pagesize (gh-102365) 2023-03-02 20:10:08 +09:00
mime.types
mock_socket.py
mod_generics_cache.py
mp_fork_bomb.py
mp_preload.py
multibytecodec_support.py
nokia.pem
nosan.pem
nullbytecert.pem
nullcert.pem
pickletester.py gh-100129: Add tests for pickling all builtin types and functions (GH-100142) 2022-12-21 16:31:22 +02:00
profilee.py gh-102799: use sys.exception() instead of sys.exc_info() in tests (#103293) 2023-04-06 11:08:25 +01:00
pstats.pck
pycacert.pem
pycakey.pem
pyclbr_input.py
pydoc_mod.py
pydocfodder.py gh-99430: Remove duplicated tests for old-styled classes (#99432) 2022-11-13 10:30:00 -08:00
pythoninfo.py
randv2_32.pck
randv2_64.pck
randv3.pck
re_tests.py
recursion.tar
regrtest.py
relimport.py
reperf.py
revocation.crl
sample_doctest.py
sample_doctest_no_docstrings.py
sample_doctest_no_doctests.py
secp384r1.pem
selfsigned_pythontestdotnet.pem
seq_tests.py
setup_testcppext.py gh-95299: Rework test_cppext.py to not invoke setup.py directly (#103316) 2023-04-12 23:17:36 -05:00
setuptools-67.6.1-py3-none-any.whl gh-95299: Rework test_cppext.py to not invoke setup.py directly (#103316) 2023-04-12 23:17:36 -05:00
sgml_input.html
shadowed_super.py gh-87729: add LOAD_SUPER_ATTR instruction for faster super() (#103497) 2023-04-24 22:22:14 +00:00
signalinterproctester.py
Sine-1000Hz-300ms.aif
smtpd.py gh-72719: Remove asyncore and asynchat modules (#96580) 2022-11-08 16:48:58 +01:00
sortperf.py
ssl_cert.pem
ssl_key.passwd.pem
ssl_key.pem
ssl_servers.py
ssltests.py
string_tests.py gh-94808: Cover str.rsplit for UCS1, UCS2 or UCS4 (#98228) 2022-10-15 11:40:22 -07:00
talos-2019-0758.pem
test___all__.py gh-99482: remove jython compatibility parts from stdlib and tests (#99484) 2022-12-23 14:17:24 -06:00
test___future__.py
test__locale.py
test__opcode.py GH-103082: Implementation of PEP 669: Low Impact Monitoring for CPython (GH-103083) 2023-04-12 12:04:55 +01:00
test__osx_support.py
test__xxinterpchannels.py GH-103805: Lib test f541 linting issue fix (#103812) 2023-04-24 23:24:49 +00:00
test__xxsubinterpreters.py GH-103805: Lib test f541 linting issue fix (#103812) 2023-04-24 23:24:49 +00:00
test_abc.py gh-98284: better error message for undefined abstractmethod (#97971) 2022-11-05 09:31:57 -07:00
test_abstract_numbers.py
test_aifc.py
test_argparse.py gh-101979: argparse: fix a bug where parentheses in metavar argument of add_argument() were dropped (#102318) 2023-03-05 06:54:33 -08:00
test_array.py
test_asdl_parser.py
test_ast.py gh-103285: Rewrite _splitlines_no_ff to improve performance (#103307) 2023-04-23 23:03:49 -06:00
test_asyncgen.py gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
test_atexit.py
test_audioop.py
test_audit.py gh-86682: Adds sys._getframemodulename as an alternative to using _getframe (GH-99520) 2023-01-13 11:31:06 +00:00
test_augassign.py
test_base64.py
test_baseexception.py gh-97591: In Exception.__setstate__() acquire strong references before calling tp_hash slot (#97700) 2022-10-01 20:57:17 -07:00
test_bdb.py gh-101517: fix line number propagation in code generated for except* (#103550) 2023-04-24 21:58:51 +01:00
test_bigaddrspace.py
test_bigmem.py gh-102701: Fix overflow in dictobject.c (GH-102750) 2023-03-17 22:39:09 +09:00
test_binascii.py
test_binop.py
test_bisect.py gh-96538: Fix refleak in _bisectmodule.c (gh-96619) 2022-09-06 19:37:18 -04:00
test_bool.py gh-102250: Fix double-decref in COMPARE_AND_BRANCH error case (GH-102287) 2023-02-27 10:46:40 +00:00
test_buffer.py gh-83791: Raise TypeError for len(memoryview_0d) (#18463) 2023-04-22 17:32:47 +01:00
test_bufio.py
test_builtin.py gh-84436: Implement Immortal Objects (gh-19474) 2023-04-22 13:39:37 -06:00
test_bytes.py gh-94808: Add coverage for bytesarray_setitem (#95802) 2022-10-10 08:28:41 -07:00
test_bz2.py bpo-23224: Fix segfaults and multiple leaks in the lzma and bz2 modules (GH-7822) 2023-02-23 06:00:58 -08:00
test_c_locale_coercion.py
test_calendar.py gh-103636: issue warning for deprecated calendar constants (#103833) 2023-04-29 01:16:46 -06:00
test_call.py gh-101261: add test for function with > 255 args (#101262) 2023-01-23 20:10:10 +00:00
test_cgi.py
test_cgitb.py
test_charmapcodec.py
test_class.py gh-102799: use sys.exception() instead of sys.exc_info() in tests (#103293) 2023-04-06 11:08:25 +01:00
test_clinic.py gh-64490: Fix bugs in argument clinic varargs processing (#32092) 2022-11-24 20:56:50 +01:00
test_cmath.py Few coverage nitpicks for the cmath module (#102067) 2023-02-22 19:10:01 +00:00
test_cmd.py
test_cmd_line.py gh-96512: Move int_max_str_digits setting to PyConfig (#96944) 2022-10-03 13:55:45 -07:00
test_cmd_line_script.py gh-102856: Initial implementation of PEP 701 (#102855) 2023-04-19 11:18:16 -05:00
test_code.py GH-103805: Lib test f541 linting issue fix (#103812) 2023-04-24 23:24:49 +00:00
test_code_module.py
test_codeccallbacks.py
test_codecencodings_cn.py
test_codecencodings_hk.py
test_codecencodings_iso2022.py
test_codecencodings_jp.py
test_codecencodings_kr.py
test_codecencodings_tw.py
test_codecmaps_cn.py
test_codecmaps_hk.py
test_codecmaps_jp.py
test_codecmaps_kr.py
test_codecmaps_tw.py
test_codecs.py gh-102406: replace exception chaining by PEP-678 notes in codecs (#102407) 2023-03-21 21:36:31 +00:00
test_codeop.py gh-103492: Clarify SyntaxWarning with literal comparison (#103493) 2023-04-24 15:42:57 -06:00
test_collections.py GH-103805: Lib test f541 linting issue fix (#103812) 2023-04-24 23:24:49 +00:00
test_colorsys.py
test_compare.py
test_compile.py GH-100982: Break up COMPARE_AND_BRANCH (GH-102801) 2023-03-23 15:25:09 -07:00
test_compileall.py bpo-40447: accept all path-like objects in compileall.compile_file (#19883) 2022-12-23 14:19:16 -06:00
test_compiler_codegen.py gh-87092: Make jump target label equal to the offset of the target in the instructions sequence (#102093) 2023-02-28 11:29:32 +00:00
test_complex.py gh-99320: remove tests for old-style class from test_complex (#99321) 2022-11-10 10:51:22 +00:00
test_concurrent_futures.py gh-94440: Fix issue of ProcessPoolExecutor shutdown hanging (#94468) 2023-03-15 21:44:52 -07:00
test_configparser.py
test_contains.py
test_context.py
test_contextlib.py gh-103791: Make contextlib.suppress also act on exceptions within an ExceptionGroup (#103792) 2023-04-24 22:17:02 +00:00
test_contextlib_async.py gh-95882: fix regression in the traceback of exceptions propagated from inside a contextlib context manager (#95883) 2023-01-03 15:47:13 +00:00
test_copy.py gh-100871: Improve copy module tests (GH-100872) 2023-01-11 09:14:41 -08:00
test_copyreg.py
test_coroutines.py GH-103805: Lib test f541 linting issue fix (#103812) 2023-04-24 23:24:49 +00:00
test_cppext.py gh-95299: Rework test_cppext.py to not invoke setup.py directly (#103316) 2023-04-12 23:17:36 -05:00
test_cprofile.py gh-102799: use sys.exception() instead of sys.exc_info() in tests (#103293) 2023-04-06 11:08:25 +01:00
test_crashers.py
test_crypt.py
test_csv.py gh-67230: add quoting rules to csv module (GH-29469) 2023-04-12 15:32:30 -07:00
test_curses.py gh-60436: fix curses textbox backspace/del (#103783) 2023-04-26 22:54:07 +02:00
test_dataclasses.py GH-103805: Lib test f541 linting issue fix (#103812) 2023-04-24 23:24:49 +00:00
test_datetime.py
test_dbm.py
test_dbm_dumb.py
test_dbm_gnu.py GH-46412: More efficient bool() for ndbm/_gdbmmodule (#96692) 2022-09-08 19:32:40 -07:00
test_dbm_ndbm.py GH-46412: More efficient bool() for ndbm/_gdbmmodule (#96692) 2022-09-08 19:32:40 -07:00
test_decimal.py gh-95778: CVE-2020-10735: Prevent DoS by very large int() (#96499) 2022-09-02 09:35:08 -07:00
test_decorators.py
test_defaultdict.py
test_deque.py
test_descr.py gh-103272: regression test for getattr exception in property (#103336) 2023-04-07 12:11:11 -07:00
test_descrtut.py
test_devpoll.py
test_dict.py gh-94808: Improve coverage of dictresize (GH-100619) 2022-12-31 18:15:30 +09:00
test_dict_version.py
test_dictcomps.py
test_dictviews.py gh-98512: Add more tests for ValuesView (#98515) 2022-11-02 19:10:42 -07:00
test_difflib.py
test_difflib_expect.html
test_dis.py GH-103804: Add test for dis.disco (#103901) 2023-04-28 12:11:21 +01:00
test_doctest.py GH-84783: Make the slice object hashable (GH-101264) 2023-02-18 18:22:02 -06:00
test_doctest.txt
test_doctest2.py
test_doctest2.txt
test_doctest3.txt
test_doctest4.txt
test_docxmlrpc.py
test_dtrace.py
test_dynamic.py GH-91079: Decouple C stack overflow checks from Python recursion checks. (GH-96510) 2022-10-05 01:34:03 +01:00
test_dynamicclassattribute.py
test_eintr.py
test_embed.py GH-103805: Lib test f541 linting issue fix (#103812) 2023-04-24 23:24:49 +00:00
test_ensurepip.py gh-95299: Stop installing setuptools as a part of ensurepip and venv (#101039) 2023-04-17 23:43:34 -05:00
test_enum.py gh-103596: [Enum] do not shadow mixed-in methods/attributes (GH-103600) 2023-04-18 16:19:23 -07:00
test_enumerate.py
test_eof.py gh-102856: Initial implementation of PEP 701 (#102855) 2023-04-19 11:18:16 -05:00
test_epoll.py
test_errno.py
test_except_star.py gh-103590: do not wrap a single exception raised from a try-except* (#103665) 2023-04-27 12:52:15 +01:00
test_exception_group.py gh-99553: add tests for ExceptionGroup wrapping (#99615) 2023-04-10 23:44:53 -07:00
test_exception_hierarchy.py
test_exception_variations.py
test_exceptions.py gh-102856: Initial implementation of PEP 701 (#102855) 2023-04-19 11:18:16 -05:00
test_extcall.py gh-96751: Remove dead code from CALL_FUNCTION_EX opcode (GH-96752) 2022-09-15 10:33:13 +01:00
test_faulthandler.py
test_fcntl.py gh-95672 skip fcntl when pipesize is smaller than pagesize (gh-102163) 2023-03-01 23:56:19 +09:00
test_file.py
test_file_eintr.py
test_filecmp.py
test_fileinput.py gh-101961 fileinput.hookcompressed should not set the encoding value for the binary mode (gh-102068) 2023-02-21 12:10:29 +09:00
test_fileio.py Make use of TESTFN_ASCII in test_fileio (GH-101645) 2023-02-07 09:22:58 -08:00
test_fileutils.py
test_finalization.py
test_float.py
test_flufl.py
test_fnmatch.py
test_fork1.py
test_format.py
test_fractions.py gh-101773: Optimize creation of Fractions in private methods (#101780) 2023-02-27 18:53:22 +00:00
test_frame.py GH-100126: Skip incomplete frames in more places (GH-100613) 2023-01-09 12:20:04 -08:00
test_frozen.py
test_fstring.py gh-103656: Transfer f-string buffers to parser to avoid use-after-free (GH-103896) 2023-04-27 01:33:31 +00:00
test_ftplib.py gh-72719: Remove asyncore and asynchat modules (#96580) 2022-11-08 16:48:58 +01:00
test_funcattrs.py
test_functools.py gh-77757: replace exception wrapping by PEP-678 notes in typeobject's __set_name__ (#103402) 2023-04-11 11:53:06 +01:00
test_future.py gh-98811: use full source location to simplify __future__ imports error checking. This also fixes an incorrect error offset. (GH-98812) 2022-10-31 13:08:03 +00:00
test_future3.py
test_future4.py
test_future5.py
test_gc.py gh-99430: Remove duplicated tests for old-styled classes (#99432) 2022-11-13 10:30:00 -08:00
test_gdb.py gh-87729: add LOAD_SUPER_ATTR instruction for faster super() (#103497) 2023-04-24 22:22:14 +00:00
test_generator_stop.py
test_generators.py GH-103488: Use return-offset, not yield-offset. (GH-103502) 2023-04-13 16:19:07 +01:00
test_genericalias.py gh-103880: Fix assertRaises usage in test_genericalias (GH-103916) 2023-04-27 16:54:59 +08:00
test_genericclass.py
test_genericpath.py
test_genexps.py
test_getopt.py
test_getpass.py
test_getpath.py gh-100320: Fix path calculations on Windows when python.exe is moved outside of the normal location (GH-100947) 2023-01-16 16:05:39 +00:00
test_gettext.py
test_glob.py
test_global.py
test_grammar.py gh-103492: Clarify SyntaxWarning with literal comparison (#103493) 2023-04-24 15:42:57 -06:00
test_graphlib.py
test_grp.py
test_gzip.py
test_hash.py
test_hashlib.py gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
test_heapq.py
test_hmac.py gh-103256: Fix hmac algorithm to support fallback implementation (gh-103286) 2023-04-07 10:51:29 +09:00
test_html.py
test_htmlparser.py
test_http_cookiejar.py gh-99576: Fix cookiejar file that was not truncated for some classes (GH-99616) 2022-12-20 17:51:26 +01:00
test_http_cookies.py
test_httplib.py gh-66897: Upgrade HTTP CONNECT to protocol HTTP/1.1 (#8305) 2023-04-04 21:55:24 -07:00
test_httpservers.py gh-100474: Fix handling of dirs named index.html in http.server (GH-100475) 2022-12-24 10:28:59 -08:00
test_idle.py
test_imaplib.py gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
test_imghdr.py
test_index.py
test_inspect.py gh-103556: [inspect.Signature] disallow pos-or-kw params without default after pos-only with default (#103557) 2023-04-21 23:45:10 -06:00
test_int.py gh-90716: bugfixes and more tests for _pylong. (#99073) 2022-11-03 16:18:38 -07:00
test_int_literal.py
test_interpreters.py gh-101524: Split Up the _xxsubinterpreters Module (gh-101526) 2023-02-03 18:14:43 -07:00
test_io.py gh-101819: Adapt _io types to heap types, batch 1 (GH-101949) 2023-02-20 05:46:20 -08:00
test_ioctl.py
test_ipaddress.py gh-82836: fix private network check (#97733) 2022-11-29 13:32:18 -08:00
test_isinstance.py gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
test_iter.py gh-101892: Fix SystemError when a callable iterator call exhausts the iterator (#101896) 2023-03-04 19:51:29 +05:30
test_iterlen.py
test_itertools.py gh-102876: remove superfluous parens from itertools.batched recipe (GH-102877) 2023-03-21 12:06:18 -05:00
test_keyword.py gh-102158: Add tests for softkwlist (#102159) 2023-02-23 21:28:24 -05:00
test_keywordonlyarg.py
test_kqueue.py
test_largefile.py
test_launcher.py GH-103805: Lib test f541 linting issue fix (#103812) 2023-04-24 23:24:49 +00:00
test_linecache.py
test_list.py gh-97616: test_list_resize_overflow() uses sys.maxsize (#99057) 2022-11-03 15:56:12 +01:00
test_listcomps.py
test_lltrace.py GH-99005: More intrinsics (GH-100774) 2023-01-06 14:47:57 +00:00
test_locale.py
test_logging.py gh-103357: Add logging.Formatter defaults support to logging.config fileConfig and dictConfig (GH-103359) 2023-04-12 08:35:56 +01:00
test_long.py gh-101266: Fix __sizeof__ for subclasses of int (#101394) 2023-02-05 10:02:53 +00:00
test_longexp.py
test_lzma.py bpo-23224: Fix segfaults and multiple leaks in the lzma and bz2 modules (GH-7822) 2023-02-23 06:00:58 -08:00
test_mailbox.py gh-93121: fix test_mailbox where some test cases were accidentally dropped (#93242) 2023-04-06 23:19:11 +01:00
test_mailcap.py gh-103186: assert in tests that UnsafeMailcapInput warnings are provided (#103217) 2023-04-06 19:13:33 +01:00
test_marshal.py gh-99934: test_marshal.py: add more elements in test_deterministic_sets (GH-99935) 2022-12-03 10:53:20 -06:00
test_math.py Revert "gh-89381: Fix invalid signatures of math/cmath.log (#101404)" (#101580) 2023-02-05 16:36:33 +00:00
test_memoryio.py
test_memoryview.py gh-90751: memoryview now supports half-float (#96738) 2022-09-10 22:44:10 +02:00
test_metaclass.py
test_mimetypes.py
test_minidom.py gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
test_mmap.py
test_module.py gh-97850: Remove all known instances of module_repr() (#97876) 2022-10-05 11:42:26 -07:00
test_modulefinder.py
test_monitoring.py GH-103082: Turn on branch events for FOR_ITER instructions. (#103507) 2023-04-13 13:56:09 +01:00
test_msilib.py
test_multibytecodec.py
test_multiprocessing_fork.py
test_multiprocessing_forkserver.py
test_multiprocessing_main_handling.py
test_multiprocessing_spawn.py
test_named_expressions.py gh-87447: Fix walrus comprehension rebind checking (#100581) 2023-01-08 15:51:29 -07:00
test_netrc.py
test_nis.py
test_nntplib.py
test_ntpath.py GH-78079: Fix UNC device path root normalization in pathlib (GH-102003) 2023-04-14 21:55:41 +01:00
test_numeric_tower.py gh-101773: Optimize creation of Fractions in private methods (#101780) 2023-02-27 18:53:22 +00:00
test_opcache.py gh-87729: specialize LOAD_SUPER_ATTR_METHOD (#103809) 2023-04-25 17:45:51 +00:00
test_opcodes.py
test_openpty.py
test_operator.py gh-102088 Optimize iter_index itertools recipe (GH-102360) 2023-03-01 21:16:23 -06:00
test_optparse.py
test_ordered_dict.py gh-101446: Change repr of collections.OrderedDict (#101661) 2023-02-07 20:01:10 -06:00
test_os.py gh-75729: Fix os.spawn tests not handling spaces on Windows (#99150) 2023-04-08 10:37:23 +03:00
test_ossaudiodev.py
test_osx_env.py
test_pathlib.py GH-103517: Improve tests for pathlib.Path.walk() (GH-103518) 2023-04-15 17:35:17 +01:00
test_patma.py GH-103971: Forward-port test from GH-103980 (GH-103984) 2023-04-28 20:25:48 +00:00
test_pdb.py gh-103578: Fix pdb reading code with non-utf8 encoding (#103581) 2023-04-25 23:04:51 -06:00
test_peepholer.py GH-103805: Lib test f541 linting issue fix (#103812) 2023-04-24 23:24:49 +00:00
test_pep646_syntax.py
test_perf_profiler.py gh-96143: subprocess API %s/universal_newlines=/text=/g. (GH-96468) 2022-09-01 02:47:40 -07:00
test_pickle.py gh-103092: Isolate _pickle module (#102982) 2023-04-04 15:38:54 +05:30
test_picklebuffer.py
test_pickletools.py
test_pipes.py
test_pkg.py
test_pkgutil.py gh-98040: Remove just the imp module (#98573) 2023-04-28 16:17:58 -07:00
test_platform.py gh-102491: Remove IronPython version check in sys_version (#102492) 2023-03-19 15:52:47 -07:00
test_plistlib.py GH-103857: Deprecate utcnow and utcfromtimestamp (#103858) 2023-04-27 11:32:30 -06:00
test_poll.py
test_popen.py
test_poplib.py gh-72719: Remove asyncore and asynchat modules (#96580) 2022-11-08 16:48:58 +01:00
test_positional_only_arg.py gh-91210: Improve error message when non-default param follows default (GH-95933) 2022-09-17 10:09:28 -07:00
test_posix.py gh-103724: Add test case if no arg as provided in os.register_at_fork (gh-103725) 2023-04-23 17:14:14 -06:00
test_posixpath.py gh-101000: Add os.path.splitroot() (#101002) 2023-01-27 00:28:27 +00:00
test_pow.py GH-102341: Improve the test function for pow (#102342) 2023-03-05 12:31:26 -05:00
test_pprint.py
test_print.py
test_profile.py gh-102799: use sys.exception() instead of sys.exc_info() in tests (#103293) 2023-04-06 11:08:25 +01:00
test_property.py GH-100942: Fix incorrect cast in property_copy(). (#100965) 2023-01-12 16:13:56 -06:00
test_pstats.py
test_pty.py gh-85984: Utilize new "winsize" functions from termios in pty tests. (#101831) 2023-02-11 21:24:43 -08:00
test_pulldom.py
test_pwd.py
test_py_compile.py gh-92886: Fix tests that fail when running with optimizations (-O) in test_py_compile.py (GH-93235) 2022-10-19 11:05:08 +01:00
test_pyclbr.py
test_pydoc.py gh-65961: Do not rely solely on __cached__ (GH-97990) 2022-10-06 15:40:22 -07:00
test_pyexpat.py
test_queue.py
test_quopri.py
test_raise.py
test_random.py GH-100805: Support numpy.array() in random.choice(). (GH-100830) 2023-01-08 13:40:35 -06:00
test_range.py Revert "Add tests for empty range equality (#103751)" (#103770) 2023-04-24 14:29:57 -04:00
test_re.py gh-84559: Remove the new multiprocessing warning, too disruptive. (#101551) 2023-02-03 15:20:46 -08:00
test_readline.py
test_regrtest.py bpo-46523: fix tests rerun when setUp[Class|Module] fails (#30895) 2023-04-07 12:43:41 +02:00
test_repl.py
test_reprlib.py gh-92734: Add indentation feature to reprlib.Repr (GH-92735) 2022-09-08 13:51:44 -05:00
test_resource.py
test_richcmp.py
test_rlcompleter.py
test_robotparser.py
test_runpy.py
test_sax.py
test_sched.py gh-90808: add more examples to test_sched.test_priority (#31144) 2022-09-20 18:34:13 -07:00
test_scope.py
test_script_helper.py
test_secrets.py
test_select.py
test_selectors.py
test_set.py
test_setcomps.py
test_shelve.py
test_shlex.py gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
test_shutil.py gh-102950: Implement PEP 706 – Filter for tarfile.extractall (#102953) 2023-04-24 10:58:06 +02:00
test_signal.py GH-102397: Fix segfault from race condition in signal handling (#102399) 2023-03-08 13:29:39 +05:30
test_site.py
test_slice.py GH-84783: Make the slice object hashable (GH-101264) 2023-02-18 18:22:02 -06:00
test_smtplib.py gh-72719: Remove asyncore and asynchat modules (#96580) 2022-11-08 16:48:58 +01:00
test_smtpnet.py
test_sndhdr.py
test_socket.py gh-103092: Isolate socket module (#103094) 2023-04-09 06:33:52 +05:30
test_socketserver.py gh-103673: Add missing ForkingUnixStreamServer and ForkingUnixDatagramServer socketservers (#103674) 2023-04-24 22:35:52 +00:00
test_sort.py
test_source_encoding.py gh-99891: Fix infinite recursion in the tokenizer when showing warnings (GH-99893) 2022-11-30 03:36:06 -08:00
test_spwd.py
test_ssl.py gh-102799: use sys.exception() instead of sys.exc_info() in tests (#103293) 2023-04-06 11:08:25 +01:00
test_stable_abi_ctypes.py gh-102755: Add PyErr_DisplayException(exc) (#102756) 2023-03-16 22:18:04 +00:00
test_startfile.py
test_stat.py
test_statistics.py GH-102670: Use sumprod() to simplify, speed up, and improve accuracy of statistics functions (GH-102649) 2023-03-13 20:06:43 -05:00
test_strftime.py gh-99482: remove jython compatibility parts from stdlib and tests (#99484) 2022-12-23 14:17:24 -06:00
test_string.py
test_string_literals.py gh-98401: Invalid escape sequences emits SyntaxWarning (#99011) 2022-11-03 17:53:25 +01:00
test_stringprep.py
test_strptime.py GH-90750: Use datetime.fromisocalendar in _strptime (#103802) 2023-04-27 10:27:27 -06:00
test_strtod.py
test_struct.py gh-98248: Normalizing the error messages in function struct.pack (GH-98252) 2022-12-04 20:24:18 +00:00
test_structseq.py
test_subclassinit.py gh-77757: replace exception wrapping by PEP-678 notes in typeobject's __set_name__ (#103402) 2023-04-11 11:53:06 +01:00
test_subprocess.py gh-95672 skip fcntl when pipesize is smaller than pagesize (gh-102163) 2023-03-01 23:56:19 +09:00
test_sunau.py
test_sundry.py gh-92584: Remove the distutils package (#99061) 2022-11-03 19:27:27 +01:00
test_super.py gh-87729: add LOAD_SUPER_ATTR instruction for faster super() (#103497) 2023-04-24 22:22:14 +00:00
test_support.py
test_symtable.py gh-98393: os module reject bytes-like, only accept bytes (#98394) 2022-10-18 17:52:31 +02:00
test_syntax.py gh-102310: Change error range for invalid bytes literals (#103663) 2023-04-22 18:08:27 -06:00
test_sys.py gh-84436: Implement Immortal Objects (gh-19474) 2023-04-22 13:39:37 -06:00
test_sys_setprofile.py gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
test_sys_settrace.py GH-103082: Implementation of PEP 669: Low Impact Monitoring for CPython (GH-103083) 2023-04-12 12:04:55 +01:00
test_sysconfig.py gh-95853: Multiple ops and debug for wasm_build.py (#96744) 2022-09-11 09:51:23 +02:00
test_syslog.py gh-99127: Allow some features of syslog to the main interpreter only (gh-99128) 2022-11-30 07:58:20 +09:00
test_tabnanny.py gh-63301: Set exit code when tabnanny CLI exits on error (#7699) 2023-03-04 13:32:13 -08:00
test_tarfile.py gh-102950: Adjust tarfile filter tests for systems that don't set the sticky bit (GH-103831) 2023-04-25 12:56:01 +00:00
test_tcl.py
test_telnetlib.py
test_tempfile.py gh-51574: Make tempfile.mkdtemp() always return absolute paths (#94612) 2023-04-25 16:05:59 +00:00
test_textwrap.py
test_thread.py gh-100228: Warn from os.fork() if other threads exist. (#100229) 2022-12-29 14:41:39 -08:00
test_threadedtempfile.py
test_threading.py gh-101659: Isolate "obmalloc" State to Each Interpreter (gh-101660) 2023-04-24 17:23:57 -06:00
test_threading_local.py GH-100892: Fix race in clearing threading.local (#100922) 2023-01-11 16:03:31 +05:30
test_threadsignals.py
test_time.py Remove space. (GH-97807) 2022-10-03 17:12:36 -07:00
test_timeit.py
test_timeout.py
test_tix.py
test_tokenize.py gh-102856: Initial implementation of PEP 701 (#102855) 2023-04-19 11:18:16 -05:00
test_trace.py gh-51524: Fix bug when calling trace.CoverageResults with valid infile (#99629) 2022-11-28 01:49:10 -05:00
test_traceback.py GH-103805: Lib test f541 linting issue fix (#103812) 2023-04-24 23:24:49 +00:00
test_tracemalloc.py GH-96612: Skip incomplete frames in tracemalloc traces. (GH-96613) 2022-09-06 17:37:47 +01:00
test_ttk_textonly.py
test_tuple.py
test_turtle.py
test_type_annotations.py
test_type_cache.py gh-103091: Add PyUnstable_Type_AssignVersionTag (#103095) 2023-04-24 10:07:47 -06:00
test_type_comments.py gh-102856: Initial implementation of PEP 701 (#102855) 2023-04-19 11:18:16 -05:00
test_typechecks.py
test_types.py gh-103746: Test types.UnionType and Literal types together (#103747) 2023-04-24 10:55:16 -06:00
test_typing.py gh-103746: Test types.UnionType and Literal types together (#103747) 2023-04-24 10:55:16 -06:00
test_ucn.py
test_unary.py gh-99688: Fix outdated tests in test_unary (#99712) 2022-12-11 18:44:29 -05:00
test_unicode.py Remove wrong comment about repr in test_unicode (#100495) 2022-12-24 06:48:43 -08:00
test_unicode_file.py
test_unicode_file_functions.py
test_unicode_identifiers.py
test_unicodedata.py gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
test_univnewlines.py
test_unpack.py
test_unpack_ex.py
test_unparse.py gh-100518: Add tests for ast.NodeTransformer (#100521) 2023-01-21 21:44:41 +00:00
test_urllib.py gh-88500: Reduce memory use of urllib.unquote (#96763) 2022-12-10 16:17:39 -08:00
test_urllib2.py gh-99352: Ensure HTTPSConnection is available before exercising https tests. (#103828) 2023-04-25 18:02:27 -07:00
test_urllib2_localnet.py
test_urllib2net.py gh-81403: Fix for CacheFTPHandler in urllib (#13951) 2023-04-22 21:41:23 -07:00
test_urllib_response.py
test_urllibnet.py
test_urlparse.py gh-99418: Make urllib.parse.urlparse enforce that a scheme must begin with an alphabetical ASCII character. (#99421) 2022-11-13 10:25:55 -08:00
test_userdict.py
test_userlist.py
test_userstring.py
test_utf8_mode.py
test_utf8source.py
test_uu.py
test_uuid.py gh-94684: uuid: support bytes in the name argument to uuid3/5 (#94709) 2023-03-23 17:42:43 -06:00
test_venv.py gh-84436: Implement Immortal Objects (gh-19474) 2023-04-22 13:39:37 -06:00
test_wait3.py
test_wait4.py
test_wave.py gh-77171: Fixes SubFormat check to compare the entire value. Add docs (GH-97509) 2022-09-23 16:08:21 +01:00
test_weakref.py gh-99184: Bypass instance attribute access in repr of weakref.ref (#99244) 2023-04-24 12:57:36 -06:00
test_weakset.py
test_webbrowser.py bpo-44844: Enable detection of Microsoft Edge browser in webbrowser module (GH-29908) 2023-04-04 17:00:03 +01:00
test_winconsoleio.py
test_winreg.py gh-103092: Isolate winreg (#103250) 2023-04-17 12:30:48 -06:00
test_winsound.py
test_with.py gh-102799: use exception instance instead of sys.exc_info() (#102885) 2023-03-31 11:23:02 +01:00
test_wmi.py gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
test_wsgiref.py
test_xdrlib.py
test_xml_dom_minicompat.py
test_xml_etree.py gh-100933: Improve check_element helper in test_xml_etree (#100934) 2023-02-08 11:13:43 +01:00
test_xml_etree_c.py gh-92123: Convert _elementtree types to heap types (#99221) 2023-01-20 12:40:06 +01:00
test_xmlrpc.py gh-95778: CVE-2020-10735: Prevent DoS by very large int() (#96499) 2022-09-02 09:35:08 -07:00
test_xmlrpc_net.py
test_xxlimited.py
test_xxtestfuzz.py
test_yield_from.py
test_zipapp.py
test_zipfile64.py gh-102515: Remove unused imports in the Lib/ directory (#102516) 2023-03-08 11:45:38 +00:00
test_zipimport.py
test_zipimport_support.py
test_zlib.py gh-101322: Ensure test_zlib.ZlibDecompressorTest runs, fix errors in ZlibDecompressor (#101323) 2023-02-04 12:07:30 -08:00
testcodec.py
testtar.tar
testtar.tar.xz
tf_inherit_check.py
time_hashlib.py
tokenize_tests-latin1-coding-cookie-and-utf8-bom-sig.txt
tokenize_tests-no-coding-cookie-and-utf8-bom-sig-only.txt
tokenize_tests-utf8-coding-cookie-and-no-utf8-bom-sig.txt
tokenize_tests-utf8-coding-cookie-and-utf8-bom-sig.txt
tokenize_tests.txt
wheel-0.40.0-py3-none-any.whl gh-95299: Rework test_cppext.py to not invoke setup.py directly (#103316) 2023-04-12 23:17:36 -05:00
win_console_handler.py
xmltests.py
zip_cp437_header.zip
zipdir.zip