cpython/Lib/test/libregrtest
Miss Islington (bot) 04b26eeb14
[3.11] [3.12] gh-83434: Sync libregrtest and test_regrtest with the main branch (GH-117250) (#117251)
[3.12] gh-83434: Sync libregrtest and test_regrtest with the main branch (GH-117250)

* gh-115122: Add --bisect option to regrtest (GH-115123)

* test.bisect_cmd now exit with code 0 on success, and code 1 on
  failure. Before, it was the opposite.
* test.bisect_cmd now runs the test worker process with
  -X faulthandler.
* regrtest RunTests: Add create_python_cmd() and bisect_cmd()
  methods.

(cherry picked from commit 1e5719a663)

* gh-115720: Show number of leaks in huntrleaks progress reports (GH-115726)

Instead of showing a dot for each iteration, show:
- '.' for zero (on negative) leaks
- number of leaks for 1-9
- 'X' if there are more leaks

This allows more rapid iteration: when bisecting, I don't need
to wait for the final report to see if the test still leaks.

Also, show the full result if there are any non-zero entries.
This shows negative entries, for the unfortunate cases where
a reference is created and cleaned up in different runs.

Test *failure* is still determined by the existing heuristic.

(cherry picked from commit af5f9d682c)

* gh-83434: Disable XML in regrtest when -R option is used (GH-117232)

(cherry picked from commit d52bdfb19f)

---------

(cherry picked from commit 477ef9015c)

Co-authored-by: Victor Stinner <vstinner@python.org>
Co-authored-by: Petr Viktorin <encukou@gmail.com>
2024-03-26 08:18:10 +00:00
..
__init__.py gh-110756: Sync regrtest with main branch (#110758) (#110781) 2023-10-12 21:45:36 +00:00
cmdline.py [3.11] [3.12] gh-83434: Sync libregrtest and test_regrtest with the main branch (GH-117250) (#117251) 2024-03-26 08:18:10 +00:00
filter.py [3.11] gh-110918: Fix side effects of regrtest test_match_tests() (GH-116718) (#116727) 2024-03-13 14:35:59 +00:00
findtests.py [3.11] gh-108303: Move all pydoc related files to test_pydoc (GH-114506) (#115501) 2024-02-15 16:36:10 +03:00
logger.py gh-110756: Sync regrtest with main branch (#110758) (#110781) 2023-10-12 21:45:36 +00:00
main.py [3.11] [3.12] gh-83434: Sync libregrtest and test_regrtest with the main branch (GH-117250) (#117251) 2024-03-26 08:18:10 +00:00
mypy.ini [3.11] [3.12] gh-109413: libregrtest: enable mypy's --strict-optional check on most files (GH-112586) (GH-112602) (#112603) 2023-12-01 17:28:09 +00:00
pgo.py [3.11] gh-111929: Fix regrtest --pgo: test_str => test_unicode (GH-111938) (#111940) 2023-11-10 09:54:38 +00:00
refleak.py [3.11] [3.12] gh-83434: Sync libregrtest and test_regrtest with the main branch (GH-117250) (#117251) 2024-03-26 08:18:10 +00:00
result.py [3.11] [3.12] gh-111165: Move test running code from test.support to libregrtest (GH-111166) (GH-111316) (GH-111318) 2023-10-25 12:37:19 +00:00
results.py [3.11] [3.12] gh-83434: Sync libregrtest and test_regrtest with the main branch (GH-117250) (#117251) 2024-03-26 08:18:10 +00:00
run_workers.py [3.11] chore: fix typos (GH-116345) (#116375) 2024-03-05 20:33:59 +00:00
runtests.py [3.11] [3.12] gh-83434: Sync libregrtest and test_regrtest with the main branch (GH-117250) (#117251) 2024-03-26 08:18:10 +00:00
save_env.py gh-110756: Sync regrtest with main branch (#110758) (#110781) 2023-10-12 21:45:36 +00:00
setup.py [3.11] [3.12] gh-109413: libregrtest: Backport .py-file changes from GH-112558 (GH-112605) (#112607) 2023-12-01 19:09:00 +00:00
single.py [3.11] gh-108927: Fix removing testing modules from sys.modules (GH-108952) (ПР-112712) 2023-12-04 18:16:03 +02:00
testresult.py [3.11] [3.12] gh-111165: Move test running code from test.support to libregrtest (GH-111166) (GH-111316) (GH-111318) 2023-10-25 12:37:19 +00:00
utils.py [3.11] chore: fix typos (GH-116345) (#116375) 2024-03-05 20:33:59 +00:00
win_utils.py [3.11] gh-116103: Prevent error in WindowsLoadTracker.__del__ on permission error (GH-116105) (GH-116121) 2024-02-29 14:44:55 +00:00
worker.py [3.11] [3.12] gh-83434: Sync libregrtest and test_regrtest with the main branch (GH-117250) (#117251) 2024-03-26 08:18:10 +00:00