cpython/Lib/test/libregrtest
Victor Stinner 859618c8cd
gh-109566, regrtest: Add --fast-ci and --slow-ci options (#109570)
* Add --fast-ci and --slow-ci options to libregrtest:

  * --fast-ci uses a default timeout of 10 minutes and "-u all,-cpu"
    (skip slowest tests).
  * --slow-ci uses a default timeout of 20 minues and "-u all" (run
    all tests).

* regrtest header now lists test resources.
* Makefile changes:

  * "make test", "make hostrunnertest" and "make coverage-report" now
    use --fast-ci option and TESTTIMEOUT variable.
  * "make buildbottest" now uses "--slow-ci". Remove options which
    became redundant with "--slow-ci".
  * "make testall" and "make testuniversal" now use --slow-ci option
    and TESTTIMEOUT variable.
  * "make testall" now uses "find -exec rm ..." instead of
    "find ... -print|xargs rm ...", same as "make clean".

* GitHub Actions workflow:

  * Ubuntu and Address Sanitizer jobs now use "make test". Remove
    options which became redundant with "--fast-ci".
  * Windows jobs now use --fast-ci option.
  * Use -j0 to detect the number of CPUs.

* Set Makefile TESTTIMEOUT default to an empty string, since
  --slow-ci and --fast-ci use different default timeout. It's now
  accepted to pass "--timeout=" to regrtest: treated as not timeout.
* Tools/scripts/run_tests.py now uses --fast-ci option.
* Tools/buildbot/test.bat now uses --slow-ci option. Remove
  --timeout=1200 option, redundant with --slow-ci.
2023-09-26 17:22:50 +02:00
..
__init__.py gh-109162: libregrtest: use relative imports (#109250) 2023-09-11 07:02:35 +00:00
cmdline.py gh-109566, regrtest: Add --fast-ci and --slow-ci options (#109570) 2023-09-26 17:22:50 +02:00
findtests.py gh-108303: Move test_future into its own test_future_stmt subdir (#109368) 2023-09-15 09:52:24 +02:00
logger.py gh-109413: Fix some trivial mypy nitpicks in libregrtest (#109454) 2023-09-15 17:01:28 +00:00
main.py gh-109566, regrtest: Add --fast-ci and --slow-ci options (#109570) 2023-09-26 17:22:50 +02:00
mypy.ini gh-109413: Improve mypy config for libregrtest (#109518) 2023-09-17 17:35:51 -07:00
pgo.py gh-109162: Refactor libregrtest.Regrtest (#109206) 2023-09-10 03:07:05 +02:00
refleak.py gh-109413: libregrtest: Add and improve type annotations (#109405) 2023-09-14 18:33:18 +00:00
result.py gh-109276: libregrtest: use separated file for JSON (#109277) 2023-09-11 19:33:42 +02:00
results.py gh-109566, regrtest: Add --fast-ci and --slow-ci options (#109570) 2023-09-26 17:22:50 +02:00
run_workers.py gh-109425: regrtest decodes worker stdout with backslashreplace (#109428) 2023-09-14 23:37:37 +00:00
runtests.py gh-109413: libregrtest: Add and improve type annotations (#109405) 2023-09-14 18:33:18 +00:00
save_env.py gh-109276: libregrtest only checks saved_test_environment() once (#109278) 2023-09-12 05:01:33 +02:00
setup.py gh-109413: libregrtest: Add and improve type annotations (#109405) 2023-09-14 18:33:18 +00:00
single.py gh-109413: Fix some trivial mypy nitpicks in libregrtest (#109454) 2023-09-15 17:01:28 +00:00
utils.py gh-109566, regrtest: Add --fast-ci and --slow-ci options (#109570) 2023-09-26 17:22:50 +02:00
win_utils.py bpo-44336: Prevent tests hanging on child process handles on Windows (GH-26578) 2022-03-22 00:06:55 +00:00
worker.py gh-109413: Fix some trivial mypy nitpicks in libregrtest (#109454) 2023-09-15 17:01:28 +00:00