9785 commits

Author	SHA1	Message	Date
Ken Jin	c419af9e27	gh-132732: JIT: Only allow compact ints in pure evaluation (GH-136040)	2025-06-28 00:18:44 +08:00
Ken Jin	695ab61351	gh-132732: Automatically constant evaluate pure operations (GH-132733) ... This adds a "macro" to the optimizer DSL called "REPLACE_OPCODE_IF_EVALUATES_PURE", which allows automatically constant evaluating a bytecode body if certain inputs have no side effects upon evaluations (such as ints, strings, and floats). Co-authored-by: Tomas R. <tomas.roun8@gmail.com>	2025-06-27 19:37:44 +08:00
Joseph Tibbertsma	cbfaf41caf	Fix needless spinning in _PyMutex_LockTimed with zero timeout (gh-135872) ... The free threading build could spin unnecessarily on `_Py_yield()` if the initial compare and swap failed.	2025-06-25 16:41:36 +00:00
Petr Viktorin	1b1ae82fab	gh-135755: Move SPECIAL_ constants to a private header (GH-135922) ... Macros without a `Py`/`_Py` prefix should not be defined in public headers.	2025-06-25 13:03:05 +02:00
Neil Schemenauer	113de8545f	GH-133136: Revise QSBR to reduce excess memory held (gh-135473) ... The free threading build uses QSBR to delay the freeing of dictionary keys and list arrays when the objects are accessed by multiple threads in order to allow concurrent reads to proceed with holding the object lock. The requests are processed in batches to reduce execution overhead, but for large memory blocks this can lead to excess memory usage. Take into account the size of the memory block when deciding when to process QSBR requests. Also track the amount of memory being held by QSBR for mimalloc pages. Advance the write sequence if this memory exceeds a limit. Advancing the sequence will allow it to be freed more quickly. Process the held QSBR items from the "eval breaker", rather than from `_PyMem_FreeDelayed()`. This gives a higher chance that the global read sequence has advanced enough so that items can be freed. Co-authored-by: Sam Gross <colesbury@gmail.com>	2025-06-25 00:06:32 -07:00
Brian Schubert	4e6f0d116e	gh-135855: Raise TypeError When Passing Non-dict Object to _interpreters.set___main___attrs (gh-135856)	2025-06-24 12:53:14 -06:00
Neil Schemenauer	ceae4edf81	gh-119786: Add InternalDocs/qsbr.md. (gh-135411) ... Add internal doc for the Quiescent-State Based Reclamation (QSBR) implementation.	2025-06-23 22:09:40 +00:00
Noam Cohen	bda121862e	gh-131798: Optimize _UNARY_NEGATIVE (GH-135223)	2025-06-24 03:42:09 +08:00
Ken Jin	569fc6870f	gh-134584: Specialize POP_TOP by reference and type in JIT (GH-135761)	2025-06-24 00:57:14 +08:00
sobolevn	8ca1e4d846	gh-135645: Added supports_isolated_interpreters to sys.implementation (#135667) ... Co-authored-by: Eric Snow <ericsnowcurrently@gmail.com>	2025-06-21 10:56:14 +03:00
Tomas R.	61532b4bc7	gh-131798: JIT: Optimize _CALL_LEN when the length is known (#135260) ... * Add news entry * Optimize _CALL_LEN * Simplify tests	2025-06-20 18:21:39 +02:00
Ken Jin	b53b0c14da	gh-135608: Add a null check for attribute promotion to fix a JIT crash (GH-135613) ... Co-authored-by: devdanzin <74280297+devdanzin@users.noreply.github.com>	2025-06-20 14:33:35 +08:00
Nadeshiko Manju	1ddfe59320	gh-135543: Emit sys.remote_exec audit event when sys.remote_exec is called (GH-135544)	2025-06-19 21:23:38 +01:00
Ken Jin	0243260284	gh-135379: Move PyLong_CheckCompact to private header and rename it (GH-135707)	2025-06-19 13:09:09 +00:00
Mark Shannon	9731dd2c8d	GH-135379: Specialize int operations for compact ints only (GH-135668)	2025-06-19 11:10:29 +01:00
Eric Snow	725da50520	gh-133485: Use interpreters.Interpreter in InterpreterPoolExecutor (gh-133957) ... Most importantly, this resolves the issues with functions and types defined in __main__. It also expands the number of supported objects and simplifies the implementation.	2025-06-18 17:57:14 -06:00
Eric Snow	269e19e0a7	gh-132775: Fix Interpreter.call() __main__ Visibility (gh-135595) ... As noted in the new tests, there are a few situations we must carefully accommodate for functions that get pickled during interp.call(). We do so by running the script from the main interpreter's __main__ module in a hidden module in the other interpreter. That hidden module is used as the function __globals__.	2025-06-17 13:16:59 -06:00
Ken Jin	fba5dded6d	gh-134584: Decref elimination for float ops in the JIT (GH-134588) ... This PR adds a PyJitRef API to the JIT's optimizer that mimics the _PyStackRef API. This allows it to track references and their stack lifetimes properly. Thus opening up the doorway to refcount elimination in the JIT.	2025-06-17 23:25:53 +08:00
Mark Shannon	8dd8b5c2f0	GH-135379: Support limited scalar replacement for replicated uops in the JIT code generator. (GH-135563) ... * Use it to support efficient specializations of COPY and SWAP in the JIT.	2025-06-17 13:43:09 +01:00
PuQing	a9e66a7c50	gh-132815: Add support for JUMP_BACKWARD in specialization stats (#135606)	2025-06-17 14:11:09 +02:00
Eric Snow	a450a0ddec	gh-135443: Sometimes Fall Back to __main__.__dict__ For Globals (gh-135491) ... For several builtin functions, we now fall back to __main__.__dict__ for the globals when there is no current frame and _PyInterpreterState_IsRunningMain() returns true. This allows those functions to be run with Interpreter.call(). The affected builtins: * exec() * eval() * globals() * locals() * vars() * dir() We take a similar approach with "stateless" functions, which don't use any global variables.	2025-06-16 17:34:19 -06:00
Hood Chatham	68b7e1a667	gh-128627: Emscripten: Add missing semicolon in ios detection code (#135590)	2025-06-16 23:17:17 +00:00
sobolevn	4c15505071	gh-135513: Fix unused variable warning in crossinterp.c (#135514)	2025-06-16 18:12:20 +02:00
Donghee Na	f079979599	gh-119132: Remove "experimental" tag from the CPython free-threading. (gh-135550) ... * gh-119132: Remove "experimental" tag from the CPython free-threading build * Address code review Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com> * Add NEWS.d * Regen configure.ac * Update doc * Update * Update * Update * Update Doc/howto/free-threading-python.rst Co-authored-by: Peter Bierma <zintensitydev@gmail.com> * Update ctypes.rst * Update * Update Doc/howto/free-threading-python.rst Co-authored-by: T. Wouters <thomas@python.org> * Apply suggestions from code review Co-authored-by: T. Wouters <thomas@python.org> Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com> --------- Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com> Co-authored-by: Peter Bierma <zintensitydev@gmail.com> Co-authored-by: T. Wouters <thomas@python.org>	2025-06-16 23:32:52 +09:00
Nadeshiko Manju	667a86e076	gh-131798: JIT: replace _CHECK_METHOD_VERSION with _CHECK_FUNCTION_VERSION_INLINE (GH-135022) ... Signed-off-by: Manjusaka <me@manjusaka.me> Co-authored-by: Brandt Bucher <brandtbucher@gmail.com>	2025-06-16 13:25:50 +08:00
Ken Jin	7b15873ed0	gh-135474: Specialize arithmetic only on compact ints (GH-135479) ... Specialize arithmetic only on compact ints. This also makes int operations non-escaping in the JIT and in tier 1.	2025-06-14 17:13:32 +08:00
Eric Snow	c7f4a80079	gh-132775: Clean Up Cross-Interpreter Error Handling (gh-135369) ... In this refactor we: * move some code around * make a couple of typedefs opaque * decouple errors from session state * improve tracebacks for propagated exceptions This change helps simplify several upcoming changes.	2025-06-13 16:45:21 -06:00
Gyeongjae Choi	d447129758	gh-128627: Fix iPad detection in wasm-gc (#135388) ... On some iPad versions, Safari reports as "macOS". Modifies the GC trampoline detection to add a feature-based check to detect this case.	2025-06-12 04:04:13 +00:00
Eric Snow	62143736b6	gh-134939: Add the concurrent.interpreters Module (gh-133958) ... PEP-734 has been accepted (for 3.14). (FTR, I'm opposed to putting this under the concurrent package, but doing so is the SC condition under which the module can land in 3.14.)	2025-06-11 17:35:48 -06:00
Mark Shannon	c87b5b2cb6	GH-135379: Remove types from stack items in code generator. (GH-135384) ... * Make casts explicit in the instruction definitions	2025-06-11 15:52:25 +01:00
Chris Eibl	49fc1f215a	Fix warnings set but not used [-Wunused-but-set-variable] in remote_debug.h (#135290)	2025-06-10 01:05:06 +01:00
Zanie Blue	2e1ad6eb26	Fix definition of _Py_RemoteDebug_ symbols for static linking (#135146)	2025-06-10 01:03:55 +01:00
Noam Cohen	b150b6aca7	gh-131798: Optimize _UNARY_INVERT (GH-135222)	2025-06-09 18:33:18 +08:00
Amit Lavon	8fdbbf8b18	GH-131798: Type-propagate string/list/tuple slices (GH-134671)	2025-06-07 14:08:44 -07:00
Daniel Golding	ac9c3431cc	gh-134876: Add fallback for when process_vm_readv fails with ENOSYS (#134878)	2025-06-07 19:32:06 +01:00
Tomas R.	46151648ca	GH-131798: Optimize away type(x) in the JIT when the result is known (GH-135194)	2025-06-06 16:44:43 -07:00
Mark Shannon	b90ecea9e6	GH-132554: Fix tier2 FOR_ITER implementation and optimizations (GH-135137)	2025-06-05 18:53:57 +01:00
rialbat	8919cb4ad9	gh-135161: Remove redundant NULL check for 'exc' after dereference in ceval.c (#135162)	2025-06-05 17:08:48 +02:00
mpage	6b77af257c	gh-134889: Fix handling of a few opcodes when optimizing LOAD_FAST (#134958) ... We were incorrectly handling a few opcodes that leave their operands on the stack. Treat all of these conservatively; assume that they always leave operands on the stack.	2025-06-04 16:07:58 -07:00
Sam Gross	cc581f32bf	gh-135099: Only wait on _PyOS_SigintEvent() in main thread (GH-135100) ... On Windows, the `_PyOS_SigintEvent()` event handle is used to interrupt the main thread when Ctrl-C is pressed. Previously, we also waited on the event from other threads, but ignored the result. However, this can race with interpreter shutdown because the main thread closes the handle in `_PySignal_Fini` and threads may still be running and using mutexes during interpreter shtudown. Only use `_PyOS_SigintEvent()` in the main thread in parking_lot.c, like we do in other places in the CPython codebase.	2025-06-04 09:35:56 +02:00
stratakis	485b499610	gh-128605: Add branch protections for x86_64 in asm_trampoline.S (#128606) ... Apply Intel Control-flow Technology for x86-64 on asm_trampoline.S. Required for mitigation against return-oriented programming (ROP) and Call or Jump Oriented Programming (COP/JOP) attacks. Manual application is required for the assembly files. See also: https://sourceware.org/annobin/annobin.html/Test-cf-protection.html	2025-06-03 09:09:43 +02:00
Eric Snow	52deabefd0	gh-132775: Expand the Capability of Interpreter.call() (gh-133484) ... It now supports most callables, full args, and return values.	2025-05-30 09:15:00 -06:00
Mark Shannon	ce6a6371a2	GH-134879: Fix INSTRUMENT_FOR_ITER for list/tuple (#134897) ... Fix INSTRUMENT_FOR_ITER for list/tuple	2025-05-30 07:11:42 -07:00
Victor Stinner	ebf6d13567	gh-134745: Change PyThread_allocate_lock() implementation to PyMutex (#134747) ... Co-authored-by: Sam Gross <colesbury@gmail.com>	2025-05-30 10:15:47 +00:00
Victor Stinner	f49a07b531	gh-133968: Add PyUnicodeWriter_WriteASCII() function (#133973) ... Replace most PyUnicodeWriter_WriteUTF8() calls with PyUnicodeWriter_WriteASCII(). Unrelated change to please the linter: remove an unused import in test_ctypes. Co-authored-by: Peter Bierma <zintensitydev@gmail.com> Co-authored-by: Bénédikt Tran <10796600+picnixz@users.noreply.github.com>	2025-05-29 14:54:30 +00:00
Serhiy Storchaka	bac3fcba5b	gh-108512: Add and use new replacements for PySys_GetObject() (GH-111035) ... Add functions PySys_GetAttr(), PySys_GetAttrString(), PySys_GetOptionalAttr() and PySys_GetOptionalAttrString().	2025-05-28 20:11:09 +03:00
Petr Viktorin	0d499c7e93	gh-128629: Add _Py_PACK_VERSION for CPython's own definitions (GH-134247) ... Add _Py_PACK_VERSION for CPython's own definitions Py_PACK_VERSION was added to limited API in 3.14, so if Py_LIMITED_API is lower, the macro can't be used. Add a private version that can be used in CPython headers for checks like `Py_LIMITED_API+0 >= _Py_PACK_VERSION(3, 14)`.	2025-05-28 15:24:40 +02:00
Neil Schemenauer	fbbbc10055	gh-127266: avoid data races when updating type slots (gh-133177) ... In the free-threaded build, avoid data races caused by updating type slots or type flags after the type was initially created. For those (typically rare) cases, use the stop-the-world mechanism. Remove the use of atomics when reading or writing type flags.	2025-05-27 18:27:41 -07:00
Noam Cohen	79d81f7cba	gh-131798: Optimize _ITER_CHECK_TUPLE (GH-134803)	2025-05-28 02:30:17 +08:00
Kumar Aditya	ac539e7e0d	gh-132917: fix data race on last_mem in free-threading gc (#134692)	2025-05-27 22:42:08 +05:30