6008 commits

Author	SHA1	Message	Date
Victor Stinner	fa43a1e0f8	gh-127705: Move Py_INCREF_MORTAL() to the internal C API (GH-136178) ... Rename Py_INCREF_MORTAL() to _Py_INCREF_MORTAL() and move it to pycore_object.h internal header.	2025-07-02 15:40:41 +02:00
Sam Gross	f41e9c750e	gh-134009: Expose PyMutex_IsLocked in the public C API (gh-134365) ... The `PyMutex_IsLocked()` function is useful in assertions for verifying that code maintains certain locking invariants.	2025-07-01 13:26:13 -04:00
Ken Jin	e0d6500b2d	gh-136125: Use _PyObject_GetMethodStackRef for LOAD_ATTR (GH-136127)	2025-07-02 01:20:46 +08:00
Victor Stinner	28940e8e48	gh-130396: Move PYOS_LOG2_STACK_MARGIN to internal headers (#135928) ... Move PYOS_LOG2_STACK_MARGIN, PYOS_STACK_MARGIN, PYOS_STACK_MARGIN_BYTES and PYOS_STACK_MARGIN_SHIFT macros to pycore_pythonrun.h internal header. Add underscore (_) prefix to the names to make them private. Rename _PYOS to _PyOS.	2025-07-01 15:18:17 +02:00
Petr Viktorin	fe119a0817	gh-87135: threading.Lock: Raise rather than hang on Python finalization (GH-135991) ... After Python finalization gets to the point where no other thread can attach thread state, attempting to acquire a Python lock must hang. Raise PythonFinalizationError instead of hanging.	2025-07-01 10:57:42 +02:00
Petr Viktorin	845263adc6	gh-133157: remove usage of _Py_NO_SANITIZE_UNDEFINED in pyexpat (#135346) ... This was the last usage, so the macro is removed as well. Co-authored-by: Bénédikt Tran <10796600+picnixz@users.noreply.github.com>	2025-07-01 10:54:08 +02:00
Xuanteng Huang	b1056c2a44	gh-135607: remove null checking of weakref list in dealloc of extension modules and objects (#135614) ... Co-authored-by: Kumar Aditya <kumaraditya@python.org> Co-authored-by: Victor Stinner <vstinner@python.org>	2025-06-30 11:14:31 +00:00
Weilin Du	698bab5a40	Doc: fix duplicated words (#136086) ... --------- Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>	2025-06-29 18:04:02 -04:00
Pablo Galindo Salgado	5334732f9c	gh-91048: Fix external inspection multi-threaded performance (#136005)	2025-06-28 14:11:31 +01:00
Ken Jin	695ab61351	gh-132732: Automatically constant evaluate pure operations (GH-132733) ... This adds a "macro" to the optimizer DSL called "REPLACE_OPCODE_IF_EVALUATES_PURE", which allows automatically constant evaluating a bytecode body if certain inputs have no side effects upon evaluations (such as ints, strings, and floats). Co-authored-by: Tomas R. <tomas.roun8@gmail.com>	2025-06-27 19:37:44 +08:00
Victor Stinner	8594d2c03d	gh-135927: Check _MSC_VER to define _Py_NULL macro (#135987)	2025-06-26 18:11:49 +02:00
Petr Viktorin	6be17baeb5	gh-135755: Use private names (_Py*) for header file guards new in 3.14 (GH-135921) ... These are private API; let's name new ones accordingly.	2025-06-26 13:05:01 +02:00
Peter Bierma	10a3d43188	gh-135755: Move PyFunction_GET_BUILTINS to the private API (GH-135938)	2025-06-26 11:43:08 +02:00
Petr Viktorin	a1da208eec	gh-131591: Add Py_ prefix to MAX_SCRIPT_PATH_SIZE; remove unprefixed struct tag (GH-135924) ... Names/macros defined in public headers should have `Py`/`_Py` prefixes.	2025-06-26 09:25:41 +02:00
Ken Jin	a88b49c3f2	gh-135927: Fix MSVC Clatest C builds (GH-135935)	2025-06-25 23:02:53 +08:00
Petr Viktorin	1b1ae82fab	gh-135755: Move SPECIAL_ constants to a private header (GH-135922) ... Macros without a `Py`/`_Py` prefix should not be defined in public headers.	2025-06-25 13:03:05 +02:00
Neil Schemenauer	113de8545f	GH-133136: Revise QSBR to reduce excess memory held (gh-135473) ... The free threading build uses QSBR to delay the freeing of dictionary keys and list arrays when the objects are accessed by multiple threads in order to allow concurrent reads to proceed with holding the object lock. The requests are processed in batches to reduce execution overhead, but for large memory blocks this can lead to excess memory usage. Take into account the size of the memory block when deciding when to process QSBR requests. Also track the amount of memory being held by QSBR for mimalloc pages. Advance the write sequence if this memory exceeds a limit. Advancing the sequence will allow it to be freed more quickly. Process the held QSBR items from the "eval breaker", rather than from `_PyMem_FreeDelayed()`. This gives a higher chance that the global read sequence has advanced enough so that items can be freed. Co-authored-by: Sam Gross <colesbury@gmail.com>	2025-06-25 00:06:32 -07:00
Ken Jin	569fc6870f	gh-134584: Specialize POP_TOP by reference and type in JIT (GH-135761)	2025-06-24 00:57:14 +08:00
Kumar Aditya	a8ec511900	gh-135380: enhance critical section held assertions (#135381)	2025-06-20 22:43:23 +05:30
Ken Jin	0243260284	gh-135379: Move PyLong_CheckCompact to private header and rename it (GH-135707)	2025-06-19 13:09:09 +00:00
Ken Jin	1b969f6d57	gh-135379: Add back const cast to _PyLong_IsCompact (GH-135706)	2025-06-19 13:54:21 +02:00
Mark Shannon	9731dd2c8d	GH-135379: Specialize int operations for compact ints only (GH-135668)	2025-06-19 11:10:29 +01:00
Donghee Na	52be7f445e	gh-133931: Introduce _PyObject_XSetRefDelayed to replace Py_XSETREF (gh-134377)	2025-06-18 08:36:02 +09:00
Ken Jin	fba5dded6d	gh-134584: Decref elimination for float ops in the JIT (GH-134588) ... This PR adds a PyJitRef API to the JIT's optimizer that mimics the _PyStackRef API. This allows it to track references and their stack lifetimes properly. Thus opening up the doorway to refcount elimination in the JIT.	2025-06-17 23:25:53 +08:00
Mark Shannon	8dd8b5c2f0	GH-135379: Support limited scalar replacement for replicated uops in the JIT code generator. (GH-135563) ... * Use it to support efficient specializations of COPY and SWAP in the JIT.	2025-06-17 13:43:09 +01:00
Eric Snow	a450a0ddec	gh-135443: Sometimes Fall Back to __main__.__dict__ For Globals (gh-135491) ... For several builtin functions, we now fall back to __main__.__dict__ for the globals when there is no current frame and _PyInterpreterState_IsRunningMain() returns true. This allows those functions to be run with Interpreter.call(). The affected builtins: * exec() * eval() * globals() * locals() * vars() * dir() We take a similar approach with "stateless" functions, which don't use any global variables.	2025-06-16 17:34:19 -06:00
Ken Jin	7b15873ed0	gh-135474: Specialize arithmetic only on compact ints (GH-135479) ... Specialize arithmetic only on compact ints. This also makes int operations non-escaping in the JIT and in tier 1.	2025-06-14 17:13:32 +08:00
Eric Snow	c7f4a80079	gh-132775: Clean Up Cross-Interpreter Error Handling (gh-135369) ... In this refactor we: * move some code around * make a couple of typedefs opaque * decouple errors from session state * improve tracebacks for propagated exceptions This change helps simplify several upcoming changes.	2025-06-13 16:45:21 -06:00
Sergey B Kirpichev	c646846c1e	gh-126703: Add freelist for PyComplexObject's (gh-135233)	2025-06-13 22:32:26 +09:00
Mark Shannon	c87b5b2cb6	GH-135379: Remove types from stack items in code generator. (GH-135384) ... * Make casts explicit in the instruction definitions	2025-06-11 15:52:25 +01:00
Petr Viktorin	49d72365cd	gh-127545: Add _Py_ALIGNED_DEF(N, T) and use it for PyObject (GH-135209) ... * Replace _Py_ALIGN_AS(V) by _Py_ALIGNED_DEF(N, T) This is now a common façade for the various `_Alignas` alternatives, which behave in interesting ways -- see the source comment. The new macro (and MSVC's `__declspec(align)`) should not be used on a variable/member declaration that includes a struct declaraton. A workaround is to separate the struct definition. Do that for `PyASCIIObject.state`. * Specify minimum PyGC_Head and PyObject alignment As documented in InternalDocs/garbage_collector.md, the garbage collector stores flags in the least significant two bits of the _gc_prev pointer in struct PyGC_Head. Consequently, this pointer is only capable of storing a location that's aligned to a 4-byte boundary. Encode this requirement using _Py_ALIGNED_DEF. This patch fixes a segfault in m68k, which was previously investigated by Adrian Glaubitz here: https://lists.debian.org/debian-68k/2024/11/msg00020.html https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1087600 Original patch (using the GCC-only Py_ALIGNED) by Finn Thain. Co-authored-by: Finn Thain <fthain@linux-m68k.org> Co-authored-by: Victor Stinner <vstinner@python.org> Co-authored-by: John Paul Adrian Glaubitz <glaubitz@physik.fu-berlin.de>	2025-06-11 12:44:58 +02:00
Petr Viktorin	e413e26719	gh-134891: Add PyUnstable_Unicode_GET_CACHED_HASH (GH-134892)	2025-06-06 15:51:00 +02:00
Mark Shannon	b90ecea9e6	GH-132554: Fix tier2 FOR_ITER implementation and optimizations (GH-135137)	2025-06-05 18:53:57 +01:00
Victor Stinner	9258f3da91	gh-134989: Fix Py_RETURN_NONE in the limited C API (GH-135165) ... Fix Py_RETURN_NONE, Py_RETURN_TRUE and Py_RETURN_FALSE macros in the limited C API 3.11 and older: Don't treat Py_None, Py_True and Py_False as immortal.	2025-06-05 14:43:47 +02:00
mpage	6b77af257c	gh-134889: Fix handling of a few opcodes when optimizing LOAD_FAST (#134958) ... We were incorrectly handling a few opcodes that leave their operands on the stack. Treat all of these conservatively; assume that they always leave operands on the stack.	2025-06-04 16:07:58 -07:00
Victor Stinner	c21113072c	gh-134989: Implement PyObject_DelAttr() as a macro in the limited C API (GH-135021)	2025-06-04 15:07:52 +02:00
Donghee Na	b525e31b7f	gh-134875: Fix mimallc build error for the old compilers (gh-134994)	2025-06-03 08:40:40 +09:00
Eric Snow	52deabefd0	gh-132775: Expand the Capability of Interpreter.call() (gh-133484) ... It now supports most callables, full args, and return values.	2025-05-30 09:15:00 -06:00
Bénédikt Tran	c600310663	gh-134586: mark _mi_assert_fail as noreturn, cold and throw (#134624) ... We add the following attributes on `_mi_assert_fail` to help IDE introspection: * `__attribute__((__noreturn__))` * `__attribute__((cold))` * `__THROW` (GCC only)	2025-05-30 14:44:03 +02:00
Victor Stinner	ebf6d13567	gh-134745: Change PyThread_allocate_lock() implementation to PyMutex (#134747) ... Co-authored-by: Sam Gross <colesbury@gmail.com>	2025-05-30 10:15:47 +00:00
Victor Stinner	f49a07b531	gh-133968: Add PyUnicodeWriter_WriteASCII() function (#133973) ... Replace most PyUnicodeWriter_WriteUTF8() calls with PyUnicodeWriter_WriteASCII(). Unrelated change to please the linter: remove an unused import in test_ctypes. Co-authored-by: Peter Bierma <zintensitydev@gmail.com> Co-authored-by: Bénédikt Tran <10796600+picnixz@users.noreply.github.com>	2025-05-29 14:54:30 +00:00
Mark Shannon	9fbd66a93d	GH-133912: Fix PyObject_GenericSetDict to handle inline values (GH-134725)	2025-05-28 19:03:41 +01:00
Serhiy Storchaka	bac3fcba5b	gh-108512: Add and use new replacements for PySys_GetObject() (GH-111035) ... Add functions PySys_GetAttr(), PySys_GetAttrString(), PySys_GetOptionalAttr() and PySys_GetOptionalAttrString().	2025-05-28 20:11:09 +03:00
Petr Viktorin	0d499c7e93	gh-128629: Add _Py_PACK_VERSION for CPython's own definitions (GH-134247) ... Add _Py_PACK_VERSION for CPython's own definitions Py_PACK_VERSION was added to limited API in 3.14, so if Py_LIMITED_API is lower, the macro can't be used. Add a private version that can be used in CPython headers for checks like `Py_LIMITED_API+0 >= _Py_PACK_VERSION(3, 14)`.	2025-05-28 15:24:40 +02:00
Neil Schemenauer	fbbbc10055	gh-127266: avoid data races when updating type slots (gh-133177) ... In the free-threaded build, avoid data races caused by updating type slots or type flags after the type was initially created. For those (typically rare) cases, use the stop-the-world mechanism. Remove the use of atomics when reading or writing type flags.	2025-05-27 18:27:41 -07:00
Kumar Aditya	a380d57873	gh-134043: use stackrefs in vectorcalling methods (#134044) ... Adds `_PyObject_GetMethodStackRef` which uses stackrefs and takes advantage of deferred reference counting in free-threading while calling method objects in vectorcall.	2025-05-27 22:28:27 +05:30
Mark Shannon	f6f4e8a662	GH-132554: "Virtual" iterators (GH-132555) ... * FOR_ITER now pushes either the iterator and NULL or leaves the iterable and pushes tagged zero * NEXT_ITER uses the tagged int as the index into the sequence or, if TOS is NULL, iterates as before.	2025-05-27 15:59:45 +01:00
Pablo Galindo Salgado	0909d6d8e8	gh-91048: Add better error messages for remote debugging for CI builds (#134682)	2025-05-26 15:31:47 +01:00
Pieter Eendebak	fb09db1b93	gh-129594: Remove redundant check on varargs in _PyArg_CheckPositional (#129595)	2025-05-26 10:51:12 +02:00
Pablo Galindo Salgado	42b25ad4d3	gh-91048: Refactor and optimize remote debugging module (#134652) ... Completely refactor Modules/_remote_debugging_module.c with improved code organization, replacing scattered reference counting and error handling with centralized goto error paths. This cleanup improves maintainability and reduces code duplication throughout the module while preserving the same external API. Implement memory page caching optimization in Python/remote_debug.h to avoid repeated reads of the same memory regions during debugging operations. The cache stores previously read memory pages and reuses them for subsequent reads, significantly reducing system calls and improving performance. Add code object caching mechanism with a new code_object_generation field in the interpreter state that tracks when code object caches need invalidation. This allows efficient reuse of parsed code object metadata and eliminates redundant processing of the same code objects across debugging sessions. Optimize memory operations by replacing multiple individual structure copies with single bulk reads for the same data structures. This reduces the number of memory operations and system calls required to gather debugging information from the target process. Update Makefile.pre.in to include Python/remote_debug.h in the headers list, ensuring that changes to the remote debugging header force proper recompilation of dependent modules and maintain build consistency across the codebase. Also, make the module compatible with the free threading build as an extra :) Co-authored-by: Łukasz Langa <lukasz@langa.pl>	2025-05-25 20:19:29 +00:00