Skip to content

[DIFF] Immutability for NoGIL for 3.15a - #112

Open
xFrednet wants to merge 3781 commits into
immutable-basefrom
immutable-nogil
Open

[DIFF] Immutability for NoGIL for 3.15a#112
xFrednet wants to merge 3781 commits into
immutable-basefrom
immutable-nogil

Conversation

@xFrednet

@xFrednet xFrednet commented Sep 24, 2026 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Collaborator

This is the entire diff to implement shallow and deep immutability for Python. This also includes the write-barriers from #63. The relevant files for this PR are probably:

Include/cpython/immutability.h
Include/internal/pycore_gc.h
Include/internal/pycore_immutability.h
Include/internal/pycore_object.h
Include/internal/pycore_stackref.h
Include/internal/pycore_weakref.h
Include/object.h
Include/refcount.h
Lib/immutable.py
Modules/_immutablemodule.c
Modules/_weakref.c
Objects/object.c
Objects/weakrefobject.c
Python/ceval.c
Python/crossinterp.c
Python/gc.c
Python/immutability.c

📚 Documentation preview 📚: https://cpython-previews--112.org.readthedocs.build/

pablogsal and others added 30 commits August 26, 2026 12:37
@pablogsal
[3.15] pythongh-154060: Preserve replay duration and rate (pythonGH-1…
27c8f1f 
…54101) (python#156407)
@miss-islington @pablogsal
[3.15] pythongh-154085: Avoid duplicating diff line values (pythonGH-…
cfaf610 
…154099) (python#156385)

pythongh-154085: Avoid duplicating diff line values (pythonGH-154099)
(cherry picked from commit 53381bc)

Co-authored-by: Pablo Galindo Salgado <Pablogsal@gmail.com>
@miss-islington @ambv @claude
[3.15] pythongh-154467: Fix empty (Pdb) prompt when attaching to a pr…
b18a8b6 
…ocess with pdb -p (pythonGH-154469) (pythonGH-156397)

pythongh-154467: Fix empty (Pdb) prompt when attaching to a process with pdb -p (pythonGH-154469)

_PdbServer inherits _cmdloop, which wraps cmdloop() in
_maybe_use_pyrepl_as_stdin(). That context manager blanks self.prompt to ''
so that a local pyrepl draws the prompt itself. The remote server, however,
never reads from a local pyrepl -- it transmits self.prompt to the client
over the socket -- so the blanking made it send an empty prompt whenever the
target process had a pyrepl-capable terminal (pyrepl_input is set).

Override _maybe_use_pyrepl_as_stdin() in _PdbServer to a no-op, keeping the
real prompt. Add an integration test that attaches to a target running under
a pty, so PyREPL is genuinely enabled inside it, and asserts the transmitted
prompt is "(Pdb) ".
(cherry picked from commit 1ec5607)

Co-authored-by: Łukasz Langa <lukasz@langa.pl>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@nedbat @StanFromIreland
[3.15] Docs(build): linklint is now called sphinx_linklint (pythonGH-…
89afe3e 
…156373) (python#156429)

(cherry picked from commit 98bd716)

Co-authored-by: Stan Ulbrych <stan@python.org>
@deadlovelll
[3.15] pythongh-155894: Fix wait_for() docs claiming a coroutine is w…
76ef766 
…rapped in a Task (python#156038)
@miss-islington @terryjreedy
[3.15] pythongh-155648: Fix IDLE tests that cannot fail (pythonGH-156257
96ae61d 
) (python#156315)

Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>
@miss-islington @hoodmane
[3.15] pythongh-156243: Indicate that emscripten_runtime depends on s…
7d10c8d 
…tringToNewUTF8 (pythonGH-156335) (python#156383)

Co-authored-by: Hood Chatham <roberthoodchatham@gmail.com>
@miss-islington @arcivanov @warsaw
[3.15] pythongh-156404: Restore the 'fullname' variable for .pth impo…
224db4e 
…rt lines (pythonGH-156406) (python#156431)

Co-authored-by: Arcadiy Ivanov <arcadiy@ivanov.biz>
Co-authored-by: Barry Warsaw <barry@python.org>
@zooba
[3.15] pythongh-148750: Unfreeze encodings module to avoid import err…
5886ba2 
…ors with zipped stdlib (pythonGH-156183) (python#156328)
@zware
[3.15] pythongh-156369: Bump OpenSSL versions for iOS and Android (py…
7b69079 
…thonGH-156432) (python#156436)
@miss-islington @ned-deily
[3.15] pythongh-156369: Update macOS installer to use OpenSSL 3.5.8. (p…
bd83c3d 
…ythonGH-156447) (python#156449)

Co-authored-by: Ned Deily <nad@python.org>
@nedbat
[3.15] Docs: remove __path__ discussion from tutorial (pythonGH-156426)…
f6b7e5b 
… (python#156455)
@miss-islington @encukou
[3.15] pythongh-65961: Document __cached__ removal in What's New & cl…
1c82381 
…arify references to it (pythonGH-156053) (python#156123)

Co-authored-by: Petr Viktorin <encukou@gmail.com>
@miss-islington @deadlovelll
[3.15] pythongh-156246: Fix documented default of the asyncio limit a…
7b89973 
…rgument (pythonGH-156247) (python#156254)

Co-authored-by: Timofei Ivankov <128279579+deadlovelll@users.noreply.github.com>
@miss-islington @dr-carlos
[3.15] pythongh-141174: Test type_repr() of Template with invalid…
4c9ac60 
… syntax in `Interpolation` (pythonGH-155661) (python#155711)

Co-authored-by: dr-carlos <77367421+dr-carlos@users.noreply.github.com>
@miss-islington @dr-carlos
[3.15] pythongh-141174: Test get_annotations() on wrapped cyclical …
94aa79c 
…`functools.partial` (pythonGH-155663) (python#155709)

Co-authored-by: dr-carlos <77367421+dr-carlos@users.noreply.github.com>
@miss-islington @asnelling
@claude @serhiy-storchaka
[3.15] pythongh-90982: Document prefixes argument on site.getsitepack…
50c4698 
…ages (pythonGH-31546) (python#155643)

Co-authored-by: Addison Snelling <addison@asnell.io>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@miss-islington @serhiy-storchaka
[3.15] pythongh-84548: Document Windows specific behavior of abspath(…
6e4aa89 
…) and realpath() (pythonGH-155388) (python#155673)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@miss-islington @serhiy-storchaka
[3.15] pythongh-89024: Document the 3.10 change in escaping the csv e…
f47da0f 
…scapechar (pythonGH-155067) (python#155685)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@serhiy-storchaka @claude
[3.15] pythongh-154139: Document that curses is not thread-safe (pyth…
4951a11 
…onGH-154173) (python#155690)

Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
@serhiy-storchaka
[3.15] pythongh-156234: Fix and rewrite the curses documentation on r…
6a9dbff 
…eading (pythonGH-156235) (python#156279)
@miss-islington @MannarAmuthan @ashkop
[3.15] pythongh-67765: Add tests for wsgiref.validate (pythonGH-112398)…
c15b6bf 
… (python#155622)

Co-authored-by: Amuthan Mannar <amuthanmannar4@gmail.com>
Co-authored-by: Alex Shkop <a.v.shkop@gmail.com>
@miss-islington @serhiy-storchaka
[3.15] pythongh-78526: Add tests for PEP 468 and PEP 520 (pythonGH-15…
a1b9786 
…5387) (python#155676)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@miss-islington @serhiy-storchaka
[3.15] pythongh-155732: Join the terminated process in test_repr_lock (…
bfa1595 
…pythonGH-155734) (python#155766)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@miss-islington @serhiy-storchaka
[3.15] pythongh-155727: Ignore internal imports in test_attribute_com…
a8e716a 
…pletion (pythonGH-155730) (python#155769)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@miss-islington @dslavicek @tomasr8
[3.15] improve test_copy_reduce and test_deepcopy_reduce coverage (py…
5f6e39a 
…thonGH-154182) (python#155792)

Co-authored-by: David <slavicek.david29@gmail.com>
Co-authored-by: Tomas R. <tomas.roun8@gmail.com>
@miss-islington @picnixz
[3.15] pythongh-155430: fix hmac.digest bigmem test (pythonGH-155431)…
6f65cec 
… (python#155846)

Co-authored-by: Bénédikt Tran <10796600+picnixz@users.noreply.github.com>
@miss-islington @StanFromIreland
[3.15] pythongh-111735: Skip turtle doctests when _tkinter is not…
431f526 
… available (pythonGH-156417) (python#156470)

Co-authored-by: Stan Ulbrych <stan@python.org>
@miss-islington @zware
[3.15] pythongh-156369: Update Windows builds to OpenSSL 3.5.8 (pytho…
f1be67f 
…nGH-156528) (python#156530)

pythongh-156369: Update Windows builds to OpenSSL 3.5.8 (pythonGH-156528)
(cherry picked from commit b7ce9c3)

Co-authored-by: Zachary Ware <zach@python.org>
@miss-islington @StanFromIreland
[3.15] pythongh-155952: Fix <unrepresentable> Argument Clinic defau…
32beeab 
…lts in several signatures (pythonGH-155954) (python#156165)

pythongh-155952: Fix `<unrepresentable>` Argument Clinic defaults in several signatures (pythonGH-155954)
(cherry picked from commit 033dc43)

Co-authored-by: Stan Ulbrych <stan@python.org>
maurycy and others added 23 commits October 5, 2026 10:21
@maurycy @pablogsal @claude
[3.15] pythongh-155811: Add a seqcount to gc_stats to prevent torn …
0281240 
…reads (pythonGH-155828) (python#158829)

* update_seq

* no need for XCHGL, MOVL is enough?

* pythongh-155811: Retry an inconsistent GC snapshot once

---------
(cherry picked from commit 5fecd44)

Co-authored-by: Pablo Galindo Salgado <Pablogsal@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
@miss-islington @maurycy @pablogsal
[3.15] pythongh-151292: _remote_debugging: Do not corrupt the binar…
8a7c23f 
…y file when hitting `OverflowError` (pythonGH-152892) (python#158830)

pythongh-151292: `_remote_debugging`: Do not corrupt the binary file when hitting `OverflowError` (pythonGH-152892)

* the kolektor

* test

* better test

* news

* =Q, move const to the base, not self.running

* pythongh-151292: Track binary writer finalization state

---------
(cherry picked from commit f839c06)

Co-authored-by: Maurycy Pawłowski-Wieroński <maurycy@maurycy.com>
Co-authored-by: Pablo Galindo Salgado <Pablogsal@gmail.com>
@miss-islington @vstinner
[3.15] pythongh-158583: Fix uninitialized memory read in bytes.fromhe…
4f7af46 
…x() (pythonGH-158584) (python#158691)

pythongh-158583: Fix uninitialized memory read in bytes.fromhex() (pythonGH-158584)
(cherry picked from commit 9d22a53)

Co-authored-by: Victor Stinner <vstinner@python.org>
@pablogsal @maurycy
[3.15] pythongh-154194: Degrade frames in Tachyon instead of failing …
c27f494 
…the sample (pythonGH-154195) (python#158831)

* pythongh-154194: Degrade frames in Tachyon instead of failing the sample (python#154195)

* degrade gracefully

* news

* better NEWS wording

* do not raise on MAX_REMOTE_STR_READ

* bye MAX_REMOTE_STR_READ

* fix -m asyncio ps|pstree

* test truncation and linetable sentinel

* simpler

* simpler

* redundant now

* respect python#157790 in the news

---------

Co-authored-by: Pablo Galindo Salgado <Pablogsal@gmail.com>
(cherry picked from commit 7d25916)

* Preserve the stable ABI when creating fallback frame names

---------

Co-authored-by: Maurycy Pawłowski-Wieroński <maurycy@maurycy.com>
@pablogsal @StanFromIreland @vstinner
[3.15] Add MSan to CI (pythonGH-158625) (python#158832)
1bc78de 
Run a job that the test suite with MSan to the CI (python#158625)

* Run the test suite with MSan in CI

* Additional fixes

* Add `_Py_MSAN_UNPOISON_STRING`

* Apply Victor's suggestions



* Apply Victor's suggestions



---------


(cherry picked from commit b93fb19)

Co-authored-by: Stan Ulbrych <stan@python.org>
Co-authored-by: Victor Stinner <victor.stinner@gmail.com>
@miss-islington @tonghuaroot
[3.15] pythongh-156810: Write the profiler's collapsed-stack export a…
fce28da 
…s UTF-8 (pythonGH-156811) (python#156814)

pythongh-156810: Write the profiler's collapsed-stack export as UTF-8 (pythonGH-156811)
(cherry picked from commit c3706f4)

Co-authored-by: tonghuaroot (童话) <tonghuaroot@gmail.com>
@miss-islington @maurycy @pablogsal
[3.15] pythongh-154060: Fix the Profile Stats offsets in the profil…
6dfba4d 
…ing binary format docs and a missing flag (pythonGH-157871) (python#158855)

pythongh-154060: Fix the `Profile Stats` offsets in the profiling binary format docs and a missing flag (pythonGH-157871)

* correct profile stats size and paddings

* missing flag

* pythongh-154060: Clarify the main-thread status flag

---------
(cherry picked from commit 8df2580)

Co-authored-by: Maurycy Pawłowski-Wieroński <maurycy@maurycy.com>
Co-authored-by: Pablo Galindo Salgado <Pablogsal@gmail.com>
@miss-islington @pablogsal
[3.15] pythongh-158552: Wait for Windows threads to suspend before bl…
31288da 
…ocking sampling (pythonGH-158802) (python#158845)

pythongh-158552: Wait for Windows threads to suspend before blocking sampling (pythonGH-158802)

* pythongh-158552: Wait for Windows threads to suspend before blocking sampling

* Use a named Windows thread enumeration status constant
(cherry picked from commit 1643525)

Co-authored-by: Pablo Galindo Salgado <Pablogsal@gmail.com>
@pablogsal @tonghuaroot
[3.15] pythongh-152721: Fix quadratic RLE replay time in the profilin…
ebaca2a 
…g binary reader (pythonGH-152722) (python#158850)

Backport of pythonGH-152722.

Co-authored-by: tonghuaroot <tonghuaroot@gmail.com>
@pablogsal @tonghuaroot
[3.15] pythongh-156545: Fix flamegraph export RecursionError on deepl…
0ac7217 
…y recursive programs (pythonGH-156546) (python#158851)

Backport of pythonGH-156546.

Co-authored-by: tonghuaroot (童话) <tonghuaroot@gmail.com>
@miss-islington @hetaozdh @edvilme
[3.15] pythongh-158540: Add the profiled script's directory to sys.pa…
f52d831 
…th (pythonGH-158548) (python#158844)

pythongh-158540: Add the profiled script's directory to sys.path (pythonGH-158548)

* pythongh-158540: Add the profiled script's directory to sys.path

When a script is profiled with ``python -m profiling.sampling run
script.py`` from another directory, the script cannot import modules
placed next to it, because ``_sync_coordinator._execute_script()``
executes it with the working directory (added by
``_setup_environment()`` for the module case) as ``sys.path[0]``
instead of the script's own directory.

Make the script's directory importable in ``_execute_script()``,
matching the behavior of ``python script.py``.

Add a regression test that runs the coordinator on a script importing
a sibling module.

* Update _sync_coordinator.py Comment simplified



* pythongh-158540: Resolve symlinks when adding the script directory to sys.path

``python script.py`` resolves symlinks when computing ``sys.path[0]``, so
a script reached through a symlink (``link.py -> sub/where.py``) imports
modules from the real script's directory.  Apply ``os.path.realpath()``
before taking the directory name, and make sure the result is placed at
the front of ``sys.path`` even if it was already listed.

Add a regression test for a symlinked script.

---------
(cherry picked from commit 3f02aab)

Co-authored-by: he_tao <53343436+hetaozdh@users.noreply.github.com>
Co-authored-by: Eduardo Villalpando Mello <eduardo.villalpando.mello@gmail.com>
@pablogsal @tonghuaroot
[3.15] pythongh-153838: Skip non-regular source files in the heatmap …
48998df 
…exporter (pythonGH-153839) (python#158853)

Backport of pythonGH-153839.

Co-authored-by: tonghuaroot <tonghuaroot@gmail.com>
@pablogsal @hetaozdh
[3.15] pythongh-158539: Fix exception mode missing handlers in genera…
d625ecb 
…tors/coroutines (pythonGH-158581) (python#158852)

* [3.15] pythongh-158539: Fix exception mode missing handlers in generators/coroutines (pythonGH-158581)

Backport of pythonGH-158581.

Co-authored-by: LucasZhou <donghao.zhou@outlook.com>

* [3.15] pythongh-158539: Use portable static assertion messages

* [3.15] pythongh-158539: Keep layout assertions with debug-offset validation

* [3.15] pythongh-158539: Use the platform guard for in-process inspection tests

---------

Co-authored-by: LucasZhou <donghao.zhou@outlook.com>
@pablogsal @deadlovelll
[3.15] pythongh-158522: Fix truncated stack for a task whose coroutin…
a904b39 
…e recurses (pythonGH-158526) (python#158870)

Co-authored-by: Timofei Ivankov <128279579+deadlovelll@users.noreply.github.com>
@pablogsal
[3.15] Revert backports merged during the 3.15.0 release freeze on 5 …
c49b3dc 
…October (python#158873)
@miss-islington @encukou
[3.15] pythongh-158098: Add Setuptools workaround to abi3t migration …
965e2b7 
…guide (pythonGH-158405) (python#158601)

Co-authored-by: Petr Viktorin <encukou@gmail.com>
@miss-islington @mhsmith
[3.15] pythongh-158536: Skip some Android logging tests on OS version…
6fae227 
…s with aggressive "chatty" filtering (pythonGH-158531) (python#158537)

Co-authored-by: Malcolm Smith <smith@chaquo.com>
@miss-islington @ngoldbaum
@encukou @hugovk
[3.15] Doc: update abi3t build tool support (pythonGH-158171) (python…
874d112 
…#158959)

Co-authored-by: Nathan Goldbaum <nathan.goldbaum@gmail.com>
Co-authored-by: Petr Viktorin <encukou@gmail.com>
Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>
@miss-islington @maurycy
[3.15] Fix the sys.remote_exec row in the audit events table (pytho…
19fd4df 
…nGH-158940) (python#158949)

Co-authored-by: Maurycy Pawłowski-Wieroński <maurycy@maurycy.com>
@miss-islington @hugovk
[3.15] pythongh-142927: Update Tachyon examples (pythonGH-159050) (py…
e5f271f 
…thon#159052)

Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>
@miss-islington @hugovk
[3.15] pythongh-133879: Announce final release in What's New in Pytho…
ed062fa 
…n 3.15 (pythonGH-158256) (python#159053)

Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>
@miss-islington @hugovk
[3.15] Update Docs lockfile to use blurb 2.2.0 (pythonGH-159058) (pyt…
cc3c98b 
…hon#159060)

Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>
@hugovk
Python 3.15.0
d220409
@xFrednet Matthew A Johnson
@mjp41 @kulisak12 @TobiasWrigstad
Immutability: Proposed code changes for PEP 795.
674e84b 
Co-authored-by: Matthew A Johnson <matjoh@microsoft.com>
Co-authored-by: Matthew Parkinson <mattpark@microsoft.com>
Co-authored-by: David Klement <kulisak12lp@gmail.com>
Co-authored-by: Tobias Wrigstad <tobias.wrigstad@it.uu.se>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mjp41 mjp41 Awaiting requested review from mjp41

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.