What's New in Python 3.15

159 pointsposted 2 months ago
by azhenley

60 Comments

pjmlp

2 months ago

I am here for the JIT and improved profiling goodies, one day Python will finally be a proper Lisp replacement.

-- https://www.norvig.com/python-lisp.html

nurettin

2 months ago

I had a colleague who was hostile to any language other than common lisp. Except python, which I assume is just because this page exists. What if norvig woke up that day and decided to write about Ruby instead?

pjmlp

2 months ago

Which incidentely has a much better history with JIT adoption than Python, where the community has largely ignored PyPy.

Meanwhile Ruby has had MacRuby from Apple, later canceled, but the main developers went out creating RubyMotion.

Sun toyed with JRuby, it was even officially supported on Netbeans, then Red-Hat supported the project for a while. It was also one of the first dynamic languages on GraalVM, with TruffleRuby. GraalPy effort only came a couple of years later, and is still on baby steps.

As of 2025, the refernce implementation counts with YJIT, MJIT, TenderJIT, and MRuby 4 brings ZJIT to the party.

Exchanging Lisp for Python we went backwards in regards to performance in dynamic languages, in a distopian world where C, C++, Fortran libraries are "Python" libraries.

Nope they are bindings, and any language with FFI can have bindings to those same libraries, e.g. PyTorch can also be used in straight C++, or from Java.

nurettin

a month ago

Special mention and thanks to headius (Charles Oliver Nutter) for his contributions to JRuby, he enabled many of my cross-platform projects back in 201* which would have been harder to build without the expressive and terse syntax Ruby provides and the ability to run jvm pretty much anywhere.

mistrial9

2 months ago

Python community -- meet Schrödinger's cat

cassepipe

2 months ago

What's Python's story for repl driven development ?

sceadu

2 months ago

I usually do REPL driven development in Python via emacs but you can tell it's not the natural way to do things, esp. if you start doing stuff with async. But I still feel that it makes me way more productive than I would otherwise be

pjmlp

2 months ago

It has a Tk based REPL and debugger in the box, and I guess nowadays Jupiter notebooks is the closest to a Lisp Machines/Interlisp-D kind of development.

There are the IDE integrations as well.

Pity is the lack of (compile ...) and (decompile ....), or similar.

Which by the way is available in Julia.

hulitu

2 months ago

> one day Python will finally be a proper Lisp replacement.

Parantheses in Lisp are visible, whitespaces in Python, not really.

BoingBoomTschak

2 months ago

Without s-exprs nor macros? Without reader? With its stupid statement/expression divide?

...Right.

pjmlp

2 months ago

There is a good compromise with reflection, attributes, metaclasses, one line lambdas, comprehensions

Now the lack of machine code generation for something Lisp was doing in the 1960's, Smalltalk in the 1980's, SELF in 1990's, and having to fall back on C, C++ and Fortran is bonkers.

Thankfully this is finally becoming a priority for those willing to sponsor the effort, and kudos to those making it happen.

I would rather use Common Lisp, in something like Allegro, but I will hardly find such a job, thus only arguing about language features doesn't take us that far.

vrighter

2 months ago

a lambda that forces you to define a function elsewhere if you want to do anything nontrivial in it defeats the purpose

testdelacc1

2 months ago

Worth mentioning that this is the documentation of 3.15 alpha 3. I feel like we’re better waiting for a release candidate or the final version before posting this page, in case there are any changes. Most people reading this are going to assume it’s final.

wdroz

2 months ago

In the improved error message [0] how are they able to tell nested attributes without having a big impact in performance? Or maybe this has a big impact on performance, then using exceptions for control flow is deprecated?

    ...
    print(container.area)
> AttributeError: 'Container' object has no attribute 'area'. Did you mean: 'inner.area'?

[0] -- https://docs.python.org/3.15/whatsnew/3.15.html#improved-err...

dotancohen

2 months ago

  > using exceptions for control flow is deprecated?
Exceptions are for the exceptional cases - the ones that mean normal operations are being suspended and error messages are being generated. Don't use them for control flow.

mort96

2 months ago

In Python, an iterator raises a StopIteration exception to indicate to the for loop that the iterator is done iterating.

In Python, the VM raises a KeyboardInterrupt exception when the user hits ctrl+c in order to unwind the stack, run cleanup code and eventually exit the program.

Python is a quite heavy user of exceptions for control flow.

Hendrikto

2 months ago

Typically yes, but not in Python. In Python it is quite common and accepted, and sometimes even recommended as Pythonic to use exceptions for control flow. See iterators, for example.

I really dislike this too, but that’s how it is.

IshKebab

2 months ago

Using exceptions for flow control has always been a bad idea, despite what they might have said. Perhaps they are generating that message lazily though?

On the other hand it's not like Python really cares about performance....

formerly_proven

2 months ago

All iterators in Python use exceptions for flow control, as do all context managers for the abort/rollback case, and it is generally considered Pythonic to use single-indexing (EAFP) instead of check-then-get (LBYL) - generally with indexing and KeyError though and less commonly with attribute access and AttributeError.

[heavy green check mark]

    try:
        data = collection['key']
    except KeyError:
        data = ..try something else..
[red x]

    if 'key' in collection:
         data = collection['key']
    else:
         data = ..try something else..
The latter form also has the genuine disadvantage that nothing ensures the two keys are the same. I've seen typos there somewhat often in code reviews.

sevensor

2 months ago

Last time I measured it, handling KeyError was also significantly faster than checking with “key in collection.” Also, as I was surprised to discover, Python threads are preemptively scheduled, GIL notwithstanding, so it’s possible for the key to be gone from the dictionary by the time you use it, even if it was there when you checked it. Although if you’re creating a situation where this is a problem, you probably have bigger issues.

andy99

2 months ago

to me something like

  for key in possible_keys:
    if key in collection:
      ...
is fine and isn’t subject to your disadvantage.

IshKebab

2 months ago

You should do normally do

    data = collection.get("key")
    if data is not None:
         ...
    else:
         ....

japhyr

2 months ago

Wouldn't this be a little cleaner?

    data = collection.get("key")
    if data:
        ...
    else:
        ...

pansa2

2 months ago

If valid `data` can be zero, an empty string, or anything else “falsy”, then your version won’t handle those values correctly. It treats them the same as `None`, i.e. not found.

blackbear_

2 months ago

No, this would crash with numpy arrays, pandas series and such, with a ValueError: The truth value of an array with more than one element is ambiguous.

IshKebab

2 months ago

No, truthiness (implicit bool coercion) is another thing you should avoid. This will do weird things if data is a string or a list or whatever.

Shish2k

2 months ago

That behaves differently (eg if collection["key"] = 0)

tayo42

2 months ago

it depends on what's in the if blocks

echoangle

2 months ago

The value in the collection could be the actual value None, that’s different from the collection not having the key.

eesmith

2 months ago

    missing = object()
    data = collection.get("key", missing)
    if data is missing:
         ...
    else:
         ....

IshKebab

2 months ago

That's why I said "normally".

amluto

2 months ago

I would like to introduce you to StopIteration.

nemetroid

2 months ago

The new profiling.sampling module looks very neat, but I don't see any way to enable/disable the profiler from code. This greatly limits the usefulness, as I am often in control of the code itself but not how it is launched.

edflsafoiewq

2 months ago

Can definitely think of some places I should use bytearray.take_bytes.

ruuda

2 months ago

> Python now uses UTF-8 as the default encoding, independent of the system’s environment.

Nice, not specifying the encoding is one of the most common issues I need to point out in code reviews.

formerly_proven

2 months ago

encode()/decode() have used UTF-8 as the default since Python 3.2 (soon, 15 years ago). This is about the default encoding for e.g. the "encoding" parameter of open().

franga2000

2 months ago

You mean the coding= comment? Where are you shipping your code that that was actually a problem? I've never been on a project where we did that, let alone needed it.

KORraN

2 months ago

The comment you mention applies to source code encoding and it's obsolete for Python 3 since the beginning. This is about something else: https://docs.python.org/3.15/whatsnew/3.15.html#whatsnew315-...

franga2000

2 months ago

Makes sense, my bad, but even that is something I've never seen. I guess this is mostly a Windows thing? I've luckily never had the misfortune of having to deploy Python code on Windows.

ruuda

2 months ago

It's a Linux thing too. It bit me in particular when running a script in a container that defaulted to ascii rather than utf-8 locale.

stabbles

2 months ago

> On POSIX platforms, platlib directories will be created if needed when creating virtual environments, instead of using lib64 -> lib symlink. This means purelib and platlib of virtual environments no longer share the same lib directory on platforms where sys.platlibdir is not equal to lib.

Sigh. Why can't they just be the same in virtual environments. Who cares about lib64 in a venv? Just another useless search path.

vb-8448

2 months ago

what about making python 5x faster(faster-cpython project)?

amelius

2 months ago

Cool, now I just have to wait until my dependencies support this version.

lucb1e

2 months ago

Doesn't look to me like much got removed that was commonly used. What dependencies do you use that wouldn't automatically work on this version?

regularfry

2 months ago

It's not that uncommon for libraries to declare an overly strict maximum version, even if the code would actually work, because they can't know that at time of setting the version constraint.

lucb1e

2 months ago

Who'd want to be sure it fully breaks with an update instead of having a small chance (a part of) it breaks with an update?!

regularfry

2 months ago

The people who are currently doing so, presumably.

Erenay09

2 months ago

Seeing this reminded me of version 3.14, where π is an infinity expressed through its fractional parts.