5228 commits

Author	SHA1	Message	Date
John Mumm	f892b8564f	Return Cow from UrlString::with_ methods (#14319) ... A minor performance improvement as a follow-up to #14245 (and an accompanying test).	2025-06-27 13:54:52 -04:00
Zanie Blue	74468dac15	Bump python-build-standalone releases to include 3.14.0b3 (#14301) ... See 20250626	2025-06-27 12:36:07 -05:00
John Mumm	880c5e4949	Ensure preview default Python installs are upgradeable (#14261) ... Python `bin` installations installed with `uv python install --default --preview` (no version specified) were not being installed as upgradeable. Instead each link was pointed at the highest patch version for a minor version. This change ensures that these preview default installations are also treated as upgradeable. The PR includes some updates to the related tests. First, it checks the default install without specified version case. Second, since it's adding more read link checks, it creates a new `read_link` helper method to consolidate repeated logic and replace instances of `#[cfg(unix/windows)` with `if cfg!(unix/windows)`. Fixes #14247	2025-06-27 19:26:28 +02:00
John Mumm	5754f2f2db	Normalize index URLs to remove trailing slash (#14245) ... This PR updates `IndexUrl` parsing to normalize non-file URLs by removing trailing slashes. It also normalizes registry source URLs when using them to validate the lockfile. Prior to this change, when writing an index URL to the lockfile, uv would use a trailing slash if present in the provided URL and no trailing slash otherwise. This can cause surprising behavior. For example, `uv lock --locked` will fail when a package is added with an `--index` value without a trailing slash and then `uv lock --locked` is run with a `pyproject.toml` version of the index URL that contains a trailing slash. This PR fixes this and adds a test for the scenario. It might be safe to normalize file URLs in the same way, but since slashes have a well-defined meaning in the context of files and directories, I chose not to normalize them here. Closes #13707.	2025-06-27 17:11:21 +02:00
John Mumm	a824468c8b	Respect URL-encoded credentials in redirect location (#14315) ... uv currently ignores URL-encoded credentials in a redirect location. This PR adds a check for these credentials to the redirect handling logic. If found, they are moved to the Authorization header in the redirect request. Closes #11097	2025-06-27 16:41:14 +02:00
Charlie Marsh	56266447e2	Bump MSRV and rust-toolchain version (#14303) ... ## Summary Per our versioning policy, we stay two versions back (and 1.88 was released today).	2025-06-27 10:27:45 -04:00
Jack O'Connor	efc361223c	move the test buckets dir into the canonicalized temp dir ... Previously we were using the XDG data dir to avoid symlinks, but there's no particular guarantee that that's not going to be a symlink too. Using the canonicalized temp dir by default is also slightly nicer for a couple reasons: It's sometimes faster (an in-memory tempfs on e.g. Arch), and it makes overriding `$TMPDIR` or `%TMP%` sufficient to control where tests put temp files, without needing to override `UV_INTERNAL__TEST_DIR` too.	2025-06-26 14:56:20 -07:00
Zanie Blue	9ee34dc69b	Fix Indexes::new doc (#14293)	2025-06-26 20:40:40 +00:00
Charlie Marsh	326e4497da	Allow local indexes to reference remote files (#14294) ... ## Summary Previously, we assumed that local indexes only referenced local files. However, it's fine for a local index (like, a `file://`-based Simple API) to reference a remote file, and in fact Pyodide operates this way. Closes https://github.com/astral-sh/uv/issues/14227. ## Test Plan Ran `UV_INDEX=$(pyodide config get package_index) cargo run add anyio`, which produced this lockfile: ```toml version = 1 revision = 2 requires-python = ">=3.13.2" [[package]] name = "anyio" version = "4.9.0" source = { registry = "../../../Library/Caches/.pyodide-xbuildenv-0.30.5/0.27.7/xbuildenv/pyodide-root/package_index" } dependencies = [ { name = "idna" }, { name = "sniffio" }, ] wheels = [ { url = "https://cdn.jsdelivr.net/pyodide/v0.27.7/full/anyio-4.9.0-py3-none-any.whl", hash = "sha256:e1d9180d4361fd71d1bc4a7007fea6cae1d18792dba9d07eaad89f2a8562f71c" }, ] [[package]] name = "foo" version = "0.1.0" source = { virtual = "." } dependencies = [ { name = "anyio" }, ] [package.metadata] requires-dist = [{ name = "anyio", specifier = ">=4.9.0" }] [[package]] name = "idna" version = "3.7" source = { registry = "../../../Library/Caches/.pyodide-xbuildenv-0.30.5/0.27.7/xbuildenv/pyodide-root/package_index" } wheels = [ { url = "https://cdn.jsdelivr.net/pyodide/v0.27.7/full/idna-3.7-py3-none-any.whl", hash = "sha256:9d4685891e3e37434e09b1becda7e96a284e660c7aea9222564d88b6c3527c09" }, ] [[package]] name = "sniffio" version = "1.3.1" source = { registry = "../../../Library/Caches/.pyodide-xbuildenv-0.30.5/0.27.7/xbuildenv/pyodide-root/package_index" } wheels = [ { url = "https://cdn.jsdelivr.net/pyodide/v0.27.7/full/sniffio-1.3.1-py3-none-any.whl", hash = "sha256:9215f9917b34fc73152b134a3fc0a2eb0e4a49b0b956100cad75e84943412bb9" }, ] ```	2025-06-26 20:17:42 +00:00
Charlie Marsh	05ab266200	Avoid using path URL for workspace Git dependencies in requirements.txt (#14288) ... ## Summary Closes https://github.com/astral-sh/uv/issues/13020.	2025-06-26 19:48:12 +00:00
Charlie Marsh	c291d4329a	Include path or URL when failing to convert in lockfile (#14292) ... ## Summary E.g., in #14227, we now get: ``` error: Failed to convert URL to path: https://cdn.jsdelivr.net/pyodide/v0.27.7/full/sniffio-1.3.1-py3-none-any.whl ```	2025-06-26 19:42:04 +00:00
Jack O'Connor	d4d6ede23b	Lock the source tree when running setuptools, to protect concurrent builds ... Fixes https://github.com/astral-sh/uv/issues/13703	2025-06-26 12:28:15 -07:00
Jack O'Connor	60528e3e25	Annotate LockedFile with #[must_use] ... Standard lock guards have the same annotation, because creating them without binding them to a local variable is almost always a mistake.	2025-06-26 12:28:15 -07:00
Zanie Blue	1ff8fc0947	Use Flit instead of Poetry for uninstall tests (#14285) ... Investigating https://github.com/astral-sh/uv/issues/14158	2025-06-26 18:09:04 +00:00
Zanie Blue	8c27c2b494	Add verbose output on flake for run_groups_requires_python (#14275) ... See https://github.com/astral-sh/uv/issues/14160 Same as https://github.com/astral-sh/uv/pull/13817	2025-06-26 12:11:34 -05:00
Zanie Blue	d27cec78b4	Restore snapshot for sync_dry_run (#14274) ... In addition to our flake catch, keep a snapshot. Extends https://github.com/astral-sh/uv/pull/13817	2025-06-26 16:23:37 +00:00
Zanie Blue	469246d177	Fix emit_index_annotation_multiple_indexes test case (#14277) ... uv is taken on Test PyPI now, so the existing test fails	2025-06-26 14:58:24 +00:00
John Mumm	4ed9c5791b	Bump version to 0.7.15 (#14254)	2025-06-25 12:06:41 +02:00
John Mumm	177df19f30	Add check for using minor version link when creating a venv on Windows (#14252) ... There was a regression introduced in #13954 on Windows where creating a venv behaved as if there was a minor version link even if none existed. This PR adds a check to fix this. Closes #14249.	2025-06-25 10:12:32 +02:00
John Mumm	5b2c3595a7	Require disambiguated relative paths for --index (#14152) ... We do not currently support passing index names to `--index` for installing packages. However, we do accept relative paths that can look like index names. This PR adds the requirement that `--index` values must be disambiguated with a prefix (`./` or `../` on Unix and Windows or `.\\` or `..\\` on Windows). For now, if an ambiguous value is provided, uv will warn that this will not be supported in the future. Currently, if you provide an index name like `--index test` when there is no `test` directory, uv will error with a `Directory not found...` error. That's not very informative if you thought index names were supported. The new warning makes the context clearer. Closes #13921	2025-06-25 10:02:06 +02:00
konsti	283323a78a	Allow symlinks in the build backend (#14212) ... In workspaces with multiple packages, you usually don't want to include shared files such as the license repeatedly. Instead, we reading from symlinked files. This would be supported if we had used std's `is_file` and read methods, but walkdir's `is_file` does not consider symlinked files as files. See https://github.com/astral-sh/uv/issues/3957#issuecomment-2994675003	2025-06-25 07:44:22 +00:00
ya7010	ac788d7cde	Update schemars 1.0.0 (#13693) ... <!-- Thank you for contributing to uv! To help us out with reviewing, please consider the following: - Does this pull request include a summary of the change? (See below.) - Does this pull request include a descriptive title? - Does this pull request include references to any relevant issues? --> ## Summary Update [schemars 0.9.0](https://github.com/GREsau/schemars/releases/tag/v0.9.0) There are differences in the generated JSON Schema and I will [contact the author](https://github.com/GREsau/schemars/issues/407). ## Test Plan --------- Co-authored-by: konstin <konstin@mailbox.org>	2025-06-24 21:43:31 +02:00
Christopher Tee	9fba7a4768	Consistently use Ordering::Relaxed for standalone atomic use cases (#14190)	2025-06-24 12:30:26 -07:00
Christopher Tee	fe11ceedfa	Skip GitHub fast path when rate-limited (#13033)	2025-06-24 12:11:41 -07:00
Charlie Marsh	606633d35f	Remove wheel filename benchmark (#14240) ... ## Summary This flakes often and we don't really need it to be monitored continuously. We can always revive it from Git later. Closes https://github.com/astral-sh/uv/issues/13952.	2025-06-24 11:54:12 -04:00
konsti	f20659e1ce	Don't log GitHub fast path usage if it's cached (#14235) ... Don't log that we resolved a reference through the GitHub fast path if we didn't use GitHub at all but used the cached revision. This avoids stating that the fast path works when it's blocked due to unrelated reasons (e.g. rate limits).	2025-06-24 11:53:10 -04:00
Charlie Marsh	093e9d6ff0	Add "python-eol" feature to Sphinx tests (#14241) ... ## Summary Closes https://github.com/astral-sh/uv/issues/14228.	2025-06-24 11:15:18 -04:00
Charlie Marsh	aa2448ef83	Strip query parameters when parsing source URL (#14224) ... ## Summary Closes https://github.com/astral-sh/uv/issues/14217.	2025-06-23 14:52:07 -04:00
Charlie Marsh	d9351d52fc	Remove wheel filename-from URL conversion (#14223) ... ## Summary This appears to be unused.	2025-06-23 14:26:14 -04:00
Aria Desires	92de53f4eb	Bump version to 0.7.14 (#14218)	2025-06-23 12:48:51 -04:00
John Mumm	2d2dd0c1a3	Update upgrade tests to use 3.10.17 instead of 3.10.8 (#14219) ... @oconnor663 discovered that executing `3.10.8` on Arch Linux ran into an error loading `libcrypt.so.1`. This caused uv to install the latest patch version on `uv venv` operations during upgrade tests, which undermined their purpose (since they are checking that if you first install `3.10.8` and then upgrade, virtual environments are transparently upgraded). This PR updates the test to use `3.10.17` instead to avoid this issue.	2025-06-23 18:19:36 +02:00
John Mumm	b06dec8398	Improve Python uninstall perf by removing unnecessary call to installations.find_all() (#14180) ... #13954 introduced an unnecessary slow-down to Python uninstall by calling `installations.find_all()` to discover remaining installations after an uninstall. Instead, we can filter all initial installations against those in `uninstalled`. As part of this change, I've updated `uninstalled` from a `Vec` to an `IndexSet` in order to do efficient lookups in the filter. This required a change I call out below to how we were retrieving them for messaging.	2025-06-23 15:51:44 +02:00
John Mumm	6481aa3e64	Consolidate logic for checking for a virtual environment (#14214) ... We were checking whether a path was an executable in a virtual environment or the base directory of a virtual environment in multiple places in the codebase. This PR consolidates this logic into one place. Closes #13947.	2025-06-23 15:12:43 +02:00
renovate[bot]	3e9dbe8b7d	Update Rust crate mimalloc to v0.1.47 (#14207) ... This PR contains the following updates: | Package | Type | Update | Change | |---|---|---|---| | [mimalloc](https://redirect.github.com/purpleprotocol/mimalloc_rust) | dependencies | patch | `0.1.46` -> `0.1.47` | --- > [!WARNING] > Some dependencies could not be looked up. Check the Dependency Dashboard for more information. --- ### Release Notes <details> <summary>purpleprotocol/mimalloc_rust (mimalloc)</summary> ### [`v0.1.47`](https://redirect.github.com/purpleprotocol/mimalloc_rust/releases/tag/v0.1.47): Version 0.1.47 [Compare Source](https://redirect.github.com/purpleprotocol/mimalloc_rust/compare/v0.1.46...v0.1.47) ##### Changes - Mimalloc `v2.2.4` </details> --- ### Configuration 📅 **Schedule**: Branch creation - "before 4am on Monday" (UTC), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR was generated by [Mend Renovate](https://mend.io/renovate/). View the [repository job log](https://developer.mend.io/github/astral-sh/uv). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiI0MC42Mi4xIiwidXBkYXRlZEluVmVyIjoiNDAuNjIuMSIsInRhcmdldEJyYW5jaCI6Im1haW4iLCJsYWJlbHMiOlsiaW50ZXJuYWwiXX0=--> Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	2025-06-23 12:07:09 +02:00
Charlie Marsh	a82c210cab	Add auto-detection for AMD GPUs (#14176) ... ## Summary Allows `--torch-backend=auto` to detect AMD GPUs. The approach is fairly well-documented inline, but I opted for `rocm_agent_enumerator` over (e.g.) `rocminfo` since it seems to be the recommended approach for scripting: https://rocm.docs.amd.com/projects/rocminfo/en/latest/how-to/use-rocm-agent-enumerator.html. Closes https://github.com/astral-sh/uv/issues/14086. ## Test Plan ``` root@rocm-jupyter-gpu-mi300x1-192gb-devcloud-atl1:~# ./uv-linux-libc-11fb582c5c046bae09766ceddd276dcc5bb41218/uv pip install torch --torch-backend=auto Resolved 11 packages in 251ms Prepared 2 packages in 6ms Installed 11 packages in 257ms + filelock==3.18.0 + fsspec==2025.5.1 + jinja2==3.1.6 + markupsafe==3.0.2 + mpmath==1.3.0 + networkx==3.5 + pytorch-triton-rocm==3.3.1 + setuptools==80.9.0 + sympy==1.14.0 + torch==2.7.1+rocm6.3 + typing-extensions==4.14.0 ``` --------- Co-authored-by: Zanie Blue <contact@zanie.dev>	2025-06-21 15:21:06 +00:00
John Mumm	8352560b98	Only update existing symlink directories on preview uninstall (#14179) ... On preview uninstall, we should not create a new minor version symlink directory if one doesn't exist. We should only update existing ones.	2025-06-21 09:50:41 +02:00
Charlie Marsh	0fef253c4b	Use a dedicated type for form metadata (#14175)	2025-06-20 20:33:29 -04:00
Charlie Marsh	e59835d50c	Add XPU to --torch-backend (#14172) ... ## Summary Like ROCm, no auto-detection for now.	2025-06-20 20:33:20 -04:00
Jack O'Connor	0133bcc8ca	(f)lock during uv run (#14153) ... This is very similar to the locking added for `uv sync`, `uv add`, and `uv remove` in https://github.com/astral-sh/uv/pull/13869. Improving our (f)locking in general is tracked in https://github.com/astral-sh/uv/issues/13883.	2025-06-20 20:34:45 +00:00
Zanie Blue	1dbe750452	Refactor PythonVersionFile global loading (#14107) ... I was looking into `uv tool` not supporting version files, and noticed this implementation was confusing and skipped handling like a tracing log if `--no-config` excludes selection a file. I've refactored it in preparation for the next change.	2025-06-20 15:31:32 -05:00
John Mumm	e9d5780369	Support transparent Python patch version upgrades (#13954) ... > NOTE: The PRs that were merged into this feature branch have all been independently reviewed. But it's also useful to see all of the changes in their final form. I've added comments to significant changes throughout the PR to aid discussion. This PR introduces transparent Python version upgrades to uv, allowing for a smoother experience when upgrading to new patch versions. Previously, upgrading Python patch versions required manual updates to each virtual environment. Now, virtual environments can transparently upgrade to newer patch versions. Due to significant changes in how uv installs and executes managed Python executables, this functionality is initially available behind a `--preview` flag. Once an installation has been made upgradeable through `--preview`, subsequent operations (like `uv venv -p 3.10` or patch upgrades) will work without requiring the flag again. This is accomplished by checking for the existence of a minor version symlink directory (or junction on Windows). ### Features * New `uv python upgrade` command to upgrade installed Python versions to the latest available patch release: ``` # Upgrade specific minor version uv python upgrade 3.12 --preview # Upgrade all installed minor versions uv python upgrade --preview ``` * Transparent upgrades also occur when installing newer patch versions: ``` uv python install 3.10.8 --preview # Automatically upgrades existing 3.10 environments uv python install 3.10.18 ``` * Support for transparently upgradeable Python `bin` installations via `--preview` flag ``` uv python install 3.13 --preview # Automatically upgrades the `bin` installation if there is a newer patch version available uv python upgrade 3.13 --preview ``` * Virtual environments can still be tied to a patch version if desired (ignoring patch upgrades): ``` uv venv -p 3.10.8 ``` ### Implementation Transparent upgrades are implemented using: * Minor version symlink directories (Unix) or junctions (Windows) * On Windows, trampolines simulate paths with junctions * Symlink directory naming follows Python build standalone format: e.g., `cpython-3.10-macos-aarch64-none` * Upgrades are scoped to the minor version key (as represented in the naming format: implementation-minor version+variant-os-arch-libc) * If the context does not provide a patch version request and the interpreter is from a managed CPython installation, the `Interpreter` used by `uv python run` will use the full symlink directory executable path when available, enabling transparently upgradeable environments created with the `venv` module (`uv run python -m venv`) New types: * `PythonMinorVersionLink`: in a sense, the core type for this PR, this is a representation of a minor version symlink directory (or junction on Windows) that points to the highest installed managed CPython patch version for a minor version key. * `PythonInstallationMinorVersionKey`: provides a view into a `PythonInstallationKey` that excludes the patch and prerelease. This is used for grouping installations by minor version key (e.g., to find the highest available patch installation for that minor version key) and for minor version directory naming. ### Compatibility * Supports virtual environments created with: * `uv venv` * `uv run python -m venv` (using managed Python that was installed or upgraded with `--preview`) * Virtual environments created within these environments * Existing virtual environments from before these changes continue to work but aren't transparently upgradeable without being recreated * Supports both standard Python (`python3.10`) and freethreaded Python (`python3.10t`) * Support for transparently upgrades is currently only available for managed CPython installations Closes #7287 Closes #7325 Closes #7892 Closes #9031 Closes #12977 --------- Co-authored-by: Zanie Blue <contact@zanie.dev>	2025-06-20 16:17:13 +02:00
John Mumm	62365d4ec8	Support netrc and same-origin credential propagation on index redirects (#14126) ... This PR is a combination of #12920 and #13754. Prior to these changes, following a redirect when searching indexes would bypass our authentication middleware. This PR updates uv to support propagating credentials through our middleware on same-origin redirects and to support netrc credentials for both same- and cross-origin redirects. It does not handle the case described in #11097 where the redirect location itself includes credentials (e.g., `https://user:pass@redirect-location.com`). That will be addressed in follow-up work. This includes unit tests for the new redirect logic and integration tests for credential propagation. The automated external registries test is also passing for AWS CodeArtifact, Azure Artifacts, GCP Artifact Registry, JFrog Artifactory, GitLab, Cloudsmith, and Gemfury.	2025-06-20 09:21:32 +02:00
Jack O'Connor	cc8d5a9215	handle an existing shebang in uv init --script (#14141) ... Closes https://github.com/astral-sh/uv/issues/14085.	2025-06-19 14:47:22 -07:00
John Mumm	611a13c841	Fix benchmark compilation failure: cannot find attribute clap in this scope (#14128) ... [Two benchmark jobs](4433771099) were failing with `error: cannot find attribute clap in this scope` based on #14120. This updates the recently added `#[clap(name = rocm...` lines to use `cfg_attr(feature = "clap",`.	2025-06-18 16:30:12 +02:00
konsti	ee0ba65eb2	Unify test venv python command creation (#14117) ... Refactoring in preparation for https://github.com/astral-sh/uv/pull/14080	2025-06-18 15:06:09 +02:00
Charlie Marsh	4d9c9a1e76	Add ROCm backends to --torch-backend (#14120) ... We don't yet support automatic detection, but this at least allows explicit selection (e.g., `uv pip install --torch-backend rocm5.3`). Closes #14087.	2025-06-18 07:35:05 -04:00
Aaron Ang	0cac73dc1f	Warn on empty index directory (#13940) ... Close #13922 ## Summary Add a warning if the directory given by the `--index` argument is empty. ## Test Plan Added test case `add_index_empty_directory` in `edit.rs`	2025-06-18 10:48:21 +02:00
Zanie Blue	47c522f9be	Serialize Python requests for tools as canonicalized strings (#14109) ... When working on support for reading global Python pins in tool operations, I noticed that we weren't using the canonicalized Python request in receipts — we were using the raw string provided by the user. Since we'll need to compare these values, we should be using the canonicalized string. The `Tool` and `ToolReceipt` types have been updated to hold a `PythonRequest` instead of a `String`, and `Serialize` was implemented for `PythonRequest` so canonicalization can happen at the edge instead of being the caller's responsibility.	2025-06-17 17:45:11 -05:00
Charlie Marsh	6c096246d8	Remove preview label from --torch-backend (#14119) ... This is now used in enough places that I'm comfortable committing to maintaining it under our versioning policy. Closes #14091.	2025-06-17 16:49:00 -04:00
Zanie Blue	c25c800367	Fix Ruff linting (#14111)	2025-06-17 17:28:23 +00:00