`uv pip install` private pypi repo doesn't work when used in docker by default

[Pebin]

uv:0.4.24
linux, opensuse

Hi, there seems to be a difference how pip and uv searches for private pypi repos in docker, outside of docker both work just fine.

When I am using pip install, everything is installed properly but with uv it fails with the following error

#14 0.500 DEBUG Transient request failure for https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/, retrying: error sending request for url (https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/)
#14 0.500   Caused by: client error (Connect)
#14 0.500   Caused by: dns error: failed to lookup address information: Name does not resolve
#14 0.500   Caused by: failed to lookup address information: Name does not resolve

Here is the full dockerfile

    FROM ghcr.io/astral-sh/uv:0.4.24 AS uv

    FROM python:3.9.20-slim-bookworm
    
    # create virtual env to be copied into runtime image later
    RUN python -m venv /opt/venv
    
    ENV PATH="/opt/venv/bin:$PATH"
    
    COPY --from=uv /uv /bin/uv
    
    COPY requirements.txt ./
    
    RUN --mount=type=secret,id=netrc,required,target=/root/.netrc pip install --verbose -r requirements.txt
    
    # again the same for the uv
    
    RUN rm -rf /opt/venv
    
    # create virtual env to be copied into runtime image later
    RUN python -m venv /opt/venv
    
    RUN --mount=type=secret,id=netrc,required,target=/root/.netrc uv pip install -v -r requirements.txt

Here is the output for the docker build command. Both pip and uv pip.

Removed the unrelated layers to make it a little bit shorter

docker build --secret id=netrc,src=$HOME/.netrc --progress=plain --no-cache . | tee build.log

#8 [stage-1 2/8] RUN python -m venv /opt/venv
#8 DONE 3.4s

#9 [stage-1 3/8] COPY --from=uv /uv /bin/uv
#9 DONE 2.8s

#10 [stage-1 4/8] COPY requirements.txt ./
#10 DONE 0.2s

#11 [stage-1 5/8] RUN --mount=type=secret,id=netrc,required,target=/root/.netrc pip install --verbose -r requirements.txt
#11 0.561 Using pip 23.0.1 from /opt/venv/lib/python3.9/site-packages/pip (python 3.9)
#11 0.591 Looking in indexes: https://pypi.org/simple, https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple
#11 1.288 Collecting alembic==1.13.3
#11 1.502   Downloading alembic-1.13.3-py3-none-any.whl (233 kB)
#11 1.663      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 233.2/233.2 kB 1.4 MB/s eta 0:00:00
#11 2.255 Collecting tm-redis==2.1.1
#11 2.539   Downloading https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/files/6cc2163fbb385478d9f1319f62b351cafa2965d8b296c5e5cb118ac7270dc8bd/tm_redis-2.1.1-py3-none-any.whl (5.5 kB)
#11 3.977 Collecting SQLAlchemy>=1.3.0
#11 4.078   Downloading SQLAlchemy-2.0.36-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
#11 4.930      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 3.6 MB/s eta 0:00:00
#11 5.442 Collecting Mako
#11 5.499   Downloading Mako-1.3.6-py3-none-any.whl (78 kB)
#11 5.529      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.6/78.6 kB 2.5 MB/s eta 0:00:00
#11 5.810 Collecting typing-extensions>=4
#11 5.866   Downloading typing_extensions-4.12.2-py3-none-any.whl (37 kB)
#11 6.245 Collecting redis<5.0.0,>=4.4.0
#11 6.303   Downloading redis-4.6.0-py3-none-any.whl (241 kB)
#11 6.350      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 241.1/241.1 kB 6.0 MB/s eta 0:00:00
#11 7.091 Collecting pydantic<3
#11 7.157   Downloading pydantic-2.9.2-py3-none-any.whl (434 kB)
#11 7.229      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 434.9/434.9 kB 6.1 MB/s eta 0:00:00
#11 7.502 Collecting annotated-types>=0.6.0
#11 7.558   Downloading annotated_types-0.7.0-py3-none-any.whl (13 kB)
#11 10.29 Collecting pydantic-core==2.23.4
#11 10.35   Downloading pydantic_core-2.23.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB)
#11 10.82      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 4.4 MB/s eta 0:00:00
#11 11.29 Collecting async-timeout>=4.0.2
#11 11.34   Downloading async_timeout-4.0.3-py3-none-any.whl (5.7 kB)
#11 12.24 Collecting greenlet!=0.4.17
#11 12.29   Downloading greenlet-3.1.1-cp39-cp39-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (597 kB)
#11 12.40      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 597.4/597.4 kB 5.7 MB/s eta 0:00:00
#11 12.95 Collecting MarkupSafe>=0.9.2
#11 13.02   Downloading MarkupSafe-3.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (20 kB)
#11 13.12 Installing collected packages: typing-extensions, MarkupSafe, greenlet, async-timeout, annotated-types, SQLAlchemy, redis, pydantic-core, Mako, pydantic, alembic, tm-redis
#11 14.23   changing mode of /opt/venv/bin/mako-render to 755
#11 14.55   changing mode of /opt/venv/bin/alembic to 755
#11 14.59 Successfully installed Mako-1.3.6 MarkupSafe-3.0.2 SQLAlchemy-2.0.36 alembic-1.13.3 annotated-types-0.7.0 async-timeout-4.0.3 greenlet-3.1.1 pydantic-2.9.2 pydantic-core-2.23.4 redis-4.6.0 tm-redis-2.1.1 typing-extensions-4.12.2
#11 14.86 
#11 14.86 [notice] A new release of pip is available: 23.0.1 -> 24.2
#11 14.86 [notice] To update, run: pip install --upgrade pip
#11 DONE 17.0s

#12 [stage-1 6/8] RUN rm -rf /opt/venv
#12 DONE 0.8s

#13 [stage-1 7/8] RUN python -m venv /opt/venv
#13 DONE 4.2s

#14 [stage-1 8/8] RUN --mount=type=secret,id=netrc,required,target=/root/.netrc uv pip install -v -r requirements.txt
#14 0.450 DEBUG uv 0.4.24
#14 0.451 DEBUG Searching for default Python interpreter in system path
#14 0.494 DEBUG Found `cpython-3.9.20-linux-x86_64-gnu` at `/opt/venv/bin/python` (search path)
#14 0.494 Using Python 3.9.20 environment at /opt/venv
#14 0.494 DEBUG Acquired lock for `/opt/venv`
#14 0.494 DEBUG At least one requirement is not satisfied: tm-redis==2.1.1
#14 0.495 DEBUG Using request timeout of 30s
#14 0.495 DEBUG Solving with installed Python version: 3.9.20
#14 0.495 DEBUG Solving with target Python version: >=3.9.20
#14 0.495 DEBUG Adding direct dependency: alembic==1.13.3
#14 0.495 DEBUG Adding direct dependency: tm-redis==2.1.1
#14 0.495 DEBUG No cache entry for: https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/
#14 0.496 DEBUG No cache entry for: https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/tm-redis/
#14 0.500 DEBUG Transient request failure for https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/, retrying: error sending request for url (https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/)
#14 0.500   Caused by: client error (Connect)
#14 0.500   Caused by: dns error: failed to lookup address information: Name does not resolve
#14 0.500   Caused by: failed to lookup address information: Name does not resolve
#14 0.500 DEBUG Transient request failure for https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/tm-redis/, retrying: error sending request for url (https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/tm-redis/)
#14 0.500   Caused by: client error (Connect)
#14 0.500   Caused by: dns error: failed to lookup address information: Name does not resolve
#14 0.500   Caused by: failed to lookup address information: Name does not resolve
#14 0.672 DEBUG Transient request failure for https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/, retrying: error sending request for url (https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/)
#14 0.672   Caused by: client error (Connect)
#14 0.672   Caused by: dns error: failed to lookup address information: Name does not resolve
#14 0.672   Caused by: failed to lookup address information: Name does not resolve
#14 1.252 DEBUG Transient request failure for https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/tm-redis/, retrying: error sending request for url (https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/tm-redis/)
#14 1.252   Caused by: client error (Connect)
#14 1.252   Caused by: dns error: failed to lookup address information: Name does not resolve
#14 1.252   Caused by: failed to lookup address information: Name does not resolve
#14 1.801 DEBUG Transient request failure for https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/, retrying: error sending request for url (https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/)
#14 1.801   Caused by: client error (Connect)
#14 1.801   Caused by: dns error: failed to lookup address information: Name does not resolve
#14 1.801   Caused by: failed to lookup address information: Name does not resolve
#14 1.837 DEBUG Transient request failure for https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/, retrying: error sending request for url (https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/)
#14 1.837   Caused by: client error (Connect)
#14 1.837   Caused by: dns error: failed to lookup address information: Name does not resolve
#14 1.837   Caused by: failed to lookup address information: Name does not resolve
#14 1.837 DEBUG Released lock at `/opt/venv/.lock`
#14 1.837 error: Could not connect, are you offline?
#14 1.837   Caused by: Request failed after 3 retries
#14 1.837   Caused by: error sending request for url (https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/)
#14 1.837   Caused by: client error (Connect)
#14 1.837   Caused by: dns error: failed to lookup address information: Name does not resolve
#14 1.837   Caused by: failed to lookup address information: Name does not resolve
#14 ERROR: process "/bin/sh -c uv pip install -v -r requirements.txt" did not complete successfully: exit code: 2
------
 > [stage-1 8/8] RUN --mount=type=secret,id=netrc,required,target=/root/.netrc uv pip install -v -r requirements.txt:
1.837   Caused by: client error (Connect)
1.837   Caused by: dns error: failed to lookup address information: Name does not resolve
1.837   Caused by: failed to lookup address information: Name does not resolve
1.837 DEBUG Released lock at `/opt/venv/.lock`
1.837 error: Could not connect, are you offline?
1.837   Caused by: Request failed after 3 retries
1.837   Caused by: error sending request for url (https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple/alembic/)
1.837   Caused by: client error (Connect)
1.837   Caused by: dns error: failed to lookup address information: Name does not resolve
1.837   Caused by: failed to lookup address information: Name does not resolve
------
Dockerfile:23
--------------------
  21 |     RUN python -m venv /opt/venv
  22 |     
  23 | >>> RUN --mount=type=secret,id=netrc,required,target=/root/.netrc uv pip install -v -r requirements.txt
  24 |     
--------------------
ERROR: failed to solve: process "/bin/sh -c uv pip install -v -r requirements.txt" did not complete successfully: exit code: 2

the installed requirements file looks like this

--index-url https://pypi.org/simple
--extra-index-url https://gitlab.tmloc.com/api/v4/groups/7/-/packages/pypi/simple

alembic==1.13.3

tm-redis==2.1.1

Do you have any idea what could be the issue?

It can be workarounded by manually writing the DNS ip addresses to /etc/docker/daemon.json but I guess that it should behave the same as pip 🤷

[sparfenyuk]

Still happens to 0.5.20. Reproduces in the freshly configured Ubuntu:22.04 (WSL distro)

[atigbadr]

I'm getting this while building images on DinD environment as well.

[zanieb]

Sorry I'm not sure how uv could fix this or why it's different— we're just using a standard reqwest network stack.

[atigbadr]

Sorry I'm not sure how uv could fix this or why it's different— we're just using a standard reqwest network stack.

Using pip install works with no issue, apt install, every other command works except for UV
Including UV pip install and UV python install

I think it is related to UV somehow

[zanieb]

As I said, it's likely this is a "Rust networking stack" problem not a "uv" problem. Some brief research

• https://stackoverflow.com/a/72545037
• https://stackoverflow.com/questions/68397898/minimal-docker-for-networking-rust-binary/68409203#68409203
• https://docs.rs/hickory-resolver/latest/hickory_resolver/

[plusls]

A simple patch to fix it:

diff --git a/crates/uv-client/Cargo.toml b/crates/uv-client/Cargo.toml
index 529e4afcc..d8b6981d1 100644
--- a/crates/uv-client/Cargo.toml
+++ b/crates/uv-client/Cargo.toml
@@ -53,6 +53,7 @@ tokio = { workspace = true }
 tokio-util = { workspace = true }
 tracing = { workspace = true }
 url = { workspace = true }
+reqwest-hickory-resolver = "0.1.0"

 [dev-dependencies]
 anyhow = { workspace = true }
diff --git a/crates/uv-client/src/base_client.rs b/crates/uv-client/src/base_client.rs
index 3c7a5eb71..2a95e14de 100644
--- a/crates/uv-client/src/base_client.rs
+++ b/crates/uv-client/src/base_client.rs
@@ -21,6 +21,7 @@ use uv_platform_tags::Platform;
 use uv_static::EnvVars;
 use uv_version::version;
 use uv_warnings::warn_user_once;
+use reqwest_hickory_resolver::HickoryResolver;

 use crate::linehaul::LineHaul;
 use crate::middleware::OfflineMiddleware;
@@ -270,6 +271,7 @@ impl<'a> BaseClientBuilder<'a> {
     ) -> Client {
         // Configure the builder.
         let client_builder = ClientBuilder::new()
+            .dns_resolver(Arc::new(HickoryResolver::default()))
             .http1_title_case_headers()
             .user_agent(user_agent)
             .pool_max_idle_per_host(20)

[stevapple]

@plusls Would you mind proposing a PR with the fix? It is life-saving for distributing app with Docker,

[plusls]

@plusls Would you mind proposing a PR with the fix? It is life-saving for distributing app with Docker,

This patch modifies reqwest's DNS implementation to hickory. Therefore, it is not suitable for direct submission as a PR and should instead be made a configurable option in uv or a Rust feature.

[zanieb]

I don't fully understand the implications of the hickory resolver, it'd be great if someone had more context on that.

[plusls]

I don't fully understand the implications of the hickory resolver, it'd be great if someone had more context on that.

Because uv default static link with musl libc，it do not support tcp dns resolve
If dns package too large, it will resolv failed

[zanieb]

mm does it work with our non-Docker distributions? Those don't statically link musl libc.